2024-09-11T06:52:36.048 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T06:52:36.080 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T06:52:36.159 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648 branch: squid description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit} email: ceph-qa@ceph.com first_in_suite: false job_id: '7900648' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 - machine: cpus: 1 disk: 40 ram: 8000 volumes: count: 4 size: 30 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: rbd qos iops burst: 100 rbd qos iops limit: 50 rbd qos schedule tick min: 100 global: mon client directed command retry: 5 mon warn on pool no app: false ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zstd bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - but it is still running - objects unfound and apparently lost - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum - noscrub - nodeep-scrub sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: daaf78de334647fc0c800f4ac495cc9475a26bae owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 6175 sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc sleep_before_teardown: 0 subset: 88/128 suite: rbd suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: daaf78de334647fc0c800f4ac495cc9475a26bae targets: smithi079.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOzNa8yislMh8GK75XlZbpr7ekm//zaDGWzEBk4HoXxYKD82GywnySbs8TXKWRLDu+H9/VQUDK/ijQpQq2krqM= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMd3/uQsZomjWb1prQOGqL8fOyvswXpgNQhWhSKN/uPzA/1dWIE2GnoIcOVWnQXFrG7vIOxk9Y2jtQz63jWK6tg= tasks: - install: null - ceph: null - thrashosds: timeout: 1200 - rbd_fsx: clients: - client.0 ops: 6000 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_21:16:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T06:52:36.159 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa; will attempt to use it 2024-09-11T06:52:36.160 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa/tasks 2024-09-11T06:52:36.160 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T06:52:36.162 INFO:teuthology.task.internal:Checking packages... 2024-09-11T06:52:36.183 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc' 2024-09-11T06:52:36.184 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T06:52:36.184 INFO:teuthology.packaging:ref: None 2024-09-11T06:52:36.184 INFO:teuthology.packaging:tag: None 2024-09-11T06:52:36.184 INFO:teuthology.packaging:branch: squid 2024-09-11T06:52:36.184 INFO:teuthology.packaging:sha1: b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T06:52:36.184 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-11T06:52:36.414 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T06:52:36.416 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T06:52:36.423 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T06:52:36.423 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T06:52:36.468 INFO:teuthology.task.internal:Saving configuration 2024-09-11T06:52:36.481 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T06:52:36.493 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T06:52:36.517 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi079.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 06:46:56.087925', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIA+h9bflVwOib1cZZyIXEm4hVoBuyhUJp0r3SOdWaq7S'} 2024-09-11T06:52:36.542 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 06:46:56.089760', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAING1mKPRlziaMYpUCjbeyY36ZLGEEMupbDcU4MZOfd7h'} 2024-09-11T06:52:36.542 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T06:52:36.549 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-11T06:52:36.549 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T06:52:36.549 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T06:52:36.627 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2142e83370>, signals=[15]) 2024-09-11T06:52:36.627 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T06:52:36.634 INFO:teuthology.task.internal:Opening connections... 2024-09-11T06:52:36.634 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T06:52:36.635 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:52:36.713 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T06:52:36.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:52:36.793 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T06:52:36.799 DEBUG:teuthology.orchestra.run.smithi079:> uname -m 2024-09-11T06:52:36.804 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2024-09-11T06:52:36.805 DEBUG:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2024-09-11T06:52:36.855 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T06:52:36.855 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="Ubuntu" 2024-09-11T06:52:36.855 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="22.04" 2024-09-11T06:52:36.855 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T06:52:36.855 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_CODENAME=jammy 2024-09-11T06:52:36.856 INFO:teuthology.orchestra.run.smithi079.stdout:ID=ubuntu 2024-09-11T06:52:36.856 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE=debian 2024-09-11T06:52:36.856 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T06:52:36.856 INFO:teuthology.orchestra.run.smithi079.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T06:52:36.856 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T06:52:36.856 INFO:teuthology.orchestra.run.smithi079.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T06:52:36.856 INFO:teuthology.orchestra.run.smithi079.stdout:UBUNTU_CODENAME=jammy 2024-09-11T06:52:36.856 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2024-09-11T06:52:36.879 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-09-11T06:52:36.884 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-09-11T06:52:36.884 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-09-11T06:52:36.934 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T06:52:36.934 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="Ubuntu" 2024-09-11T06:52:36.934 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="22.04" 2024-09-11T06:52:36.934 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T06:52:36.934 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_CODENAME=jammy 2024-09-11T06:52:36.934 INFO:teuthology.orchestra.run.smithi110.stdout:ID=ubuntu 2024-09-11T06:52:36.934 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE=debian 2024-09-11T06:52:36.934 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T06:52:36.934 INFO:teuthology.orchestra.run.smithi110.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T06:52:36.935 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T06:52:36.935 INFO:teuthology.orchestra.run.smithi110.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T06:52:36.935 INFO:teuthology.orchestra.run.smithi110.stdout:UBUNTU_CODENAME=jammy 2024-09-11T06:52:36.935 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-09-11T06:52:36.954 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T06:52:36.964 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T06:52:36.984 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T06:52:36.985 DEBUG:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2024-09-11T06:52:36.987 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-09-11T06:52:36.991 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T06:52:37.009 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T06:52:37.009 DEBUG:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2024-09-11T06:52:37.032 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-09-11T06:52:37.045 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T06:52:37.099 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T06:52:37.114 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T06:52:37.114 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T06:52:37.114 DEBUG:teuthology.orchestra.run.smithi079:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T06:52:37.115 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T06:52:37.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T06:52:37.120 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-11T06:52:37.120 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T06:52:37.121 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-11T06:52:37.166 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-56-generic 2024-09-11T06:52:37.166 INFO:teuthology.task.kernel:Running kernel on smithi110: 5.15.0-56-generic 2024-09-11T06:52:37.166 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-09-11T06:52:37.167 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-56-generic 2024-09-11T06:52:37.167 INFO:teuthology.task.kernel:Running kernel on smithi079: 5.15.0-56-generic 2024-09-11T06:52:37.168 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-09-11T06:52:37.291 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-11T06:52:37.298 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-09-11T06:52:37.446 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T06:52:37.565 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T06:52:37.583 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T06:52:37.641 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T06:52:37.647 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T06:52:37.669 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T06:52:37.710 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T06:52:37.748 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T06:52:37.750 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T06:52:37.751 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T06:52:37.769 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T06:52:37.770 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T06:52:37.773 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T06:52:37.773 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T06:52:37.779 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T06:52:37.783 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T06:52:37.784 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T06:52:37.785 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T06:52:37.785 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T06:52:37.816 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T06:52:37.816 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T06:52:37.868 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T06:52:38.002 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T06:52:38.004 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T06:52:38.107 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T06:52:38.140 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T06:52:38.142 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T06:52:38.188 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T06:52:38.226 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T06:52:38.229 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T06:52:38.229 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T06:52:38.229 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T06:52:38.258 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T06:52:38.263 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T06:52:38.263 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T06:52:38.269 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T06:52:38.276 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T06:52:38.278 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T06:52:38.307 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T06:52:38.307 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T06:52:38.308 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T06:52:38.308 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T06:52:38.334 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T06:52:38.458 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T06:52:38.492 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T06:52:38.493 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T06:52:38.506 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T06:52:38.506 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T06:52:38.508 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T06:52:38.509 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T06:52:38.573 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T06:52:38.576 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T06:52:38.576 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T06:52:38.578 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T06:52:38.590 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T06:52:38.590 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T06:52:38.591 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T06:52:38.591 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T06:52:38.624 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T06:52:38.626 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T06:52:38.644 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T06:52:38.646 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T06:52:38.650 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T06:52:38.652 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T06:52:38.652 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T06:52:38.653 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T06:52:38.657 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T06:52:38.658 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T06:52:38.658 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T06:52:38.706 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T06:52:38.707 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T06:52:38.707 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T06:52:38.709 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T06:52:38.733 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T06:52:38.734 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T06:52:38.735 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T06:52:38.735 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T06:52:38.736 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T06:52:38.736 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T06:52:38.737 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T06:52:38.737 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T06:52:38.737 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T06:52:38.738 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T06:52:38.738 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T06:52:38.739 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T06:52:38.787 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T06:52:38.819 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T06:52:38.820 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T06:52:44.006 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 15.8 MB in 2s (7,601 kB/s) 2024-09-11T06:52:44.694 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 15.8 MB in 3s (6,213 kB/s) 2024-09-11T06:52:45.378 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-11T06:52:45.396 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T06:52:45.451 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-11T06:52:45.635 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-09-11T06:52:45.635 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-09-11T06:52:45.802 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T06:52:45.802 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T06:52:45.802 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T06:52:45.802 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T06:52:45.802 INFO:teuthology.orchestra.run.smithi110.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T06:52:45.803 INFO:teuthology.orchestra.run.smithi110.stdout: python2.7-minimal 2024-09-11T06:52:45.803 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T06:52:45.804 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-09-11T06:52:45.804 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T06:52:45.804 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T06:52:45.804 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T06:52:45.805 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-09-11T06:52:45.805 INFO:teuthology.orchestra.run.smithi110.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T06:52:45.805 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-09-11T06:52:45.805 INFO:teuthology.orchestra.run.smithi110.stdout: thermald 2024-09-11T06:52:45.858 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-09-11T06:52:45.858 INFO:teuthology.orchestra.run.smithi110.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T06:52:45.858 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T06:52:45.859 INFO:teuthology.orchestra.run.smithi110.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T06:52:45.860 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages will be upgraded: 2024-09-11T06:52:45.860 INFO:teuthology.orchestra.run.smithi110.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T06:52:46.041 INFO:teuthology.orchestra.run.smithi110.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T06:52:46.042 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 113 MB of archives. 2024-09-11T06:52:46.042 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T06:52:46.042 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T06:52:46.105 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-11T06:52:46.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T06:52:46.187 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-11T06:52:46.402 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-11T06:52:46.402 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-11T06:52:46.588 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T06:52:46.588 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T06:52:46.588 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T06:52:46.589 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T06:52:46.589 INFO:teuthology.orchestra.run.smithi079.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T06:52:46.589 INFO:teuthology.orchestra.run.smithi079.stdout: python2.7-minimal 2024-09-11T06:52:46.589 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T06:52:46.590 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-11T06:52:46.590 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T06:52:46.590 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T06:52:46.591 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T06:52:46.592 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-11T06:52:46.592 INFO:teuthology.orchestra.run.smithi079.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T06:52:46.592 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-09-11T06:52:46.592 INFO:teuthology.orchestra.run.smithi079.stdout: thermald 2024-09-11T06:52:46.642 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-11T06:52:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T06:52:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T06:52:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T06:52:46.644 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages will be upgraded: 2024-09-11T06:52:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T06:52:46.824 INFO:teuthology.orchestra.run.smithi079.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T06:52:46.824 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 113 MB of archives. 2024-09-11T06:52:46.824 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T06:52:46.824 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T06:52:47.415 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T06:52:47.764 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T06:52:48.250 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T06:52:48.601 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T06:52:49.925 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T06:52:49.925 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T06:52:49.925 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T06:52:50.279 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T06:52:50.361 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T06:52:50.766 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 113 MB in 4s (25.2 MB/s) 2024-09-11T06:52:50.851 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T06:52:50.851 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T06:52:50.851 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T06:52:50.960 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T06:52:51.446 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T06:52:51.584 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T06:52:51.998 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 113 MB in 5s (23.0 MB/s) 2024-09-11T06:52:52.190 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T06:52:53.001 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T06:52:53.005 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T06:52:53.108 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:52:54.238 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T06:52:54.242 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T06:52:54.312 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:52:55.777 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T06:52:55.798 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T06:52:55.887 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:52:56.347 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T06:52:56.368 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T06:52:56.397 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:52:56.813 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T06:52:56.834 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T06:52:56.913 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:52:57.400 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T06:52:57.420 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T06:52:57.458 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:03.035 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T06:53:03.160 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T06:53:03.493 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T06:53:03.597 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T06:53:03.784 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T06:53:03.909 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T06:53:03.984 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T06:53:04.006 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T06:53:04.054 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T06:53:04.192 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T06:53:04.305 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T06:53:04.583 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T06:53:04.594 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T06:53:04.633 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T06:53:10.048 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T06:53:10.086 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T06:53:10.131 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:10.283 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T06:53:10.320 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T06:53:10.358 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:12.860 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T06:53:12.954 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T06:53:13.003 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T06:53:13.969 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T06:53:14.120 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T06:53:14.217 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:14.310 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T06:53:14.432 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:14.558 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T06:53:14.687 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:14.747 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T06:53:14.914 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:16.028 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T06:53:16.028 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T06:53:16.028 INFO:teuthology.orchestra.run.smithi079.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T06:53:16.028 INFO:teuthology.orchestra.run.smithi079.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T06:53:16.180 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:16.248 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T06:53:16.249 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T06:53:16.249 INFO:teuthology.orchestra.run.smithi110.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T06:53:16.249 INFO:teuthology.orchestra.run.smithi110.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T06:53:16.407 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:17.615 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:17.842 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:19.008 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T06:53:19.492 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T06:53:19.894 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T06:53:20.037 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T06:53:20.119 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:20.166 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T06:53:20.166 INFO:teuthology.orchestra.run.smithi079.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T06:53:20.180 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T06:53:20.247 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T06:53:20.248 INFO:teuthology.orchestra.run.smithi110.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T06:53:33.953 INFO:teuthology.orchestra.run.smithi079.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T06:53:33.953 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub' 2024-09-11T06:53:33.976 INFO:teuthology.orchestra.run.smithi079.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T06:53:33.999 INFO:teuthology.orchestra.run.smithi079.stdout:Generating grub configuration file ... 2024-09-11T06:53:34.263 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T06:53:34.292 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T06:53:34.506 INFO:teuthology.orchestra.run.smithi110.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T06:53:34.506 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub' 2024-09-11T06:53:34.531 INFO:teuthology.orchestra.run.smithi110.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T06:53:34.549 INFO:teuthology.orchestra.run.smithi110.stdout:Generating grub configuration file ... 2024-09-11T06:53:34.566 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T06:53:34.571 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T06:53:34.638 INFO:teuthology.orchestra.run.smithi079.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T06:53:34.643 INFO:teuthology.orchestra.run.smithi079.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T06:53:34.799 INFO:teuthology.orchestra.run.smithi079.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T06:53:34.800 INFO:teuthology.orchestra.run.smithi079.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T06:53:34.800 INFO:teuthology.orchestra.run.smithi079.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T06:53:34.848 INFO:teuthology.orchestra.run.smithi079.stdout:done 2024-09-11T06:53:34.850 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T06:53:34.871 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T06:53:35.173 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T06:53:35.179 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T06:53:35.245 INFO:teuthology.orchestra.run.smithi110.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T06:53:35.250 INFO:teuthology.orchestra.run.smithi110.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T06:53:35.348 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-09-11T06:53:35.365 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-09-11T06:53:35.365 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-09-11T06:53:35.365 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-09-11T06:53:35.365 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-09-11T06:53:35.365 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-09-11T06:53:35.366 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T06:53:35.366 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-09-11T06:53:35.366 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-09-11T06:53:35.366 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.119.119 2024-09-11T06:53:35.366 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T06:53:35.366 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T06:53:35.366 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-09-11T06:53:35.366 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-09-11T06:53:35.366 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-09-11T06:53:35.366 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-09-11T06:53:35.366 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T06:53:35.367 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T06:53:35.367 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T06:53:35.367 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T06:53:35.367 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T06:53:35.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get clean 2024-09-11T06:53:35.415 INFO:teuthology.orchestra.run.smithi110.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T06:53:35.415 INFO:teuthology.orchestra.run.smithi110.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T06:53:35.415 INFO:teuthology.orchestra.run.smithi110.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T06:53:35.466 INFO:teuthology.orchestra.run.smithi110.stdout:done 2024-09-11T06:53:35.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-11T06:53:35.802 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T06:53:35.802 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T06:53:35.872 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T06:53:35.954 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T06:53:35.995 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-09-11T06:53:36.038 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-09-11T06:53:36.038 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-09-11T06:53:36.038 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-09-11T06:53:36.038 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-09-11T06:53:36.038 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-09-11T06:53:36.039 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T06:53:36.039 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-09-11T06:53:36.039 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-09-11T06:53:36.039 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.119.119 2024-09-11T06:53:36.039 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T06:53:36.039 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T06:53:36.039 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-09-11T06:53:36.039 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-09-11T06:53:36.039 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-09-11T06:53:36.039 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-09-11T06:53:36.039 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T06:53:36.039 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T06:53:36.040 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T06:53:36.040 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T06:53:36.040 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T06:53:36.040 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get clean 2024-09-11T06:53:36.245 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-09-11T06:53:36.496 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T06:53:36.497 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T06:53:36.568 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T06:53:36.650 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T06:53:37.203 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-11T06:53:37.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T06:53:37.275 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-11T06:53:37.460 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-11T06:53:37.461 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-11T06:53:37.628 INFO:teuthology.orchestra.run.smithi079.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T06:53:37.628 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T06:53:37.628 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T06:53:37.629 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T06:53:37.629 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T06:53:37.629 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T06:53:37.629 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T06:53:37.629 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T06:53:37.666 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T06:53:37.668 DEBUG:teuthology.orchestra.run.smithi079:> dpkg -s linux-image-generic 2024-09-11T06:53:37.728 INFO:teuthology.orchestra.run.smithi079.stdout:Package: linux-image-generic 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Status: install ok installed 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Priority: optional 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Section: kernel 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Installed-Size: 21 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: amd64 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Source: linux-meta 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Version: 5.15.0.119.119 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Recommends: thermald 2024-09-11T06:53:37.729 INFO:teuthology.orchestra.run.smithi079.stdout:Description: Generic Linux kernel image 2024-09-11T06:53:37.730 INFO:teuthology.orchestra.run.smithi079.stdout: This package will always depend on the latest generic kernel image 2024-09-11T06:53:37.730 INFO:teuthology.orchestra.run.smithi079.stdout: available. 2024-09-11T06:53:37.730 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-11T06:53:37.774 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.stzyKcoO6a 2024-09-11T06:53:37.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub/grub.cfg /tmp/tmp.stzyKcoO6a 2024-09-11T06:53:37.841 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.stzyKcoO6a 2024-09-11T06:53:37.871 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-11T06:53:37.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T06:53:37.941 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-11T06:53:37.959 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.stzyKcoO6a is 10KB 2024-09-11T06:53:37.971 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.stzyKcoO6a 2024-09-11T06:53:37.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T06:53:38.030 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T06:53:38.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T06:53:38.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T06:53:38.097 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T06:53:38.098 DEBUG:teuthology.orchestra.run.smithi079:> sudo update-grub 2024-09-11T06:53:38.127 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-09-11T06:53:38.127 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-09-11T06:53:38.294 INFO:teuthology.orchestra.run.smithi110.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T06:53:38.294 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T06:53:38.294 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T06:53:38.294 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T06:53:38.295 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T06:53:38.295 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T06:53:38.295 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T06:53:38.295 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T06:53:38.335 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T06:53:38.337 DEBUG:teuthology.orchestra.run.smithi110:> dpkg -s linux-image-generic 2024-09-11T06:53:38.396 INFO:teuthology.orchestra.run.smithi110.stdout:Package: linux-image-generic 2024-09-11T06:53:38.396 INFO:teuthology.orchestra.run.smithi110.stdout:Status: install ok installed 2024-09-11T06:53:38.396 INFO:teuthology.orchestra.run.smithi110.stdout:Priority: optional 2024-09-11T06:53:38.396 INFO:teuthology.orchestra.run.smithi110.stdout:Section: kernel 2024-09-11T06:53:38.396 INFO:teuthology.orchestra.run.smithi110.stdout:Installed-Size: 21 2024-09-11T06:53:38.396 INFO:teuthology.orchestra.run.smithi110.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T06:53:38.396 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: amd64 2024-09-11T06:53:38.396 INFO:teuthology.orchestra.run.smithi110.stdout:Source: linux-meta 2024-09-11T06:53:38.397 INFO:teuthology.orchestra.run.smithi110.stdout:Version: 5.15.0.119.119 2024-09-11T06:53:38.397 INFO:teuthology.orchestra.run.smithi110.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T06:53:38.397 INFO:teuthology.orchestra.run.smithi110.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T06:53:38.397 INFO:teuthology.orchestra.run.smithi110.stdout:Recommends: thermald 2024-09-11T06:53:38.397 INFO:teuthology.orchestra.run.smithi110.stdout:Description: Generic Linux kernel image 2024-09-11T06:53:38.397 INFO:teuthology.orchestra.run.smithi110.stdout: This package will always depend on the latest generic kernel image 2024-09-11T06:53:38.397 INFO:teuthology.orchestra.run.smithi110.stdout: available. 2024-09-11T06:53:38.397 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-09-11T06:53:38.441 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.pUA8umN5OZ 2024-09-11T06:53:38.442 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub/grub.cfg /tmp/tmp.pUA8umN5OZ 2024-09-11T06:53:38.497 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.pUA8umN5OZ 2024-09-11T06:53:38.628 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.pUA8umN5OZ is 10KB 2024-09-11T06:53:38.641 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.pUA8umN5OZ 2024-09-11T06:53:38.646 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T06:53:38.701 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T06:53:38.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T06:53:38.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T06:53:38.768 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T06:53:38.768 DEBUG:teuthology.orchestra.run.smithi110:> sudo update-grub 2024-09-11T06:53:39.338 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub' 2024-09-11T06:53:39.339 INFO:teuthology.orchestra.run.smithi079.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T06:53:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2024-09-11T06:53:39.504 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T06:53:39.509 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T06:53:39.731 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T06:53:39.736 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T06:53:39.777 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T06:53:39.782 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T06:53:39.904 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T06:53:39.904 INFO:teuthology.orchestra.run.smithi079.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T06:53:39.904 INFO:teuthology.orchestra.run.smithi079.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T06:53:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:done 2024-09-11T06:53:39.920 DEBUG:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2024-09-11T06:53:40.045 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub' 2024-09-11T06:53:40.046 INFO:teuthology.orchestra.run.smithi110.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T06:53:40.050 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-09-11T06:53:40.254 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T06:53:40.260 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T06:53:40.551 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T06:53:40.556 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T06:53:40.595 INFO:teuthology.orchestra.run.smithi110.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T06:53:40.600 INFO:teuthology.orchestra.run.smithi110.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T06:53:40.710 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T06:53:40.711 INFO:teuthology.orchestra.run.smithi110.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T06:53:40.711 INFO:teuthology.orchestra.run.smithi110.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T06:53:40.720 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-09-11T06:53:40.721 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-09-11T06:54:09.943 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T06:54:09.944 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-11T06:54:09.945 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:54:10.724 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T06:54:10.725 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-11T06:54:10.725 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:54:28.413 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-11T06:54:29.181 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-09-11T06:54:37.419 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-11T06:54:37.420 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:54:38.182 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-11T06:54:38.183 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:54:40.477 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-11T06:54:41.245 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-09-11T06:54:52.489 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-11T06:54:52.490 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:54:53.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-11T06:54:53.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:55:10.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2024-09-11T06:55:11.677 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.110 2024-09-11T06:55:25.925 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-11T06:55:25.926 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:55:26.377 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-11T06:55:26.678 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-11T06:55:26.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T06:55:26.995 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-11T06:55:27.240 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-11T06:55:27.240 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-11T06:55:27.240 DEBUG:teuthology.orchestra.run.smithi079:> uname -r 2024-09-11T06:55:27.287 INFO:teuthology.orchestra.run.smithi079.stdout:5.15.0-119-generic 2024-09-11T06:55:27.287 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T06:55:27.287 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T06:55:27.288 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T06:55:27.847 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-11T06:55:27.847 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-11T06:55:27.847 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-09-11T06:55:27.894 INFO:teuthology.orchestra.run.smithi110.stdout:5.15.0-119-generic 2024-09-11T06:55:27.894 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T06:55:27.894 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T06:55:27.894 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T06:55:28.288 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T06:55:28.288 DEBUG:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T06:55:28.458 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2024-09-11T06:55:28.498 DEBUG:teuthology.parallel:result is None 2024-09-11T06:55:28.895 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-11T06:55:28.896 DEBUG:teuthology.orchestra.run.smithi110:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T06:55:28.981 INFO:teuthology.orchestra.run.smithi110.stdout:ttyS1 2024-09-11T06:55:29.004 DEBUG:teuthology.parallel:result is None 2024-09-11T06:55:29.004 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-11T06:55:29.011 INFO:teuthology.task.internal:Creating test directory... 2024-09-11T06:55:29.011 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T06:55:29.013 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-11T06:55:29.019 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-11T06:55:29.039 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-11T06:55:29.072 INFO:teuthology.task.internal:Creating archive directory... 2024-09-11T06:55:29.072 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T06:55:29.074 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-11T06:55:29.091 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-11T06:55:29.130 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-11T06:55:29.130 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T06:55:29.132 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-11T06:55:29.153 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T06:55:29.162 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T06:55:29.163 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T06:55:29.173 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-11T06:55:29.173 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-11T06:55:29.180 INFO:teuthology.task.internal:Configuring sudo... 2024-09-11T06:55:29.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T06:55:29.221 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-11T06:55:29.244 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-11T06:55:29.253 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-11T06:55:29.253 DEBUG:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T06:55:29.289 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-11T06:55:29.294 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T06:55:29.340 DEBUG:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T06:55:29.388 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T06:55:29.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T06:55:29.459 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-11T06:55:29.465 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-11T06:55:29.511 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T06:55:29.512 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-11T06:55:29.579 DEBUG:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2024-09-11T06:55:29.581 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-09-11T06:55:29.822 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-11T06:55:29.829 INFO:teuthology.task.internal:Starting timer... 2024-09-11T06:55:29.829 INFO:teuthology.run_tasks:Running task pcp... 2024-09-11T06:55:29.868 INFO:teuthology.run_tasks:Running task selinux... 2024-09-11T06:55:29.943 DEBUG:teuthology.task.selinux:Excluding smithi079: OS 'ubuntu' does not support SELinux 2024-09-11T06:55:29.943 DEBUG:teuthology.task.selinux:Excluding smithi110: OS 'ubuntu' does not support SELinux 2024-09-11T06:55:29.943 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-11T06:55:29.943 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-11T06:55:29.943 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-11T06:55:29.943 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-11T06:55:30.018 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-11T06:55:30.021 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-11T06:55:30.133 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-11T06:55:30.144 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-11T06:55:30.145 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi079.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-11T07:02:54.631 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi079.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2024-09-11T07:02:54.632 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-11T07:02:54.633 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi079.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T07:02:54.714 DEBUG:teuthology.orchestra.run.smithi079:> true 2024-09-11T07:02:54.792 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi079.front.sepia.ceph.com' 2024-09-11T07:02:54.793 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-11T07:02:54.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T07:02:54.874 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-09-11T07:02:54.952 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-09-11T07:02:54.953 INFO:teuthology.run_tasks:Running task clock... 2024-09-11T07:02:54.964 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-11T07:02:54.964 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T07:02:54.965 DEBUG:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T07:02:54.967 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-11T07:02:54.968 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: Command line: ntpd -gq 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: ---------------------------------------------------- 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: ntp-4 is maintained by Network Time Foundation, 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: corporation. Support and training for ntp-4 are 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: available at https://www.nwtime.org/support 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: ---------------------------------------------------- 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: proto: precision = 0.047 usec (-24) 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: basedate set to 2022-02-04 2024-09-11T07:02:54.996 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: gps base set to 2022-02-06 (week 2196) 2024-09-11T07:02:54.997 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T07:02:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T07:02:54.997 INFO:teuthology.orchestra.run.smithi079.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-11T07:02:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: restrict ::: KOD does nothing without LIMITED. 2024-09-11T07:02:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: Listen and drop on 0 v6wildcard [::]:123 2024-09-11T07:02:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-11T07:02:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: Listen normally on 2 lo 127.0.0.1:123 2024-09-11T07:02:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: Listen normally on 3 enp3s0f1 172.21.15.79:123 2024-09-11T07:02:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: Listen normally on 4 lo [::1]:123 2024-09-11T07:02:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce87%5]:123 2024-09-11T07:02:54.998 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:02:54 ntpd[18425]: Listening on routing socket on fd #22 for interface updates 2024-09-11T07:02:55.018 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-11T07:02:55.018 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: Command line: ntpd -gq 2024-09-11T07:02:55.018 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: ---------------------------------------------------- 2024-09-11T07:02:55.018 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: ntp-4 is maintained by Network Time Foundation, 2024-09-11T07:02:55.018 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-11T07:02:55.018 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: corporation. Support and training for ntp-4 are 2024-09-11T07:02:55.018 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: available at https://www.nwtime.org/support 2024-09-11T07:02:55.018 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: ---------------------------------------------------- 2024-09-11T07:02:55.019 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: proto: precision = 0.045 usec (-24) 2024-09-11T07:02:55.019 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: basedate set to 2022-02-04 2024-09-11T07:02:55.019 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: gps base set to 2022-02-06 (week 2196) 2024-09-11T07:02:55.019 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T07:02:55.020 INFO:teuthology.orchestra.run.smithi110.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-11T07:02:55.020 INFO:teuthology.orchestra.run.smithi110.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-11T07:02:55.021 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: restrict ::: KOD does nothing without LIMITED. 2024-09-11T07:02:55.021 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: Listen and drop on 0 v6wildcard [::]:123 2024-09-11T07:02:55.021 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-11T07:02:55.021 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: Listen normally on 2 lo 127.0.0.1:123 2024-09-11T07:02:55.021 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: Listen normally on 3 enp3s0f1 172.21.15.110:123 2024-09-11T07:02:55.021 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: Listen normally on 4 lo [::1]:123 2024-09-11T07:02:55.021 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc35%5]:123 2024-09-11T07:02:55.021 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:02:55 ntpd[18428]: Listening on routing socket on fd #22 for interface updates 2024-09-11T07:02:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:55 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:55 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:55 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:55 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:55 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:55.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:55 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:55.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:55 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:02:55.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:55 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:02:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:56 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:56 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:56 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:56 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:56.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:56 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:02:56.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:56 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:02:57.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:57 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:57.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:57 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:57.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:57 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:57.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:57 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:57.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:57 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:02:57.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:57 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:02:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:58 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:58 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:58 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:58 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:58 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:58 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:58 ntpd[18428]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:02:58.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:58 ntpd[18428]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:02:58.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:58 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:58.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:58 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:58.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:58 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:58.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:58 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:58.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:58 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:02:58.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:58 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:02:59.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:59 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:59.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:59 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:59.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:59 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:59.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:59 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:59.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:59 ntpd[18428]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:02:59.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:02:59 ntpd[18428]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:02:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:59.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:02:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:02:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:02:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:02:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:02:59.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:02:59 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:03:00.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:00.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:00.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:00.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:00.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:00.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:00.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:03:00.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:03:00.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:00.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:00.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:03:00.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:00 ntpd[18428]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:03:00.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:00 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:00.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:00 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:00.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:00 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:00.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:00 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:00.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:00 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:03:00.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:00 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:03:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:01 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:01 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:01 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:01 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:01.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:01 ntpd[18428]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:03:01.021 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:01 ntpd[18428]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:03:01.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:01 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:01.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:01 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:01.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:01 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:01.996 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:01 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:01.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:01 ntpd[18425]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:01.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:01 ntpd[18425]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:01.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:01 ntpd[18425]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:03:01.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:01 ntpd[18425]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:03:01.997 INFO:teuthology.orchestra.run.smithi079.stdout:11 Sep 07:03:01 ntpd[18425]: ntpd: time slew +0.000296 s 2024-09-11T07:03:01.997 INFO:teuthology.orchestra.run.smithi079.stdout:ntpd: time slew +0.000296s 2024-09-11T07:03:01.997 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:01 ntpd[18425]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-11T07:03:01.998 INFO:teuthology.orchestra.run.smithi079.stderr:11 Sep 07:03:01 ntpd[18425]: can't open /var/log/ntpstats/loopstats.20240911: Permission denied 2024-09-11T07:03:02.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:02.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:02.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:02.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:02.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:02.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:02.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:03:02.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:03:02.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:02.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:02.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:03:02.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:02 ntpd[18428]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:03:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T07:03:02.046 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-09-11T07:03:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T07:03:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T07:03:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T07:03:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T07:03:03.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:03 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:03.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:03 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:03.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:03 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:03.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:03 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:03.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:03 ntpd[18428]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:03:03.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:03 ntpd[18428]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:03:04.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:04 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:04.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:04 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:04.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:04 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:04.019 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:04 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:04.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:04 ntpd[18428]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-11T07:03:04.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:04 ntpd[18428]: can't open /var/log/ntpstats/rawstats.20240911: Permission denied 2024-09-11T07:03:04.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:04 ntpd[18428]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-11T07:03:04.020 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:04 ntpd[18428]: can't open /var/log/ntpstats/peerstats.20240911: Permission denied 2024-09-11T07:03:04.020 INFO:teuthology.orchestra.run.smithi110.stdout:11 Sep 07:03:04 ntpd[18428]: ntpd: time slew +0.000871 s 2024-09-11T07:03:04.020 INFO:teuthology.orchestra.run.smithi110.stdout:ntpd: time slew +0.000871s 2024-09-11T07:03:04.021 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:04 ntpd[18428]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-11T07:03:04.021 INFO:teuthology.orchestra.run.smithi110.stderr:11 Sep 07:03:04 ntpd[18428]: can't open /var/log/ntpstats/loopstats.20240911: Permission denied 2024-09-11T07:03:04.070 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T07:03:04.070 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-09-11T07:03:04.070 INFO:teuthology.orchestra.run.smithi110.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T07:03:04.070 INFO:teuthology.orchestra.run.smithi110.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T07:03:04.070 INFO:teuthology.orchestra.run.smithi110.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T07:03:04.070 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T07:03:04.071 INFO:teuthology.run_tasks:Running task install... 2024-09-11T07:03:04.082 DEBUG:teuthology.task.install:project ceph 2024-09-11T07:03:04.082 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}} 2024-09-11T07:03:04.082 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'} 2024-09-11T07:03:04.082 INFO:teuthology.task.install:Using flavor: default 2024-09-11T07:03:04.088 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-11T07:03:04.088 INFO:teuthology.task.install:extra packages: [] 2024-09-11T07:03:04.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-key list | grep Ceph 2024-09-11T07:03:04.089 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-key list | grep Ceph 2024-09-11T07:03:04.150 INFO:teuthology.orchestra.run.smithi079.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-11T07:03:04.171 INFO:teuthology.orchestra.run.smithi110.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-11T07:03:04.178 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-11T07:03:04.178 INFO:teuthology.orchestra.run.smithi079.stdout:uid [ unknown] Ceph.com (release key) 2024-09-11T07:03:04.179 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-11T07:03:04.179 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T07:03:04.199 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-11T07:03:04.199 INFO:teuthology.orchestra.run.smithi110.stdout:uid [ unknown] Ceph.com (release key) 2024-09-11T07:03:04.200 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-11T07:03:04.200 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T07:03:04.329 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-11T07:03:04.329 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T07:03:04.341 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default/ 2024-09-11T07:03:04.341 INFO:teuthology.task.install.deb:Package version is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T07:03:04.447 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:03:04.447 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-11T07:03:04.454 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:03:04.454 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-11T07:03:04.461 DEBUG:teuthology.orchestra.run.smithi079:> sudo apt-get update 2024-09-11T07:03:04.468 DEBUG:teuthology.orchestra.run.smithi110:> sudo apt-get update 2024-09-11T07:03:04.684 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-11T07:03:04.688 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-11T07:03:04.706 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-11T07:03:04.710 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-11T07:03:04.732 INFO:teuthology.orchestra.run.smithi079.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-11T07:03:04.737 INFO:teuthology.orchestra.run.smithi110.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-11T07:03:04.758 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T07:03:04.758 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T07:03:04.759 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-11T07:03:04.768 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T07:03:04.768 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T07:03:04.768 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-11T07:03:04.790 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-11T07:03:04.800 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,404 B] 2024-09-11T07:03:04.830 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T07:03:04.841 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T07:03:04.912 INFO:teuthology.orchestra.run.smithi079.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T07:03:04.922 INFO:teuthology.orchestra.run.smithi110.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T07:03:05.114 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 29.0 kB in 0s (61.1 kB/s) 2024-09-11T07:03:05.158 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 29.0 kB in 1s (57.5 kB/s) 2024-09-11T07:03:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-11T07:03:06.159 DEBUG:teuthology.orchestra.run.smithi079:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy 2024-09-11T07:03:06.160 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-11T07:03:06.176 DEBUG:teuthology.orchestra.run.smithi110:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-298-gb53b6d3e-1jammy cephadm=19.1.1-298-gb53b6d3e-1jammy ceph-mds=19.1.1-298-gb53b6d3e-1jammy ceph-mgr=19.1.1-298-gb53b6d3e-1jammy ceph-common=19.1.1-298-gb53b6d3e-1jammy ceph-fuse=19.1.1-298-gb53b6d3e-1jammy ceph-test=19.1.1-298-gb53b6d3e-1jammy ceph-volume=19.1.1-298-gb53b6d3e-1jammy radosgw=19.1.1-298-gb53b6d3e-1jammy python3-rados=19.1.1-298-gb53b6d3e-1jammy python3-rgw=19.1.1-298-gb53b6d3e-1jammy python3-cephfs=19.1.1-298-gb53b6d3e-1jammy python3-rbd=19.1.1-298-gb53b6d3e-1jammy libcephfs2=19.1.1-298-gb53b6d3e-1jammy libcephfs-dev=19.1.1-298-gb53b6d3e-1jammy librados2=19.1.1-298-gb53b6d3e-1jammy librbd1=19.1.1-298-gb53b6d3e-1jammy rbd-fuse=19.1.1-298-gb53b6d3e-1jammy 2024-09-11T07:03:06.222 INFO:teuthology.orchestra.run.smithi079.stdout:Reading package lists... 2024-09-11T07:03:06.237 INFO:teuthology.orchestra.run.smithi110.stdout:Reading package lists... 2024-09-11T07:03:06.431 INFO:teuthology.orchestra.run.smithi079.stdout:Building dependency tree... 2024-09-11T07:03:06.432 INFO:teuthology.orchestra.run.smithi079.stdout:Reading state information... 2024-09-11T07:03:06.446 INFO:teuthology.orchestra.run.smithi110.stdout:Building dependency tree... 2024-09-11T07:03:06.447 INFO:teuthology.orchestra.run.smithi110.stdout:Reading state information... 2024-09-11T07:03:06.626 INFO:teuthology.orchestra.run.smithi079.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T07:03:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T07:03:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T07:03:06.626 INFO:teuthology.orchestra.run.smithi079.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T07:03:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T07:03:06.627 INFO:teuthology.orchestra.run.smithi079.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T07:03:06.627 INFO:teuthology.orchestra.run.smithi079.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T07:03:06.628 INFO:teuthology.orchestra.run.smithi079.stdout:The following additional packages will be installed: 2024-09-11T07:03:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-11T07:03:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-11T07:03:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-11T07:03:06.628 INFO:teuthology.orchestra.run.smithi079.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-11T07:03:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-11T07:03:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-11T07:03:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-11T07:03:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-11T07:03:06.629 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-11T07:03:06.630 INFO:teuthology.orchestra.run.smithi079.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-11T07:03:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet zip 2024-09-11T07:03:06.631 INFO:teuthology.orchestra.run.smithi079.stdout:Suggested packages: 2024-09-11T07:03:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-11T07:03:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-11T07:03:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-11T07:03:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-11T07:03:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-11T07:03:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-11T07:03:06.631 INFO:teuthology.orchestra.run.smithi079.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-11T07:03:06.632 INFO:teuthology.orchestra.run.smithi079.stdout:Recommended packages: 2024-09-11T07:03:06.632 INFO:teuthology.orchestra.run.smithi079.stdout: btrfs-tools 2024-09-11T07:03:06.635 INFO:teuthology.orchestra.run.smithi110.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T07:03:06.635 INFO:teuthology.orchestra.run.smithi110.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T07:03:06.636 INFO:teuthology.orchestra.run.smithi110.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T07:03:06.636 INFO:teuthology.orchestra.run.smithi110.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T07:03:06.636 INFO:teuthology.orchestra.run.smithi110.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T07:03:06.636 INFO:teuthology.orchestra.run.smithi110.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T07:03:06.636 INFO:teuthology.orchestra.run.smithi110.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T07:03:06.637 INFO:teuthology.orchestra.run.smithi110.stdout:The following additional packages will be installed: 2024-09-11T07:03:06.637 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-11T07:03:06.638 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-11T07:03:06.638 INFO:teuthology.orchestra.run.smithi110.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-11T07:03:06.638 INFO:teuthology.orchestra.run.smithi110.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-11T07:03:06.638 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-11T07:03:06.638 INFO:teuthology.orchestra.run.smithi110.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-11T07:03:06.639 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-11T07:03:06.640 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-11T07:03:06.640 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet zip 2024-09-11T07:03:06.640 INFO:teuthology.orchestra.run.smithi110.stdout:Suggested packages: 2024-09-11T07:03:06.640 INFO:teuthology.orchestra.run.smithi110.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-11T07:03:06.640 INFO:teuthology.orchestra.run.smithi110.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-11T07:03:06.640 INFO:teuthology.orchestra.run.smithi110.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-11T07:03:06.640 INFO:teuthology.orchestra.run.smithi110.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-11T07:03:06.640 INFO:teuthology.orchestra.run.smithi110.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-11T07:03:06.640 INFO:teuthology.orchestra.run.smithi110.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-11T07:03:06.640 INFO:teuthology.orchestra.run.smithi110.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-11T07:03:06.641 INFO:teuthology.orchestra.run.smithi110.stdout:Recommended packages: 2024-09-11T07:03:06.641 INFO:teuthology.orchestra.run.smithi110.stdout: btrfs-tools 2024-09-11T07:03:06.732 INFO:teuthology.orchestra.run.smithi079.stdout:The following NEW packages will be installed: 2024-09-11T07:03:06.732 INFO:teuthology.orchestra.run.smithi079.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-11T07:03:06.733 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-11T07:03:06.733 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-11T07:03:06.733 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-11T07:03:06.733 INFO:teuthology.orchestra.run.smithi079.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-11T07:03:06.733 INFO:teuthology.orchestra.run.smithi079.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-11T07:03:06.734 INFO:teuthology.orchestra.run.smithi079.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-11T07:03:06.734 INFO:teuthology.orchestra.run.smithi079.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-11T07:03:06.734 INFO:teuthology.orchestra.run.smithi079.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-11T07:03:06.734 INFO:teuthology.orchestra.run.smithi079.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-11T07:03:06.734 INFO:teuthology.orchestra.run.smithi079.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-11T07:03:06.734 INFO:teuthology.orchestra.run.smithi079.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-11T07:03:06.734 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-11T07:03:06.735 INFO:teuthology.orchestra.run.smithi079.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-11T07:03:06.746 INFO:teuthology.orchestra.run.smithi110.stdout:The following NEW packages will be installed: 2024-09-11T07:03:06.746 INFO:teuthology.orchestra.run.smithi110.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-11T07:03:06.746 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-11T07:03:06.747 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-11T07:03:06.747 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-11T07:03:06.747 INFO:teuthology.orchestra.run.smithi110.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-11T07:03:06.747 INFO:teuthology.orchestra.run.smithi110.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-11T07:03:06.748 INFO:teuthology.orchestra.run.smithi110.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-11T07:03:06.748 INFO:teuthology.orchestra.run.smithi110.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-11T07:03:06.748 INFO:teuthology.orchestra.run.smithi110.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-11T07:03:06.748 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-11T07:03:06.748 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-11T07:03:06.748 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-11T07:03:06.748 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-11T07:03:06.748 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-11T07:03:06.748 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-11T07:03:06.749 INFO:teuthology.orchestra.run.smithi110.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-11T07:03:06.876 INFO:teuthology.orchestra.run.smithi079.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-11T07:03:06.876 INFO:teuthology.orchestra.run.smithi079.stdout:Need to get 181 MB of archives. 2024-09-11T07:03:06.876 INFO:teuthology.orchestra.run.smithi079.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-11T07:03:06.876 INFO:teuthology.orchestra.run.smithi079.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-11T07:03:06.893 INFO:teuthology.orchestra.run.smithi110.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-11T07:03:06.893 INFO:teuthology.orchestra.run.smithi110.stdout:Need to get 181 MB of archives. 2024-09-11T07:03:06.893 INFO:teuthology.orchestra.run.smithi110.stdout:After this operation, 829 MB of additional disk space will be used. 2024-09-11T07:03:06.893 INFO:teuthology.orchestra.run.smithi110.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-298-gb53b6d3e-1jammy [3,588 kB] 2024-09-11T07:03:06.922 INFO:teuthology.orchestra.run.smithi079.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-11T07:03:06.937 INFO:teuthology.orchestra.run.smithi110.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-11T07:03:07.151 INFO:teuthology.orchestra.run.smithi110.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-11T07:03:07.155 INFO:teuthology.orchestra.run.smithi079.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-298-gb53b6d3e-1jammy [3,243 kB] 2024-09-11T07:03:07.248 INFO:teuthology.orchestra.run.smithi110.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-11T07:03:07.265 INFO:teuthology.orchestra.run.smithi079.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-298-gb53b6d3e-1jammy [719 kB] 2024-09-11T07:03:07.268 INFO:teuthology.orchestra.run.smithi110.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-11T07:03:07.283 INFO:teuthology.orchestra.run.smithi079.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-298-gb53b6d3e-1jammy [356 kB] 2024-09-11T07:03:07.285 INFO:teuthology.orchestra.run.smithi110.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-11T07:03:07.286 INFO:teuthology.orchestra.run.smithi110.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-11T07:03:07.290 INFO:teuthology.orchestra.run.smithi110.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-11T07:03:07.291 INFO:teuthology.orchestra.run.smithi110.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-11T07:03:07.293 INFO:teuthology.orchestra.run.smithi079.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-298-gb53b6d3e-1jammy [32.8 kB] 2024-09-11T07:03:07.295 INFO:teuthology.orchestra.run.smithi079.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-298-gb53b6d3e-1jammy [180 kB] 2024-09-11T07:03:07.299 INFO:teuthology.orchestra.run.smithi079.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-298-gb53b6d3e-1jammy [67.6 kB] 2024-09-11T07:03:07.301 INFO:teuthology.orchestra.run.smithi079.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-298-gb53b6d3e-1jammy [333 kB] 2024-09-11T07:03:07.307 INFO:teuthology.orchestra.run.smithi110.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-11T07:03:07.308 INFO:teuthology.orchestra.run.smithi079.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-298-gb53b6d3e-1jammy [6,875 kB] 2024-09-11T07:03:07.365 INFO:teuthology.orchestra.run.smithi079.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-11T07:03:07.366 INFO:teuthology.orchestra.run.smithi110.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-11T07:03:07.376 INFO:teuthology.orchestra.run.smithi079.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-11T07:03:07.378 INFO:teuthology.orchestra.run.smithi110.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-11T07:03:07.460 INFO:teuthology.orchestra.run.smithi079.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-11T07:03:07.461 INFO:teuthology.orchestra.run.smithi110.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-11T07:03:07.532 INFO:teuthology.orchestra.run.smithi079.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-11T07:03:07.534 INFO:teuthology.orchestra.run.smithi079.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-11T07:03:07.536 INFO:teuthology.orchestra.run.smithi110.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-298-gb53b6d3e-1jammy [112 kB] 2024-09-11T07:03:07.539 INFO:teuthology.orchestra.run.smithi110.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-298-gb53b6d3e-1jammy [472 kB] 2024-09-11T07:03:07.548 INFO:teuthology.orchestra.run.smithi110.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-11T07:03:07.557 INFO:teuthology.orchestra.run.smithi079.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-298-gb53b6d3e-1jammy [25.9 MB] 2024-09-11T07:03:07.692 INFO:teuthology.orchestra.run.smithi079.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-11T07:03:07.693 INFO:teuthology.orchestra.run.smithi110.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-11T07:03:07.703 INFO:teuthology.orchestra.run.smithi079.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-11T07:03:07.704 INFO:teuthology.orchestra.run.smithi110.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-11T07:03:07.732 INFO:teuthology.orchestra.run.smithi079.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-11T07:03:07.734 INFO:teuthology.orchestra.run.smithi110.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-11T07:03:07.743 INFO:teuthology.orchestra.run.smithi079.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-11T07:03:07.744 INFO:teuthology.orchestra.run.smithi079.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-11T07:03:07.744 INFO:teuthology.orchestra.run.smithi110.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-11T07:03:07.745 INFO:teuthology.orchestra.run.smithi110.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-11T07:03:07.746 INFO:teuthology.orchestra.run.smithi079.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-11T07:03:07.747 INFO:teuthology.orchestra.run.smithi110.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-11T07:03:07.765 INFO:teuthology.orchestra.run.smithi079.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-11T07:03:07.766 INFO:teuthology.orchestra.run.smithi110.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-11T07:03:07.769 INFO:teuthology.orchestra.run.smithi079.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-11T07:03:07.772 INFO:teuthology.orchestra.run.smithi110.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-11T07:03:07.774 INFO:teuthology.orchestra.run.smithi079.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-11T07:03:07.775 INFO:teuthology.orchestra.run.smithi110.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-11T07:03:07.776 INFO:teuthology.orchestra.run.smithi079.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-11T07:03:07.777 INFO:teuthology.orchestra.run.smithi110.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-11T07:03:07.856 INFO:teuthology.orchestra.run.smithi079.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-11T07:03:07.857 INFO:teuthology.orchestra.run.smithi110.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-11T07:03:07.860 INFO:teuthology.orchestra.run.smithi079.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-11T07:03:07.861 INFO:teuthology.orchestra.run.smithi110.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-11T07:03:07.864 INFO:teuthology.orchestra.run.smithi079.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-11T07:03:07.866 INFO:teuthology.orchestra.run.smithi110.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-11T07:03:07.867 INFO:teuthology.orchestra.run.smithi079.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-11T07:03:07.869 INFO:teuthology.orchestra.run.smithi079.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-11T07:03:07.869 INFO:teuthology.orchestra.run.smithi079.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-11T07:03:07.869 INFO:teuthology.orchestra.run.smithi110.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-11T07:03:07.871 INFO:teuthology.orchestra.run.smithi110.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-11T07:03:07.871 INFO:teuthology.orchestra.run.smithi079.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-11T07:03:07.872 INFO:teuthology.orchestra.run.smithi110.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-11T07:03:07.874 INFO:teuthology.orchestra.run.smithi110.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-11T07:03:07.937 INFO:teuthology.orchestra.run.smithi079.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-11T07:03:07.937 INFO:teuthology.orchestra.run.smithi079.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-11T07:03:07.938 INFO:teuthology.orchestra.run.smithi079.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-11T07:03:07.938 INFO:teuthology.orchestra.run.smithi110.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-11T07:03:07.939 INFO:teuthology.orchestra.run.smithi110.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-11T07:03:07.940 INFO:teuthology.orchestra.run.smithi110.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-11T07:03:08.018 INFO:teuthology.orchestra.run.smithi079.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-11T07:03:08.019 INFO:teuthology.orchestra.run.smithi079.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-11T07:03:08.019 INFO:teuthology.orchestra.run.smithi079.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-11T07:03:08.021 INFO:teuthology.orchestra.run.smithi110.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-11T07:03:08.022 INFO:teuthology.orchestra.run.smithi110.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-11T07:03:08.023 INFO:teuthology.orchestra.run.smithi110.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-11T07:03:08.025 INFO:teuthology.orchestra.run.smithi079.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-11T07:03:08.026 INFO:teuthology.orchestra.run.smithi079.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-11T07:03:08.027 INFO:teuthology.orchestra.run.smithi079.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-11T07:03:08.028 INFO:teuthology.orchestra.run.smithi079.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-11T07:03:08.029 INFO:teuthology.orchestra.run.smithi110.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-11T07:03:08.030 INFO:teuthology.orchestra.run.smithi110.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-11T07:03:08.031 INFO:teuthology.orchestra.run.smithi110.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-11T07:03:08.032 INFO:teuthology.orchestra.run.smithi110.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-11T07:03:08.100 INFO:teuthology.orchestra.run.smithi079.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-11T07:03:08.101 INFO:teuthology.orchestra.run.smithi079.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-11T07:03:08.101 INFO:teuthology.orchestra.run.smithi079.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-11T07:03:08.101 INFO:teuthology.orchestra.run.smithi110.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-11T07:03:08.102 INFO:teuthology.orchestra.run.smithi110.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-11T07:03:08.103 INFO:teuthology.orchestra.run.smithi110.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-11T07:03:08.183 INFO:teuthology.orchestra.run.smithi079.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-11T07:03:08.184 INFO:teuthology.orchestra.run.smithi079.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-11T07:03:08.185 INFO:teuthology.orchestra.run.smithi079.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-11T07:03:08.186 INFO:teuthology.orchestra.run.smithi110.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-11T07:03:08.187 INFO:teuthology.orchestra.run.smithi110.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-11T07:03:08.188 INFO:teuthology.orchestra.run.smithi110.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-11T07:03:08.197 INFO:teuthology.orchestra.run.smithi079.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-11T07:03:08.197 INFO:teuthology.orchestra.run.smithi079.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-11T07:03:08.198 INFO:teuthology.orchestra.run.smithi079.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-11T07:03:08.199 INFO:teuthology.orchestra.run.smithi079.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-11T07:03:08.200 INFO:teuthology.orchestra.run.smithi110.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-11T07:03:08.200 INFO:teuthology.orchestra.run.smithi110.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-11T07:03:08.201 INFO:teuthology.orchestra.run.smithi110.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-11T07:03:08.203 INFO:teuthology.orchestra.run.smithi110.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-11T07:03:08.269 INFO:teuthology.orchestra.run.smithi079.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-11T07:03:08.271 INFO:teuthology.orchestra.run.smithi110.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-11T07:03:08.272 INFO:teuthology.orchestra.run.smithi079.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-11T07:03:08.274 INFO:teuthology.orchestra.run.smithi079.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-11T07:03:08.275 INFO:teuthology.orchestra.run.smithi110.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-11T07:03:08.277 INFO:teuthology.orchestra.run.smithi110.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-11T07:03:08.353 INFO:teuthology.orchestra.run.smithi079.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-11T07:03:08.354 INFO:teuthology.orchestra.run.smithi079.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-11T07:03:08.355 INFO:teuthology.orchestra.run.smithi110.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-11T07:03:08.357 INFO:teuthology.orchestra.run.smithi110.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-11T07:03:08.359 INFO:teuthology.orchestra.run.smithi079.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-11T07:03:08.361 INFO:teuthology.orchestra.run.smithi079.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-11T07:03:08.362 INFO:teuthology.orchestra.run.smithi079.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-11T07:03:08.365 INFO:teuthology.orchestra.run.smithi110.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-11T07:03:08.368 INFO:teuthology.orchestra.run.smithi079.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-11T07:03:08.369 INFO:teuthology.orchestra.run.smithi110.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-11T07:03:08.371 INFO:teuthology.orchestra.run.smithi110.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-11T07:03:08.375 INFO:teuthology.orchestra.run.smithi110.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-11T07:03:08.546 INFO:teuthology.orchestra.run.smithi110.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-11T07:03:08.547 INFO:teuthology.orchestra.run.smithi110.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-11T07:03:08.549 INFO:teuthology.orchestra.run.smithi110.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-11T07:03:08.552 INFO:teuthology.orchestra.run.smithi110.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-11T07:03:08.553 INFO:teuthology.orchestra.run.smithi110.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-11T07:03:08.553 INFO:teuthology.orchestra.run.smithi079.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-298-gb53b6d3e-1jammy [5,145 kB] 2024-09-11T07:03:08.553 INFO:teuthology.orchestra.run.smithi079.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-11T07:03:08.555 INFO:teuthology.orchestra.run.smithi110.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-11T07:03:08.556 INFO:teuthology.orchestra.run.smithi079.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-11T07:03:08.558 INFO:teuthology.orchestra.run.smithi079.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-11T07:03:08.559 INFO:teuthology.orchestra.run.smithi079.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-11T07:03:08.562 INFO:teuthology.orchestra.run.smithi079.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-11T07:03:08.604 INFO:teuthology.orchestra.run.smithi079.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-11T07:03:08.607 INFO:teuthology.orchestra.run.smithi079.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-11T07:03:08.608 INFO:teuthology.orchestra.run.smithi079.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-11T07:03:08.613 INFO:teuthology.orchestra.run.smithi110.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-11T07:03:08.616 INFO:teuthology.orchestra.run.smithi110.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-11T07:03:08.617 INFO:teuthology.orchestra.run.smithi110.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-11T07:03:08.626 INFO:teuthology.orchestra.run.smithi110.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-11T07:03:08.629 INFO:teuthology.orchestra.run.smithi110.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-11T07:03:08.630 INFO:teuthology.orchestra.run.smithi110.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-11T07:03:08.633 INFO:teuthology.orchestra.run.smithi079.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-298-gb53b6d3e-1jammy [245 kB] 2024-09-11T07:03:08.635 INFO:teuthology.orchestra.run.smithi079.stdout:Get:73 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-298-gb53b6d3e-1jammy [124 kB] 2024-09-11T07:03:08.637 INFO:teuthology.orchestra.run.smithi079.stdout:Get:74 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-298-gb53b6d3e-1jammy [1,555 kB] 2024-09-11T07:03:08.652 INFO:teuthology.orchestra.run.smithi110.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-11T07:03:08.686 INFO:teuthology.orchestra.run.smithi079.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-298-gb53b6d3e-1jammy [6,143 kB] 2024-09-11T07:03:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-11T07:03:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-11T07:03:08.700 INFO:teuthology.orchestra.run.smithi110.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-11T07:03:08.700 INFO:teuthology.orchestra.run.smithi110.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-11T07:03:08.717 INFO:teuthology.orchestra.run.smithi110.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-11T07:03:08.718 INFO:teuthology.orchestra.run.smithi110.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-11T07:03:08.719 INFO:teuthology.orchestra.run.smithi110.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-11T07:03:08.720 INFO:teuthology.orchestra.run.smithi110.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-11T07:03:08.721 INFO:teuthology.orchestra.run.smithi110.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-11T07:03:08.722 INFO:teuthology.orchestra.run.smithi110.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-11T07:03:08.724 INFO:teuthology.orchestra.run.smithi079.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-11T07:03:08.726 INFO:teuthology.orchestra.run.smithi079.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-11T07:03:08.727 INFO:teuthology.orchestra.run.smithi079.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-11T07:03:08.728 INFO:teuthology.orchestra.run.smithi110.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-11T07:03:08.729 INFO:teuthology.orchestra.run.smithi079.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-11T07:03:08.729 INFO:teuthology.orchestra.run.smithi079.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-11T07:03:08.731 INFO:teuthology.orchestra.run.smithi079.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-11T07:03:08.738 INFO:teuthology.orchestra.run.smithi079.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-11T07:03:08.801 INFO:teuthology.orchestra.run.smithi110.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-11T07:03:08.804 INFO:teuthology.orchestra.run.smithi110.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-11T07:03:08.805 INFO:teuthology.orchestra.run.smithi110.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-11T07:03:08.810 INFO:teuthology.orchestra.run.smithi079.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-11T07:03:08.813 INFO:teuthology.orchestra.run.smithi079.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-11T07:03:08.815 INFO:teuthology.orchestra.run.smithi079.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-11T07:03:08.819 INFO:teuthology.orchestra.run.smithi110.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-11T07:03:08.884 INFO:teuthology.orchestra.run.smithi110.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-11T07:03:08.890 INFO:teuthology.orchestra.run.smithi110.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-11T07:03:08.892 INFO:teuthology.orchestra.run.smithi079.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-11T07:03:08.892 INFO:teuthology.orchestra.run.smithi110.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-11T07:03:08.893 INFO:teuthology.orchestra.run.smithi110.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-11T07:03:08.899 INFO:teuthology.orchestra.run.smithi079.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-11T07:03:08.901 INFO:teuthology.orchestra.run.smithi079.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-11T07:03:08.903 INFO:teuthology.orchestra.run.smithi079.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-11T07:03:08.905 INFO:teuthology.orchestra.run.smithi110.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-11T07:03:08.906 INFO:teuthology.orchestra.run.smithi110.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-11T07:03:08.913 INFO:teuthology.orchestra.run.smithi110.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-11T07:03:08.914 INFO:teuthology.orchestra.run.smithi079.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-11T07:03:08.915 INFO:teuthology.orchestra.run.smithi079.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-11T07:03:08.923 INFO:teuthology.orchestra.run.smithi079.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-11T07:03:08.953 INFO:teuthology.orchestra.run.smithi079.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-298-gb53b6d3e-1jammy [22.8 MB] 2024-09-11T07:03:08.968 INFO:teuthology.orchestra.run.smithi110.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-11T07:03:08.969 INFO:teuthology.orchestra.run.smithi110.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-11T07:03:08.970 INFO:teuthology.orchestra.run.smithi110.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-11T07:03:08.975 INFO:teuthology.orchestra.run.smithi079.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-11T07:03:08.977 INFO:teuthology.orchestra.run.smithi079.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-11T07:03:08.978 INFO:teuthology.orchestra.run.smithi079.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-11T07:03:09.053 INFO:teuthology.orchestra.run.smithi110.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-11T07:03:09.054 INFO:teuthology.orchestra.run.smithi110.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-11T07:03:09.061 INFO:teuthology.orchestra.run.smithi079.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-11T07:03:09.063 INFO:teuthology.orchestra.run.smithi079.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-11T07:03:09.071 INFO:teuthology.orchestra.run.smithi110.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-11T07:03:09.072 INFO:teuthology.orchestra.run.smithi110.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-11T07:03:09.073 INFO:teuthology.orchestra.run.smithi110.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-11T07:03:09.078 INFO:teuthology.orchestra.run.smithi110.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-11T07:03:09.079 INFO:teuthology.orchestra.run.smithi110.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-11T07:03:09.082 INFO:teuthology.orchestra.run.smithi079.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-11T07:03:09.083 INFO:teuthology.orchestra.run.smithi079.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-11T07:03:09.084 INFO:teuthology.orchestra.run.smithi079.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-11T07:03:09.090 INFO:teuthology.orchestra.run.smithi079.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-11T07:03:09.091 INFO:teuthology.orchestra.run.smithi079.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-11T07:03:09.510 INFO:teuthology.orchestra.run.smithi110.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-11T07:03:09.511 INFO:teuthology.orchestra.run.smithi110.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-11T07:03:09.526 INFO:teuthology.orchestra.run.smithi110.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-11T07:03:09.565 INFO:teuthology.orchestra.run.smithi110.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-11T07:03:09.574 INFO:teuthology.orchestra.run.smithi110.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-11T07:03:09.576 INFO:teuthology.orchestra.run.smithi110.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-11T07:03:09.644 INFO:teuthology.orchestra.run.smithi110.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-11T07:03:09.880 INFO:teuthology.orchestra.run.smithi110.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-11T07:03:09.880 INFO:teuthology.orchestra.run.smithi110.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-11T07:03:09.958 INFO:teuthology.orchestra.run.smithi079.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-298-gb53b6d3e-1jammy [14.1 kB] 2024-09-11T07:03:09.958 INFO:teuthology.orchestra.run.smithi079.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [877 kB] 2024-09-11T07:03:09.975 INFO:teuthology.orchestra.run.smithi079.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-298-gb53b6d3e-1jammy [2,462 kB] 2024-09-11T07:03:10.012 INFO:teuthology.orchestra.run.smithi079.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-298-gb53b6d3e-1jammy [794 kB] 2024-09-11T07:03:10.048 INFO:teuthology.orchestra.run.smithi079.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-298-gb53b6d3e-1jammy [152 kB] 2024-09-11T07:03:10.051 INFO:teuthology.orchestra.run.smithi079.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-298-gb53b6d3e-1jammy [2,284 kB] 2024-09-11T07:03:10.134 INFO:teuthology.orchestra.run.smithi079.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-298-gb53b6d3e-1jammy [8,625 kB] 2024-09-11T07:03:10.477 INFO:teuthology.orchestra.run.smithi079.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-298-gb53b6d3e-1jammy [14.2 kB] 2024-09-11T07:03:10.478 INFO:teuthology.orchestra.run.smithi079.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-298-gb53b6d3e-1jammy [51.4 MB] 2024-09-11T07:03:11.597 INFO:teuthology.orchestra.run.smithi110.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-11T07:03:11.599 INFO:teuthology.orchestra.run.smithi110.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-11T07:03:11.601 INFO:teuthology.orchestra.run.smithi110.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-11T07:03:11.949 INFO:teuthology.orchestra.run.smithi110.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-11T07:03:12.257 INFO:teuthology.orchestra.run.smithi079.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-298-gb53b6d3e-1jammy [130 kB] 2024-09-11T07:03:12.260 INFO:teuthology.orchestra.run.smithi079.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-298-gb53b6d3e-1jammy [39.0 kB] 2024-09-11T07:03:12.261 INFO:teuthology.orchestra.run.smithi079.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-298-gb53b6d3e-1jammy [13.6 MB] 2024-09-11T07:03:12.451 INFO:teuthology.orchestra.run.smithi079.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-298-gb53b6d3e-1jammy [91.5 kB] 2024-09-11T07:03:12.520 INFO:teuthology.orchestra.run.smithi110.stdout:Fetched 181 MB in 5s (34.8 MB/s) 2024-09-11T07:03:12.739 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-11T07:03:12.841 INFO:teuthology.orchestra.run.smithi110.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-11T07:03:12.846 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-11T07:03:12.938 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T07:03:13.014 INFO:teuthology.orchestra.run.smithi079.stdout:Fetched 181 MB in 6s (31.7 MB/s) 2024-09-11T07:03:13.156 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-11T07:03:13.249 INFO:teuthology.orchestra.run.smithi079.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-11T07:03:13.255 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-11T07:03:13.292 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-11T07:03:13.317 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-11T07:03:13.338 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T07:03:13.358 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T07:03:13.675 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-11T07:03:13.701 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-11T07:03:13.702 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-11T07:03:13.729 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-11T07:03:13.741 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T07:03:13.769 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T07:03:14.111 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-11T07:03:14.137 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-11T07:03:14.147 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-11T07:03:14.174 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T07:03:14.177 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T07:03:14.222 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:03:14.606 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-11T07:03:14.626 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-11T07:03:14.632 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T07:03:14.652 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T07:03:14.681 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:03:14.692 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:03:15.034 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-11T07:03:15.037 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-11T07:03:15.060 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T07:03:15.063 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T07:03:15.101 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:03:15.104 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:03:15.432 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-11T07:03:15.445 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-11T07:03:15.458 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-11T07:03:15.472 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-11T07:03:15.498 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T07:03:15.512 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:03:15.827 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librados2. 2024-09-11T07:03:15.853 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../007-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:15.865 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-11T07:03:15.891 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-11T07:03:15.893 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:15.932 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T07:03:16.226 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librados2. 2024-09-11T07:03:16.241 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../007-librados2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:16.285 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:16.346 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librbd1. 2024-09-11T07:03:16.373 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../008-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:16.412 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:16.754 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librbd1. 2024-09-11T07:03:16.780 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../008-librbd1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:16.820 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:16.857 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs2. 2024-09-11T07:03:16.884 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:16.915 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:17.193 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rados. 2024-09-11T07:03:17.208 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../010-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:17.251 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:17.257 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs2. 2024-09-11T07:03:17.283 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../009-libcephfs2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:17.323 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:17.579 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-11T07:03:17.606 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:17.617 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rados. 2024-09-11T07:03:17.632 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../010-python3-rados_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:17.645 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:17.667 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:17.898 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cephfs. 2024-09-11T07:03:17.914 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:17.956 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:17.962 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-11T07:03:17.988 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:18.029 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:18.243 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-11T07:03:18.269 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:18.281 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cephfs. 2024-09-11T07:03:18.296 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../012-python3-cephfs_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:18.301 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:18.339 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:18.604 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-11T07:03:18.630 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-11T07:03:18.650 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-11T07:03:18.662 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T07:03:18.676 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../013-python3-ceph-common_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:18.717 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:18.965 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-prettytable. 2024-09-11T07:03:18.991 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-11T07:03:19.020 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-11T07:03:19.031 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-11T07:03:19.046 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-11T07:03:19.086 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T07:03:19.293 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rbd. 2024-09-11T07:03:19.308 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:19.351 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:19.406 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-prettytable. 2024-09-11T07:03:19.432 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-11T07:03:19.472 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-11T07:03:19.696 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-11T07:03:19.722 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-11T07:03:19.750 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rbd. 2024-09-11T07:03:19.762 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T07:03:19.765 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../016-python3-rbd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:19.800 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:20.023 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-11T07:03:20.038 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-11T07:03:20.073 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T07:03:20.103 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-11T07:03:20.129 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-11T07:03:20.170 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T07:03:20.368 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-11T07:03:20.384 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-11T07:03:20.418 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T07:03:20.430 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-11T07:03:20.446 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-11T07:03:20.489 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T07:03:20.780 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua5.1. 2024-09-11T07:03:20.783 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-11T07:03:20.798 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-11T07:03:20.806 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-11T07:03:20.841 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T07:03:20.846 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-11T07:03:21.128 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua5.1. 2024-09-11T07:03:21.143 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-11T07:03:21.178 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-11T07:03:21.191 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-any. 2024-09-11T07:03:21.217 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-11T07:03:21.257 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-11T07:03:21.473 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-any. 2024-09-11T07:03:21.478 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package zip. 2024-09-11T07:03:21.494 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-11T07:03:21.499 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-11T07:03:21.537 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking zip (3.0-12build2) ... 2024-09-11T07:03:21.539 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-11T07:03:21.783 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package zip. 2024-09-11T07:03:21.798 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-11T07:03:21.865 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package unzip. 2024-09-11T07:03:21.891 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-11T07:03:21.931 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-11T07:03:21.970 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking zip (3.0-12build2) ... 2024-09-11T07:03:22.327 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package luarocks. 2024-09-11T07:03:22.353 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-11T07:03:22.402 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-11T07:03:22.445 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package unzip. 2024-09-11T07:03:22.471 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-11T07:03:22.512 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-11T07:03:22.735 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package librgw2. 2024-09-11T07:03:22.762 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../025-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:22.801 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:22.857 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package luarocks. 2024-09-11T07:03:22.883 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-11T07:03:22.915 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-11T07:03:23.273 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package librgw2. 2024-09-11T07:03:23.300 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../025-librgw2_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:23.340 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:23.596 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rgw. 2024-09-11T07:03:23.623 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:23.662 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:23.884 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rgw. 2024-09-11T07:03:23.910 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../026-python3-rgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:23.950 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:24.007 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-11T07:03:24.033 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-11T07:03:24.074 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T07:03:24.303 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-11T07:03:24.330 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-11T07:03:24.351 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libradosstriper1. 2024-09-11T07:03:24.367 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:24.371 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T07:03:24.401 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:24.640 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libradosstriper1. 2024-09-11T07:03:24.666 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../028-libradosstriper1_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:24.698 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:24.830 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-common. 2024-09-11T07:03:24.857 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../029-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:24.896 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:25.134 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-common. 2024-09-11T07:03:25.161 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../029-ceph-common_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:25.201 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:26.302 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-base. 2024-09-11T07:03:26.328 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../030-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:26.378 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:26.631 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-base. 2024-09-11T07:03:26.658 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../030-ceph-base_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:26.707 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:26.998 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-11T07:03:27.024 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-11T07:03:27.064 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-11T07:03:27.302 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-11T07:03:27.328 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-11T07:03:27.367 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cheroot. 2024-09-11T07:03:27.369 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-11T07:03:27.393 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-11T07:03:27.434 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T07:03:27.638 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cheroot. 2024-09-11T07:03:27.664 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-11T07:03:27.705 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T07:03:27.762 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-11T07:03:27.788 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-11T07:03:27.829 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-11T07:03:28.041 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-11T07:03:28.068 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-11T07:03:28.090 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-11T07:03:28.107 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-11T07:03:28.116 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-11T07:03:28.148 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-11T07:03:28.411 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-11T07:03:28.437 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-11T07:03:28.453 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-11T07:03:28.477 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-11T07:03:28.478 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-11T07:03:28.517 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-11T07:03:28.763 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-11T07:03:28.790 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-11T07:03:28.830 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-11T07:03:29.046 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempora. 2024-09-11T07:03:29.072 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-11T07:03:29.121 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-11T07:03:29.132 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempora. 2024-09-11T07:03:29.159 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-11T07:03:29.199 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-11T07:03:29.398 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-portend. 2024-09-11T07:03:29.425 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-11T07:03:29.465 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-11T07:03:29.504 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-portend. 2024-09-11T07:03:29.531 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-11T07:03:29.571 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-11T07:03:29.734 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-11T07:03:29.761 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-11T07:03:29.801 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-11T07:03:29.857 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-11T07:03:29.884 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-11T07:03:29.924 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-11T07:03:30.113 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-11T07:03:30.139 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-11T07:03:30.179 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-11T07:03:30.227 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-11T07:03:30.253 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-11T07:03:30.293 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-11T07:03:30.474 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-natsort. 2024-09-11T07:03:30.490 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-11T07:03:30.524 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-11T07:03:30.639 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-natsort. 2024-09-11T07:03:30.666 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-11T07:03:30.706 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-11T07:03:30.827 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-logutils. 2024-09-11T07:03:30.854 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-11T07:03:30.894 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-11T07:03:31.042 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-logutils. 2024-09-11T07:03:31.069 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-11T07:03:31.109 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-11T07:03:31.197 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-11T07:03:31.223 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-11T07:03:31.263 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-11T07:03:31.379 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-11T07:03:31.406 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-11T07:03:31.445 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-11T07:03:31.541 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-mako. 2024-09-11T07:03:31.568 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-11T07:03:31.607 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T07:03:31.748 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-mako. 2024-09-11T07:03:31.775 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-11T07:03:31.815 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T07:03:31.886 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-11T07:03:31.912 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-11T07:03:31.944 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-11T07:03:32.144 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-11T07:03:32.170 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-11T07:03:32.210 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-11T07:03:32.247 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-11T07:03:32.274 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-11T07:03:32.313 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-11T07:03:32.600 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webob. 2024-09-11T07:03:32.626 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-11T07:03:32.666 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T07:03:32.671 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-11T07:03:32.698 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-11T07:03:32.732 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-11T07:03:32.991 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webob. 2024-09-11T07:03:33.006 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-11T07:03:33.019 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-waitress. 2024-09-11T07:03:33.046 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-11T07:03:33.049 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T07:03:33.089 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T07:03:33.394 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-waitress. 2024-09-11T07:03:33.414 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-tempita. 2024-09-11T07:03:33.421 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-11T07:03:33.441 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-11T07:03:33.464 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T07:03:33.480 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T07:03:33.733 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-paste. 2024-09-11T07:03:33.760 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-11T07:03:33.797 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-tempita. 2024-09-11T07:03:33.800 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T07:03:33.825 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-11T07:03:33.864 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T07:03:34.120 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-11T07:03:34.135 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-11T07:03:34.170 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T07:03:34.184 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-paste. 2024-09-11T07:03:34.211 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-11T07:03:34.250 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T07:03:34.423 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-11T07:03:34.449 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-11T07:03:34.489 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-11T07:03:34.573 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-11T07:03:34.586 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-11T07:03:34.629 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T07:03:34.792 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-webtest. 2024-09-11T07:03:34.819 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-11T07:03:34.859 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-11T07:03:34.907 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-11T07:03:34.934 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-11T07:03:34.973 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-11T07:03:35.179 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pecan. 2024-09-11T07:03:35.205 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-11T07:03:35.235 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-webtest. 2024-09-11T07:03:35.245 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T07:03:35.251 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-11T07:03:35.293 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-11T07:03:35.614 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pecan. 2024-09-11T07:03:35.617 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-certifi. 2024-09-11T07:03:35.641 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-11T07:03:35.643 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-11T07:03:35.680 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T07:03:35.683 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-11T07:03:35.978 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-idna. 2024-09-11T07:03:36.004 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-11T07:03:36.035 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-certifi. 2024-09-11T07:03:36.036 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T07:03:36.062 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-11T07:03:36.102 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-11T07:03:36.339 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-urllib3. 2024-09-11T07:03:36.366 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-11T07:03:36.405 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T07:03:36.480 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-idna. 2024-09-11T07:03:36.507 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-11T07:03:36.547 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T07:03:36.717 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests. 2024-09-11T07:03:36.744 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-11T07:03:36.783 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T07:03:36.825 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-urllib3. 2024-09-11T07:03:36.852 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-11T07:03:36.883 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T07:03:37.120 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-11T07:03:37.147 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-11T07:03:37.170 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests. 2024-09-11T07:03:37.186 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T07:03:37.197 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-11T07:03:37.228 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T07:03:37.498 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-11T07:03:37.514 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:37.515 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-11T07:03:37.542 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-11T07:03:37.556 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:37.581 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T07:03:37.868 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-11T07:03:37.884 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:37.918 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:37.952 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-11T07:03:37.979 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:38.019 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:38.347 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-11T07:03:38.371 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-11T07:03:38.414 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-11T07:03:38.675 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-openssl. 2024-09-11T07:03:38.691 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-11T07:03:38.724 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-11T07:03:39.053 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr. 2024-09-11T07:03:39.080 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:39.099 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-11T07:03:39.119 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:39.126 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:39.165 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:39.518 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-11T07:03:39.523 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mon. 2024-09-11T07:03:39.545 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-11T07:03:39.549 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:39.584 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-11T07:03:39.589 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:39.846 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-openssl. 2024-09-11T07:03:39.861 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-11T07:03:39.896 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-11T07:03:40.241 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr. 2024-09-11T07:03:40.267 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../063-ceph-mgr_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:40.307 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:40.711 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mon. 2024-09-11T07:03:40.738 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../064-ceph-mon_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:40.777 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:41.060 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-osd. 2024-09-11T07:03:41.086 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:41.120 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:41.315 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-osd. 2024-09-11T07:03:41.341 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../065-ceph-osd_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:41.373 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:42.197 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph. 2024-09-11T07:03:42.223 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../066-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:42.263 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:42.410 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph. 2024-09-11T07:03:42.436 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../066-ceph_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:42.476 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:42.582 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-fuse. 2024-09-11T07:03:42.609 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:42.649 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:42.796 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-fuse. 2024-09-11T07:03:42.823 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../067-ceph-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:42.977 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mds. 2024-09-11T07:03:43.004 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:43.029 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:43.035 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:43.383 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mds. 2024-09-11T07:03:43.409 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../068-ceph-mds_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:43.430 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package cephadm. 2024-09-11T07:03:43.441 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:43.457 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../069-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:43.496 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:43.783 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-11T07:03:43.809 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-11T07:03:43.810 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package cephadm. 2024-09-11T07:03:43.837 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../069-cephadm_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:43.840 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-11T07:03:43.886 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:44.214 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-11T07:03:44.240 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-11T07:03:44.280 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-11T07:03:44.281 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-11T07:03:44.308 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T07:03:44.410 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T07:03:44.600 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-11T07:03:44.615 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T07:03:44.658 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T07:03:45.482 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-babel. 2024-09-11T07:03:45.509 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T07:03:45.548 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T07:03:45.681 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-babel. 2024-09-11T07:03:45.708 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-11T07:03:45.747 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T07:03:45.851 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-jinja2. 2024-09-11T07:03:45.878 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-11T07:03:45.918 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T07:03:46.067 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-jinja2. 2024-09-11T07:03:46.094 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-11T07:03:46.133 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T07:03:46.279 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-11T07:03:46.306 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:46.337 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:46.487 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-11T07:03:46.514 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:46.553 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:46.674 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-11T07:03:46.701 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-11T07:03:46.741 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-11T07:03:46.899 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-11T07:03:46.925 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-11T07:03:46.965 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-11T07:03:46.993 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-routes. 2024-09-11T07:03:47.020 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-11T07:03:47.051 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T07:03:47.243 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-routes. 2024-09-11T07:03:47.261 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-11T07:03:47.293 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T07:03:47.355 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-11T07:03:47.382 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:47.413 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:47.639 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-11T07:03:47.665 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:47.730 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:48.751 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-11T07:03:48.767 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-11T07:03:48.809 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T07:03:49.011 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-11T07:03:49.037 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-11T07:03:49.077 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T07:03:49.271 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-joblib. 2024-09-11T07:03:49.287 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-11T07:03:49.322 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T07:03:49.573 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-joblib. 2024-09-11T07:03:49.600 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-11T07:03:49.639 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T07:03:49.733 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-11T07:03:49.754 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-11T07:03:49.792 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-11T07:03:50.001 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-11T07:03:50.028 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-11T07:03:50.068 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-11T07:03:50.094 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-sklearn. 2024-09-11T07:03:50.122 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-11T07:03:50.161 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T07:03:50.346 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-sklearn. 2024-09-11T07:03:50.373 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-11T07:03:50.412 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T07:03:50.986 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-11T07:03:51.014 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:51.105 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-11T07:03:51.133 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:51.139 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:51.265 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:52.109 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-cachetools. 2024-09-11T07:03:52.137 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-11T07:03:52.175 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-11T07:03:52.194 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-cachetools. 2024-09-11T07:03:52.221 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-11T07:03:52.261 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-11T07:03:52.478 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-11T07:03:52.506 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-11T07:03:52.539 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-11T07:03:52.544 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-11T07:03:52.566 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-11T07:03:52.606 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-11T07:03:52.890 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-11T07:03:52.918 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-11T07:03:52.951 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-11T07:03:52.956 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T07:03:52.978 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-11T07:03:53.017 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T07:03:53.251 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-rsa. 2024-09-11T07:03:53.279 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-11T07:03:53.317 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-11T07:03:53.363 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-rsa. 2024-09-11T07:03:53.390 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-11T07:03:53.429 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-11T07:03:53.588 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-google-auth. 2024-09-11T07:03:53.604 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-11T07:03:53.671 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-11T07:03:53.741 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-google-auth. 2024-09-11T07:03:53.768 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-11T07:03:53.808 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-11T07:03:53.991 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-11T07:03:54.018 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-11T07:03:54.057 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T07:03:54.086 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-11T07:03:54.102 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-11T07:03:54.136 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T07:03:54.360 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-websocket. 2024-09-11T07:03:54.376 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-11T07:03:54.410 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-11T07:03:54.423 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-websocket. 2024-09-11T07:03:54.450 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-11T07:03:54.490 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-11T07:03:54.689 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-11T07:03:54.717 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-11T07:03:54.747 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T07:03:54.818 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-11T07:03:54.845 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-11T07:03:54.884 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T07:03:55.419 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-11T07:03:55.448 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:55.486 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:55.533 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-11T07:03:55.561 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:03:55.599 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:55.822 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-11T07:03:55.850 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-11T07:03:55.889 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T07:03:55.919 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-11T07:03:55.946 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-11T07:03:55.985 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T07:03:56.200 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-11T07:03:56.216 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T07:03:56.250 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T07:03:56.347 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-11T07:03:56.375 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T07:03:56.414 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T07:03:56.486 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package jq. 2024-09-11T07:03:56.513 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T07:03:56.552 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-11T07:03:56.650 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package jq. 2024-09-11T07:03:56.668 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-11T07:03:56.708 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-11T07:03:56.788 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package socat. 2024-09-11T07:03:56.804 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-11T07:03:56.847 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-11T07:03:56.961 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package socat. 2024-09-11T07:03:56.988 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-11T07:03:57.028 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-11T07:03:57.158 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package xmlstarlet. 2024-09-11T07:03:57.175 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-11T07:03:57.217 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-11T07:03:57.348 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package xmlstarlet. 2024-09-11T07:03:57.364 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-11T07:03:57.406 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-11T07:03:57.587 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-test. 2024-09-11T07:03:57.603 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../097-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:57.645 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:03:57.761 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-test. 2024-09-11T07:03:57.777 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../097-ceph-test_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:03:57.819 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:00.249 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package ceph-volume. 2024-09-11T07:04:00.276 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:04:00.292 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package ceph-volume. 2024-09-11T07:04:00.315 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:00.320 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../098-ceph-volume_19.1.1-298-gb53b6d3e-1jammy_all.deb ... 2024-09-11T07:04:00.358 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:00.578 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-11T07:04:00.594 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:04:00.636 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:00.646 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-11T07:04:00.662 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../099-libcephfs-dev_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:04:00.695 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:00.965 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-11T07:04:00.992 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-11T07:04:00.999 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-11T07:04:01.026 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-11T07:04:01.031 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T07:04:01.065 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T07:04:01.386 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-11T07:04:01.386 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-11T07:04:01.413 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-11T07:04:01.414 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-11T07:04:01.452 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-11T07:04:01.453 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-11T07:04:01.742 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package nvme-cli. 2024-09-11T07:04:01.770 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-11T07:04:01.809 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T07:04:01.849 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package nvme-cli. 2024-09-11T07:04:01.876 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-11T07:04:01.915 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T07:04:02.239 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package pkg-config. 2024-09-11T07:04:02.266 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-11T07:04:02.305 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T07:04:02.338 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package pkg-config. 2024-09-11T07:04:02.365 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-11T07:04:02.404 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T07:04:02.566 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-11T07:04:02.594 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-11T07:04:02.615 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-11T07:04:02.631 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-11T07:04:02.633 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-11T07:04:02.665 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-11T07:04:03.052 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-11T07:04:03.061 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-11T07:04:03.079 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-11T07:04:03.088 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-11T07:04:03.110 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-11T07:04:03.127 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-11T07:04:03.397 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pastescript. 2024-09-11T07:04:03.413 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pastescript. 2024-09-11T07:04:03.424 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-11T07:04:03.441 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-11T07:04:03.463 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-11T07:04:03.471 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-11T07:04:03.758 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pluggy. 2024-09-11T07:04:03.784 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pluggy. 2024-09-11T07:04:03.785 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-11T07:04:03.811 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-11T07:04:03.824 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-11T07:04:03.850 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-11T07:04:04.136 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-psutil. 2024-09-11T07:04:04.162 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-psutil. 2024-09-11T07:04:04.163 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-11T07:04:04.189 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-11T07:04:04.219 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-11T07:04:04.228 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-11T07:04:04.580 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-py. 2024-09-11T07:04:04.607 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-py. 2024-09-11T07:04:04.607 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-11T07:04:04.634 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-11T07:04:04.655 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-11T07:04:04.673 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-11T07:04:04.975 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pygments. 2024-09-11T07:04:04.985 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pygments. 2024-09-11T07:04:05.002 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-11T07:04:05.013 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-11T07:04:05.041 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T07:04:05.043 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T07:04:05.473 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-11T07:04:05.501 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-11T07:04:05.529 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-11T07:04:05.531 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-11T07:04:05.556 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-11T07:04:05.595 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-11T07:04:05.834 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-toml. 2024-09-11T07:04:05.856 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-toml. 2024-09-11T07:04:05.862 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-11T07:04:05.883 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-11T07:04:05.901 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-11T07:04:05.914 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-11T07:04:06.204 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-pytest. 2024-09-11T07:04:06.231 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-11T07:04:06.251 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-pytest. 2024-09-11T07:04:06.278 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-11T07:04:06.278 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T07:04:06.317 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T07:04:06.629 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package python3-simplejson. 2024-09-11T07:04:06.633 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package python3-simplejson. 2024-09-11T07:04:06.656 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-11T07:04:06.660 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-11T07:04:06.687 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-11T07:04:06.699 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-11T07:04:06.922 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-11T07:04:06.936 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-11T07:04:06.952 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-11T07:04:06.964 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-11T07:04:06.979 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-11T07:04:07.018 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-11T07:04:07.702 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package radosgw. 2024-09-11T07:04:07.729 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../116-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:04:07.765 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package radosgw. 2024-09-11T07:04:07.768 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:07.793 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../116-radosgw_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:04:07.831 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:08.596 INFO:teuthology.orchestra.run.smithi110.stdout:Selecting previously unselected package rbd-fuse. 2024-09-11T07:04:08.623 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:04:08.634 INFO:teuthology.orchestra.run.smithi079.stdout:Selecting previously unselected package rbd-fuse. 2024-09-11T07:04:08.650 INFO:teuthology.orchestra.run.smithi079.stdout:Preparing to unpack .../117-rbd-fuse_19.1.1-298-gb53b6d3e-1jammy_amd64.deb ... 2024-09-11T07:04:08.662 INFO:teuthology.orchestra.run.smithi110.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:Unpacking rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:08.976 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-11T07:04:08.998 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-11T07:04:09.242 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T07:04:09.258 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-11T07:04:09.351 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T07:04:09.384 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-11T07:04:09.591 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-11T07:04:09.643 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-11T07:04:09.910 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-11T07:04:09.955 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-11T07:04:10.319 INFO:teuthology.orchestra.run.smithi110.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-11T07:04:10.375 INFO:teuthology.orchestra.run.smithi079.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-11T07:04:10.461 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:10.646 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:11.029 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user cephadm....done 2024-09-11T07:04:11.137 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user cephadm....done 2024-09-11T07:04:11.253 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T07:04:11.268 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-11T07:04:11.561 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-11T07:04:11.821 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-11T07:04:11.828 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-11T07:04:11.930 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-11T07:04:12.081 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-11T07:04:12.164 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-11T07:04:12.208 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-11T07:04:12.424 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T07:04:12.467 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-11T07:04:12.550 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-11T07:04:12.727 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-11T07:04:12.836 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-11T07:04:12.860 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T07:04:13.130 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-11T07:04:13.262 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-11T07:04:13.474 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-11T07:04:13.513 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-11T07:04:13.733 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-11T07:04:13.780 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-11T07:04:14.001 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-11T07:04:14.040 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-11T07:04:14.350 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-11T07:04:14.528 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-11T07:04:14.666 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-11T07:04:14.762 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-11T07:04:15.052 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:15.156 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-11T07:04:15.311 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T07:04:15.407 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-argparse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:15.674 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-11T07:04:15.700 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T07:04:15.801 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-11T07:04:15.922 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T07:04:15.952 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-11T07:04:16.073 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-11T07:04:16.077 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-11T07:04:16.329 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-11T07:04:16.341 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-11T07:04:16.702 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-11T07:04:16.709 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-11T07:04:16.735 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-11T07:04:16.738 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-11T07:04:16.799 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T07:04:16.802 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-11T07:04:16.920 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-11T07:04:16.925 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-11T07:04:17.271 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T07:04:17.285 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-11T07:04:17.397 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-11T07:04:17.411 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-11T07:04:17.665 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T07:04:17.679 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-11T07:04:17.932 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-11T07:04:17.938 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-11T07:04:18.240 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up zip (3.0-12build2) ... 2024-09-11T07:04:18.267 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up zip (3.0-12build2) ... 2024-09-11T07:04:18.357 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T07:04:18.393 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-11T07:04:19.028 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T07:04:19.045 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-11T07:04:19.261 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T07:04:19.296 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-11T07:04:19.362 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-11T07:04:19.397 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-11T07:04:19.513 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T07:04:19.514 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-11T07:04:19.815 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-11T07:04:19.815 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-11T07:04:20.191 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-11T07:04:20.217 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-11T07:04:20.442 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T07:04:20.476 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-11T07:04:20.819 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T07:04:20.861 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-11T07:04:21.145 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T07:04:21.154 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-11T07:04:21.489 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-11T07:04:21.522 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-11T07:04:21.740 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-11T07:04:21.781 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-11T07:04:21.891 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:21.907 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:22.201 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T07:04:22.201 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-11T07:04:22.518 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T07:04:22.527 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-11T07:04:23.642 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T07:04:23.707 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-11T07:04:23.893 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:04:23.975 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:04:24.028 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-11T07:04:24.135 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-11T07:04:24.312 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T07:04:24.419 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-11T07:04:24.446 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-11T07:04:24.545 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-11T07:04:24.573 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T07:04:24.671 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-11T07:04:24.866 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-11T07:04:24.964 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-11T07:04:25.125 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-11T07:04:25.223 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-11T07:04:25.368 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:04:25.494 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-11T07:04:25.500 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:04:25.626 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-11T07:04:25.804 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-11T07:04:25.935 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-11T07:04:26.056 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-11T07:04:26.203 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-11T07:04:26.307 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-11T07:04:26.463 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-11T07:04:26.566 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-11T07:04:26.730 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-11T07:04:26.826 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-11T07:04:26.981 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-11T07:04:27.085 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T07:04:27.211 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-11T07:04:27.266 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-11T07:04:27.425 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-11T07:04:27.488 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T07:04:27.614 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T07:04:27.734 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-11T07:04:27.886 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-11T07:04:27.899 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T07:04:28.178 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-11T07:04:28.200 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-11T07:04:28.459 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T07:04:28.463 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-11T07:04:28.569 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-11T07:04:28.670 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T07:04:28.722 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-11T07:04:28.758 INFO:teuthology.orchestra.run.smithi079.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-11T07:04:28.848 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-11T07:04:28.982 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-11T07:04:28.997 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T07:04:29.073 INFO:teuthology.orchestra.run.smithi110.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-11T07:04:29.123 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T07:04:29.318 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-11T07:04:29.469 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-11T07:04:29.516 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-11T07:04:29.775 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-11T07:04:29.862 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-11T07:04:29.893 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-11T07:04:30.104 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-11T07:04:30.153 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:04:30.205 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-11T07:04:30.271 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T07:04:30.456 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-11T07:04:30.605 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T07:04:30.615 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-11T07:04:30.909 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T07:04:30.950 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-11T07:04:31.174 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-11T07:04:31.300 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-11T07:04:31.519 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-11T07:04:31.577 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-11T07:04:31.794 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-11T07:04:31.853 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T07:04:31.920 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-11T07:04:32.188 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-11T07:04:32.190 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-11T07:04:32.447 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-11T07:04:32.575 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-11T07:04:32.792 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-11T07:04:32.851 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T07:04:33.169 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-11T07:04:33.180 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T07:04:33.306 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:33.432 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:33.453 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-11T07:04:33.558 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-11T07:04:33.773 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-11T07:04:33.895 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:33.898 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librados2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:34.004 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:34.025 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libsqlite3-mod-ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:34.114 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-11T07:04:34.151 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-11T07:04:34.392 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:34.487 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:34.517 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:34.617 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libradosstriper1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:34.626 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:34.722 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-11T07:04:34.824 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T07:04:34.824 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T07:04:35.007 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librbd1 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:35.158 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-modules-core (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:35.309 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:35.344 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:35.453 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:35.539 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T07:04:35.539 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-11T07:04:35.588 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:35.706 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T07:04:36.036 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up libcephfs-dev (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:36.162 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rados (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:36.287 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up librgw2 (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:36.413 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-11T07:04:36.860 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:36.969 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:37.095 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:37.221 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:37.348 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:37.642 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rbd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:37.793 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up rbd-fuse (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:37.891 INFO:teuthology.orchestra.run.smithi079.stdout:Adding group ceph....done 2024-09-11T07:04:37.936 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-rgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:38.062 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up python3-cephfs (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:38.188 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-common (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:38.201 INFO:teuthology.orchestra.run.smithi079.stdout:Adding system user ceph....done 2024-09-11T07:04:38.354 INFO:teuthology.orchestra.run.smithi079.stdout:Setting system user ceph properties....done 2024-09-11T07:04:38.388 INFO:teuthology.orchestra.run.smithi079.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-11T07:04:38.523 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-11T07:04:38.765 INFO:teuthology.orchestra.run.smithi110.stdout:Adding group ceph....done 2024-09-11T07:04:38.821 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-11T07:04:39.141 INFO:teuthology.orchestra.run.smithi110.stdout:Adding system user ceph....done 2024-09-11T07:04:39.267 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:39.300 INFO:teuthology.orchestra.run.smithi110.stdout:Setting system user ceph properties....done 2024-09-11T07:04:39.315 INFO:teuthology.orchestra.run.smithi110.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-11T07:04:39.368 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:39.454 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-11T07:04:39.767 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-11T07:04:39.789 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T07:04:39.789 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T07:04:40.230 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-test (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:40.237 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:40.357 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up radosgw (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:40.571 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-11T07:04:40.852 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T07:04:40.852 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-11T07:04:41.066 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:41.309 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-base (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:41.406 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T07:04:41.406 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T07:04:41.664 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-11T07:04:41.893 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:42.093 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T07:04:42.094 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T07:04:42.140 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mds (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T07:04:42.381 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-11T07:04:42.553 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:42.833 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T07:04:42.833 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T07:04:42.841 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:43.055 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T07:04:43.055 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-11T07:04:43.322 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:43.473 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:43.501 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-osd (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:43.624 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:43.778 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T07:04:43.779 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-11T07:04:43.834 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T07:04:43.834 INFO:teuthology.orchestra.run.smithi079.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T07:04:44.236 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-k8sevents (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:44.292 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:44.362 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:44.443 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:44.513 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mon (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:44.569 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:44.723 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T07:04:44.723 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-11T07:04:44.729 INFO:teuthology.orchestra.run.smithi079.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:45.181 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-cephadm (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:45.191 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-11T07:04:45.309 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-11T07:04:45.323 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:45.453 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-11T07:04:45.458 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-mgr-dashboard (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:45.634 INFO:teuthology.orchestra.run.smithi110.stdout:Setting up ceph-volume (19.1.1-298-gb53b6d3e-1jammy) ... 2024-09-11T07:04:46.045 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-11T07:04:46.213 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-11T07:04:46.256 INFO:teuthology.orchestra.run.smithi079.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-11T07:04:46.431 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-11T07:04:46.906 INFO:teuthology.orchestra.run.smithi079.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-11T07:04:46.912 DEBUG:teuthology.parallel:result is None 2024-09-11T07:04:47.582 INFO:teuthology.orchestra.run.smithi110.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-11T07:04:48.243 INFO:teuthology.orchestra.run.smithi110.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-11T07:04:48.247 DEBUG:teuthology.parallel:result is None 2024-09-11T07:04:48.248 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T07:04:48.400 DEBUG:teuthology.orchestra.run.smithi079:> dpkg-query -W -f '${Version}' ceph 2024-09-11T07:04:48.419 INFO:teuthology.orchestra.run.smithi079.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-11T07:04:48.420 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T07:04:48.420 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-11T07:04:48.422 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc 2024-09-11T07:04:48.580 DEBUG:teuthology.orchestra.run.smithi110:> dpkg-query -W -f '${Version}' ceph 2024-09-11T07:04:48.599 INFO:teuthology.orchestra.run.smithi110.stdout:19.1.1-298-gb53b6d3e-1jammy 2024-09-11T07:04:48.599 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-298-gb53b6d3e-1jammy 2024-09-11T07:04:48.599 INFO:teuthology.task.install:The correct ceph version 19.1.1-298-gb53b6d3e-1jammy is installed. 2024-09-11T07:04:48.601 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-11T07:04:48.601 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:04:48.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T07:04:48.615 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:04:48.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-11T07:04:48.652 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-11T07:04:48.653 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:04:48.653 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T07:04:48.672 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T07:04:48.727 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:04:48.727 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-09-11T07:04:48.740 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-11T07:04:48.796 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-11T07:04:48.797 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:04:48.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T07:04:48.810 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T07:04:48.863 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:04:48.863 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-11T07:04:48.877 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-11T07:04:48.932 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-11T07:04:48.932 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:04:48.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T07:04:48.946 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T07:04:48.999 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:04:48.999 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-09-11T07:04:49.013 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-11T07:04:49.068 INFO:teuthology.run_tasks:Running task ceph... 2024-09-11T07:04:49.172 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-11T07:04:49.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2024-09-11T07:04:49.175 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-09-11T07:04:49.187 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-11T07:04:49.188 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T07:04:49.229 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-11T07:04:49.243 INFO:tasks.ceph:Creating extra log directories... 2024-09-11T07:04:49.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T07:04:49.286 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-11T07:04:49.307 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-11T07:04:49.308 INFO:tasks.ceph:config {'conf': {'client': {'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-11T07:04:49.308 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648', 'branch': 'squid', 'description': 'rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7900648', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}, {'machine': {'cpus': 1, 'disk': 40, 'ram': 8000}, 'volumes': {'count': 4, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 6175, 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc', 'sleep_before_teardown': 0, 'subset': '88/128', 'suite': 'rbd', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_daaf78de334647fc0c800f4ac495cc9475a26bae/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae', 'targets': {'smithi079.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEOzNa8yislMh8GK75XlZbpr7ekm//zaDGWzEBk4HoXxYKD82GywnySbs8TXKWRLDu+H9/VQUDK/ijQpQq2krqM=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMd3/uQsZomjWb1prQOGqL8fOyvswXpgNQhWhSKN/uPzA/1dWIE2GnoIcOVWnQXFrG7vIOxk9Y2jtQz63jWK6tg='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'thrashosds': {'timeout': 1200}}, {'rbd_fsx': {'clients': ['client.0'], 'ops': 6000}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_21:16:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-11T07:04:49.308 DEBUG:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T07:04:49.341 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-11T07:04:49.347 DEBUG:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T07:04:49.390 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-09-11T07:04:49.402 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:04:49.402 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T07:04:49.449 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T07:04:49.449 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 2024-09-11T07:04:49.496 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T07:04:49.496 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T07:04:49.497 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-09-11T07:04:49.497 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T07:04:49.497 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-11 06:59:24.771990331 +0000 2024-09-11T07:04:49.497 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-11 06:59:24.519992583 +0000 2024-09-11T07:04:49.497 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-11 06:59:24.519992583 +0000 2024-09-11T07:04:49.497 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-11T07:04:49.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T07:04:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-11T07:04:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-11T07:04:49.552 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.00037858 s, 1.4 MB/s 2024-09-11T07:04:49.553 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T07:04:49.602 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 2024-09-11T07:04:49.648 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T07:04:49.648 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T07:04:49.649 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-09-11T07:04:49.649 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T07:04:49.649 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-11 06:59:25.267985901 +0000 2024-09-11T07:04:49.649 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-11 06:59:25.027988045 +0000 2024-09-11T07:04:49.649 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-11 06:59:25.027988045 +0000 2024-09-11T07:04:49.649 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-11T07:04:49.649 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T07:04:49.702 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-11T07:04:49.702 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-11T07:04:49.702 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000392071 s, 1.3 MB/s 2024-09-11T07:04:49.703 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T07:04:49.755 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 2024-09-11T07:04:49.800 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T07:04:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T07:04:49.801 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 916 Links: 1 2024-09-11T07:04:49.801 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T07:04:49.801 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-11 06:59:25.779981328 +0000 2024-09-11T07:04:49.801 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-11 06:59:25.483983972 +0000 2024-09-11T07:04:49.801 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-11 06:59:25.483983972 +0000 2024-09-11T07:04:49.801 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-11T07:04:49.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T07:04:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-11T07:04:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-11T07:04:49.855 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000366085 s, 1.4 MB/s 2024-09-11T07:04:49.856 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T07:04:49.906 DEBUG:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 2024-09-11T07:04:49.952 INFO:teuthology.orchestra.run.smithi079.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T07:04:49.952 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T07:04:49.953 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 935 Links: 1 2024-09-11T07:04:49.953 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T07:04:49.953 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2024-09-11 06:59:26.307976612 +0000 2024-09-11T07:04:49.953 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2024-09-11 06:59:26.043978969 +0000 2024-09-11T07:04:49.953 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2024-09-11 06:59:26.043978969 +0000 2024-09-11T07:04:49.953 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2024-09-11T07:04:49.953 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T07:04:50.006 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2024-09-11T07:04:50.006 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2024-09-11T07:04:50.007 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes copied, 0.000299661 s, 1.7 MB/s 2024-09-11T07:04:50.008 DEBUG:teuthology.orchestra.run.smithi079:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T07:04:50.058 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T07:04:50.058 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:04:50.058 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-09-11T07:04:50.064 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-11T07:04:50.064 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-09-11T07:04:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-11T07:04:50.113 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T07:04:50.113 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 881 Links: 1 2024-09-11T07:04:50.113 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T07:04:50.113 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-11 06:59:24.728447288 +0000 2024-09-11T07:04:50.113 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-11 06:59:24.724447324 +0000 2024-09-11T07:04:50.114 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-11 06:59:24.724447324 +0000 2024-09-11T07:04:50.114 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-11T07:04:50.114 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-11T07:04:50.167 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-11T07:04:50.167 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-11T07:04:50.167 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000304913 s, 1.7 MB/s 2024-09-11T07:04:50.168 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-11T07:04:50.218 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-09-11T07:04:50.264 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-11T07:04:50.265 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T07:04:50.265 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 893 Links: 1 2024-09-11T07:04:50.265 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T07:04:50.265 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-11 06:59:25.252442608 +0000 2024-09-11T07:04:50.265 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-11 06:59:25.248442644 +0000 2024-09-11T07:04:50.265 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-11 06:59:25.248442644 +0000 2024-09-11T07:04:50.265 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-11T07:04:50.265 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-11T07:04:50.319 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-11T07:04:50.319 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-11T07:04:50.319 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000306168 s, 1.7 MB/s 2024-09-11T07:04:50.320 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-11T07:04:50.370 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-09-11T07:04:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-11T07:04:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T07:04:50.417 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-09-11T07:04:50.417 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T07:04:50.417 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-11 06:59:26.012435819 +0000 2024-09-11T07:04:50.417 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-11 06:59:25.756438105 +0000 2024-09-11T07:04:50.417 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-11 06:59:25.756438105 +0000 2024-09-11T07:04:50.417 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-11T07:04:50.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-11T07:04:50.471 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-11T07:04:50.471 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-11T07:04:50.471 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000262652 s, 1.9 MB/s 2024-09-11T07:04:50.472 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-11T07:04:50.522 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-09-11T07:04:50.569 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-11T07:04:50.569 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-11T07:04:50.569 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 925 Links: 1 2024-09-11T07:04:50.570 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-11T07:04:50.570 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-09-11 06:59:26.236433818 +0000 2024-09-11T07:04:50.570 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-09-11 06:59:26.232433854 +0000 2024-09-11T07:04:50.570 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-09-11 06:59:26.232433854 +0000 2024-09-11T07:04:50.570 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: - 2024-09-11T07:04:50.571 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-11T07:04:50.623 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-09-11T07:04:50.623 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-09-11T07:04:50.623 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000241695 s, 2.1 MB/s 2024-09-11T07:04:50.624 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-11T07:04:50.673 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T07:04:50.673 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T07:04:50.674 INFO:tasks.ceph:Generating config... 2024-09-11T07:04:50.675 INFO:tasks.ceph:[client] rbd qos iops burst = 100 2024-09-11T07:04:50.675 INFO:tasks.ceph:[client] rbd qos iops limit = 50 2024-09-11T07:04:50.675 INFO:tasks.ceph:[client] rbd qos schedule tick min = 100 2024-09-11T07:04:50.675 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-11T07:04:50.675 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-09-11T07:04:50.675 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-11T07:04:50.675 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-11T07:04:50.675 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-11T07:04:50.675 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-11T07:04:50.675 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-11T07:04:50.675 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] bluestore compression algorithm = zstd 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-11T07:04:50.676 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-09-11T07:04:50.677 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-11T07:04:50.677 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-09-11T07:04:50.677 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-11T07:04:50.677 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-11T07:04:50.677 INFO:tasks.ceph:Setting up mon.a... 2024-09-11T07:04:50.677 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-11T07:04:50.712 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.keyring 2024-09-11T07:04:50.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-11T07:04:50.803 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T07:04:50.855 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.79'), ('mon.c', '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]'), ('mon.b', '172.21.15.110')] 2024-09-11T07:04:50.855 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790],172.21.15.110', 'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-11T07:04:50.856 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:04:50.856 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T07:04:50.900 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.79 --addv c '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]' --add b 172.21.15.110 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:04:50.986 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:04:50.986 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: generated fsid e1313abd-54a9-4e53-ab67-469f744048b1 2024-09-11T07:04:50.986 INFO:teuthology.orchestra.run.smithi079.stdout:setting min_mon_release = quincy 2024-09-11T07:04:50.986 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 0 2024-09-11T07:04:50.986 INFO:teuthology.orchestra.run.smithi079.stdout:fsid e1313abd-54a9-4e53-ab67-469f744048b1 2024-09-11T07:04:50.986 INFO:teuthology.orchestra.run.smithi079.stdout:last_changed 2024-09-11T07:04:50.987557+0000 2024-09-11T07:04:50.986 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-11T07:04:50.987557+0000 2024-09-11T07:04:50.987 INFO:teuthology.orchestra.run.smithi079.stdout:min_mon_release 17 (quincy) 2024-09-11T07:04:50.987 INFO:teuthology.orchestra.run.smithi079.stdout:election_strategy: 1 2024-09-11T07:04:50.987 INFO:teuthology.orchestra.run.smithi079.stdout:0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2024-09-11T07:04:50.987 INFO:teuthology.orchestra.run.smithi079.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-09-11T07:04:50.987 INFO:teuthology.orchestra.run.smithi079.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2024-09-11T07:04:50.987 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-11T07:04:50.988 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-11T07:04:51.036 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e1313abd-54a9-4e53-ab67-469f744048b1... 2024-09-11T07:04:51.037 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T07:04:51.081 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-11T07:04:51.109 INFO:teuthology.orchestra.run.smithi079.stdout:[global] 2024-09-11T07:04:51.109 INFO:teuthology.orchestra.run.smithi079.stdout: chdir = "" 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: auth supported = cephx 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: filestore xattr use omap = true 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: mon clock drift allowed = 1.000 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: osd crush chooseleaf type = 0 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: auth debug = true 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on old message = true 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: ms die on bug = true 2024-09-11T07:04:51.110 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: mon pg warn max object skew = 0 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default size = 2 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow primary affinity = true 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd allow pg remap = true 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on legacy crush tunables = false 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on crush straw calc version zero = false 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on no sortbitwise = false 2024-09-11T07:04:51.111 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on osd down out interval zero = false 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on too few osds = false 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: mon_allow_pool_size_one = true 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: osd default data pool replay window = 5 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: mon allow pool delete = true 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: mon cluster log file level = debug 2024-09-11T07:04:51.112 INFO:teuthology.orchestra.run.smithi079.stdout: debug asserts on shutdown = true 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: mon health detail to clog = false 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: mon host = "172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790],172.21.15.110" 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: mon client directed command retry = 5 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: mon warn on pool no app = False 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: ms inject socket failures = 5000 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: fsid = e1313abd-54a9-4e53-ab67-469f744048b1 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout:[osd] 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: osd journal size = 100 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub load threshold = 5.0 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: osd scrub max interval = 600 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: osd mclock profile = high_recovery_ops 2024-09-11T07:04:51.113 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd recover clone overlap = true 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd recovery max chunk = 1048576 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug shutdown = true 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug op order = true 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug verify stray on activate = true 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug trim objects = true 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd open classes on start = true 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug pg log writeout = true 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd deep scrub update digest min age = 30 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.114 INFO:teuthology.orchestra.run.smithi079.stdout: osd map max advance = 10 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: journal zero on create = true 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: filestore ondisk finisher threads = 3 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: filestore apply finisher threads = 3 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: bdev debug aio = true 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: osd debug misdirected ops = true 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore block size = 96636764160 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore compression algorithm = zstd 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore compression mode = aggressive 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: bluestore fsck on mount = True 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluefs = 1/20 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: debug bluestore = 1/20 2024-09-11T07:04:51.115 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: debug osd = 20 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: debug rocksdb = 4/10 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd full ratio = 0.9 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd nearfull ratio = 0.8 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd blocked scrub grace period = 3600 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd failsafe full ratio = 0.95 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd max markdown count = 1000 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd objectstore = bluestore 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: osd shutdown pgref assert = True 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr] 2024-09-11T07:04:51.116 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug mgr = 20 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: mgr/telemetry/nag = false 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout:[mon] 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug ms = 1 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug mon = 20 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug paxos = 20 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: debug auth = 20 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: mon data avail warn = 5 2024-09-11T07:04:51.117 INFO:teuthology.orchestra.run.smithi079.stdout: mon mgr mkfs grace = 240 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min pgs per osd = 4 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd reporter subtree level = osd 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: mon osd prime pg temp = true 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: mon reweight min bytes per osd = 10 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: # 1m isn't quite enough 2024-09-11T07:04:51.118 INFO:teuthology.orchestra.run.smithi079.stdout: mon_down_mkfs_grace = 2m 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: mon_warn_on_filestore_osds = false 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout:[client] 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: rgw cache enabled = true 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable ops log = true 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: rgw enable usage log = true 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: rbd qos iops burst = 100 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: rbd qos iops limit = 50 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout: rbd qos schedule tick min = 100 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.a] 2024-09-11T07:04:51.119 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.c] 2024-09-11T07:04:51.120 INFO:teuthology.orchestra.run.smithi079.stdout:[mon.b] 2024-09-11T07:04:51.121 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-09-11T07:04:51.121 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-09-11T07:04:51.121 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-11T07:04:51.121 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-09-11T07:04:51.121 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.121 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-09-11T07:04:51.121 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.121 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.122 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-11T07:04:51.123 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790],172.21.15.110" 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: mon client directed command retry = 5 2024-09-11T07:04:51.124 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on pool no app = False 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: ms inject socket failures = 5000 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = e1313abd-54a9-4e53-ab67-469f744048b1 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.125 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-09-11T07:04:51.126 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore compression algorithm = zstd 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore compression mode = aggressive 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 1/20 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 1/20 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 4/10 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-09-11T07:04:51.127 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: osd blocked scrub grace period = 3600 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: osd max markdown count = 1000 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: osd shutdown pgref assert = True 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-09-11T07:04:51.128 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-09-11T07:04:51.129 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-09-11T07:04:51.130 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-11T07:04:51.131 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-11T07:04:51.131 INFO:teuthology.orchestra.run.smithi110.stdout: rbd qos iops burst = 100 2024-09-11T07:04:51.131 INFO:teuthology.orchestra.run.smithi110.stdout: rbd qos iops limit = 50 2024-09-11T07:04:51.131 INFO:teuthology.orchestra.run.smithi110.stdout: rbd qos schedule tick min = 100 2024-09-11T07:04:51.131 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-09-11T07:04:51.131 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-09-11T07:04:51.131 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-09-11T07:04:51.131 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-11T07:04:51.131 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-11T07:04:51.211 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-11T07:04:51.211 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:04:51.211 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-11T07:04:51.216 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:04:51.216 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-11T07:04:51.264 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T07:04:51.264 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:04:51.264 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T07:04:51.265 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T07:04:51.330 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:04:51.330 DEBUG:teuthology.orchestra.run.smithi079:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:04:51.376 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T07:04:51.377 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:04:51.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-11T07:04:51.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-11T07:04:51.398 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:04:51.398 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:04:51.444 INFO:tasks.ceph:Setting up mon nodes... 2024-09-11T07:04:51.445 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-11T07:04:51.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T07:04:51.487 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-11T07:04:51.490 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T07:04:51.534 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-11T07:04:51.545 INFO:tasks.ceph:Setting up mds nodes... 2024-09-11T07:04:51.546 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-11T07:04:51.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-11T07:04:51.580 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-11T07:04:51.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-11T07:04:51.625 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-11T07:04:51.636 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-11T07:04:51.636 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-11T07:04:51.636 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-11T07:04:51.649 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T07:04:51.649 INFO:tasks.ceph:role: osd.0 2024-09-11T07:04:51.649 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T07:04:51.649 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T07:04:51.712 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T07:04:51.712 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T07:04:51.712 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T07:04:51.712 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T07:04:51.712 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T07:04:51.712 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-11T07:04:51.712 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T07:04:51.712 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T07:04:51.713 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T07:04:51.713 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T07:04:52.169 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-11T07:04:52.171 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-11T07:04:52.171 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-11T07:04:52.270 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-11T07:04:52.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T07:04:52.281 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T07:04:52.281 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-11T07:04:52.333 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T07:04:52.334 INFO:tasks.ceph:role: osd.1 2024-09-11T07:04:52.334 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T07:04:52.334 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T07:04:52.394 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T07:04:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T07:04:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T07:04:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T07:04:52.395 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T07:04:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-11T07:04:52.395 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T07:04:52.395 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T07:04:52.395 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T07:04:52.395 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T07:04:52.866 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-11T07:04:52.868 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-11T07:04:52.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-11T07:04:53.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-11T07:04:53.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T07:04:53.012 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T07:04:53.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-11T07:04:53.067 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T07:04:53.068 INFO:tasks.ceph:role: osd.2 2024-09-11T07:04:53.068 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T07:04:53.068 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T07:04:53.132 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T07:04:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T07:04:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T07:04:53.132 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T07:04:53.132 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T07:04:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-11T07:04:53.133 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T07:04:53.133 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T07:04:53.133 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T07:04:53.133 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T07:04:53.617 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-11T07:04:53.620 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-11T07:04:53.620 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-11T07:04:53.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-11T07:04:53.771 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T07:04:53.771 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T07:04:53.772 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-11T07:04:53.829 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-11T07:04:53.829 INFO:tasks.ceph:role: osd.3 2024-09-11T07:04:53.829 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T07:04:53.829 DEBUG:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T07:04:53.892 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T07:04:53.892 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T07:04:53.892 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T07:04:53.892 INFO:teuthology.orchestra.run.smithi079.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T07:04:53.892 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T07:04:53.892 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2024-09-11T07:04:53.892 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T07:04:53.893 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T07:04:53.893 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T07:04:53.893 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T07:04:54.311 INFO:teuthology.orchestra.run.smithi079.stdout:Discarding blocks...Done. 2024-09-11T07:04:54.313 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2024-09-11T07:04:54.314 DEBUG:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-11T07:04:54.397 DEBUG:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-11T07:04:54.448 INFO:teuthology.orchestra.run.smithi079.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T07:04:54.449 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T07:04:54.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:04:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:04:54.561+0000 7f33343557c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-11T07:04:54.564 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:04:54.565+0000 7f33343557c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-11T07:04:54.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:04:54.565+0000 7f33343557c0 -1 bdev(0x564ea6505800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-11T07:04:54.565 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:04:54.565+0000 7f33343557c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-11T07:04:57.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-11T07:04:57.710 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:04:57.793 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:04:57.793+0000 7f490e2687c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-11T07:04:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:04:57.793+0000 7f490e2687c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-11T07:04:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:04:57.793+0000 7f490e2687c0 -1 bdev(0x5643d6ad9800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-11T07:04:57.794 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:04:57.793+0000 7f490e2687c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-11T07:05:00.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-11T07:05:01.021 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:05:01.101 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:05:01.101+0000 7f9748ff17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-11T07:05:01.102 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:05:01.101+0000 7f9748ff17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-11T07:05:01.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:05:01.101+0000 7f9748ff17c0 -1 bdev(0x56051c3ff800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-11T07:05:01.103 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:05:01.101+0000 7f9748ff17c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-11T07:05:04.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-11T07:05:04.300 DEBUG:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:05:04.383 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:05:04.381+0000 7fa70d8cf7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-11T07:05:04.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:05:04.385+0000 7fa70d8cf7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-11T07:05:04.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:05:04.385+0000 7fa70d8cf7c0 -1 bdev(0x55636b095800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-11T07:05:04.384 INFO:teuthology.orchestra.run.smithi079.stderr:2024-09-11T07:05:04.385+0000 7fa70d8cf7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-11T07:05:07.523 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-11T07:05:07.585 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-11T07:05:07.600 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T07:05:07.600 INFO:tasks.ceph:role: osd.4 2024-09-11T07:05:07.600 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T07:05:07.600 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-11T07:05:07.656 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T07:05:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T07:05:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T07:05:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T07:05:07.657 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T07:05:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-11T07:05:07.657 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T07:05:07.657 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T07:05:07.657 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T07:05:07.657 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T07:05:07.680 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-11T07:05:07.682 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-11T07:05:07.683 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-11T07:05:07.740 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-11T07:05:07.793 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T07:05:07.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T07:05:07.794 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-11T07:05:07.847 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T07:05:07.847 INFO:tasks.ceph:role: osd.5 2024-09-11T07:05:07.847 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T07:05:07.847 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-11T07:05:07.899 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T07:05:07.899 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T07:05:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T07:05:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T07:05:07.900 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T07:05:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-11T07:05:07.900 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T07:05:07.900 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T07:05:07.900 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T07:05:07.900 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T07:05:07.924 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-11T07:05:07.926 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-11T07:05:07.926 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-11T07:05:07.984 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-11T07:05:08.037 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T07:05:08.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T07:05:08.038 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-11T07:05:08.090 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T07:05:08.090 INFO:tasks.ceph:role: osd.6 2024-09-11T07:05:08.090 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T07:05:08.090 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-11T07:05:08.144 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T07:05:08.144 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T07:05:08.144 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T07:05:08.144 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T07:05:08.144 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T07:05:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-11T07:05:08.145 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T07:05:08.145 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T07:05:08.145 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T07:05:08.145 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T07:05:08.168 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-11T07:05:08.169 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-11T07:05:08.170 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-11T07:05:08.227 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-11T07:05:08.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T07:05:08.283 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T07:05:08.284 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-11T07:05:08.340 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-11T07:05:08.340 INFO:tasks.ceph:role: osd.7 2024-09-11T07:05:08.340 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T07:05:08.341 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-11T07:05:08.396 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-11T07:05:08.396 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-11T07:05:08.396 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-11T07:05:08.396 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-11T07:05:08.396 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-11T07:05:08.396 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-09-11T07:05:08.396 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-11T07:05:08.396 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-11T07:05:08.396 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-11T07:05:08.396 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-11T07:05:08.419 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-09-11T07:05:08.421 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-09-11T07:05:08.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-11T07:05:08.480 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-11T07:05:08.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T07:05:08.535 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: /sbin/restorecon: command not found 2024-09-11T07:05:08.535 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:05:08.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:08.647+0000 7fe2738ae7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-11T07:05:08.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:08.647+0000 7fe2738ae7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-11T07:05:08.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:08.647+0000 7fe2738ae7c0 -1 bdev(0x55b69abb7800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-11T07:05:08.649 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:08.647+0000 7fe2738ae7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-11T07:05:11.808 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-11T07:05:11.824 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:05:11.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:11.903+0000 7f49b27d67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-11T07:05:11.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:11.903+0000 7f49b27d67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-11T07:05:11.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:11.903+0000 7f49b27d67c0 -1 bdev(0x5636dfc91800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-11T07:05:11.907 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:11.903+0000 7f49b27d67c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-11T07:05:15.046 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-11T07:05:15.101 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:05:15.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:15.179+0000 7fdf2de547c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-11T07:05:15.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:15.179+0000 7fdf2de547c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-11T07:05:15.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:15.179+0000 7fdf2de547c0 -1 bdev(0x56220ce2b800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-11T07:05:15.184 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:15.179+0000 7fdf2de547c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-11T07:05:18.340 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-11T07:05:18.397 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:05:18.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:18.475+0000 7f79dc8fb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-11T07:05:18.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:18.475+0000 7f79dc8fb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-11T07:05:18.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:18.475+0000 7f79dc8fb7c0 -1 bdev(0x5628503cf800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-11T07:05:18.479 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:18.475+0000 7f79dc8fb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-11T07:05:21.626 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-11T07:05:21.679 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-11T07:05:21.680 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:05:21.680 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-11T07:05:21.694 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:05:21.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-11T07:05:21.750 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:05:21.751 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-11T07:05:21.802 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:05:21.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-11T07:05:21.856 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:05:21.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-11T07:05:21.913 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:05:21.913 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-11T07:05:21.924 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:05:21.925 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-11T07:05:21.980 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:05:21.980 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-11T07:05:22.035 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:05:22.035 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-11T07:05:22.087 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:05:22.087 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-11T07:05:22.139 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:05:22.139 DEBUG:teuthology.orchestra.run.smithi079:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-11T07:05:22.145 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:05:22.145 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-11T07:05:22.186 INFO:tasks.ceph:Adding keys to all mons... 2024-09-11T07:05:22.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T07:05:22.189 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-11T07:05:22.230 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2024-09-11T07:05:22.230 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQATQeFmu3AeHRAA7moMd5nZsX0ZYgh1fTd4Qw== 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAWQeFmB3OqIRAAGNq/7yOlB9/wkZE94gwYHA== 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAZQeFmur1fLxAA3y2slV1SdgMyQMXdfNR9fA== 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAdQeFmFvEgBhAA0Vyz9dL30XO3NDonFT24JQ== 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAgQeFm3fzyFhAAGtO43hOiNCfXfujzrunD/A== 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQATQeFmOmTfHxAA4O1ZFPf03jB32ZnoU8bMwA== 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAkQeFm6xS6JhAAa/q3wm7d0XGfN8HQgSXAww== 2024-09-11T07:05:22.231 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2024-09-11T07:05:22.232 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAnQeFmsg0bNhAAJzVjJkJ20apL4QH4jFGiWQ== 2024-09-11T07:05:22.232 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2024-09-11T07:05:22.232 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQArQeFmcH/8ChAAVbVsO6+k/V4IErEx7TaBTw== 2024-09-11T07:05:22.232 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2024-09-11T07:05:22.232 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQAuQeFmBRiZHBAASRPrc3XSZ6fsEwQi6HZflw== 2024-09-11T07:05:22.232 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2024-09-11T07:05:22.232 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQATQeFmdiuyIhAA53Q2WjX991FCGa2QschFgA== 2024-09-11T07:05:22.232 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2024-09-11T07:05:22.232 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQATQeFmQoNMJRAA2sEOyMdf1Nnpb1CsDRdJWA== 2024-09-11T07:05:22.238 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2024-09-11T07:05:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQATQeFmu3AeHRAA7moMd5nZsX0ZYgh1fTd4Qw== 2024-09-11T07:05:22.238 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-09-11T07:05:22.238 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAWQeFmB3OqIRAAGNq/7yOlB9/wkZE94gwYHA== 2024-09-11T07:05:22.239 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-09-11T07:05:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAZQeFmur1fLxAA3y2slV1SdgMyQMXdfNR9fA== 2024-09-11T07:05:22.239 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-09-11T07:05:22.239 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAdQeFmFvEgBhAA0Vyz9dL30XO3NDonFT24JQ== 2024-09-11T07:05:22.239 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-09-11T07:05:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAgQeFm3fzyFhAAGtO43hOiNCfXfujzrunD/A== 2024-09-11T07:05:22.240 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-09-11T07:05:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQATQeFmOmTfHxAA4O1ZFPf03jB32ZnoU8bMwA== 2024-09-11T07:05:22.240 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2024-09-11T07:05:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAkQeFm6xS6JhAAa/q3wm7d0XGfN8HQgSXAww== 2024-09-11T07:05:22.240 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2024-09-11T07:05:22.240 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAnQeFmsg0bNhAAJzVjJkJ20apL4QH4jFGiWQ== 2024-09-11T07:05:22.240 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2024-09-11T07:05:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQArQeFmcH/8ChAAVbVsO6+k/V4IErEx7TaBTw== 2024-09-11T07:05:22.241 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2024-09-11T07:05:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQAuQeFmBRiZHBAASRPrc3XSZ6fsEwQi6HZflw== 2024-09-11T07:05:22.241 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-09-11T07:05:22.241 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQATQeFmdiuyIhAA53Q2WjX991FCGa2QschFgA== 2024-09-11T07:05:22.242 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2024-09-11T07:05:22.242 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQATQeFmQoNMJRAA2sEOyMdf1Nnpb1CsDRdJWA== 2024-09-11T07:05:22.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T07:05:22.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T07:05:22.333 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.336 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.425 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.466 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.551 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.554 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.632 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T07:05:22.637 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-11T07:05:22.715 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.721 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.800 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.805 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.891 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.894 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.976 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:22.980 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-11T07:05:23.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T07:05:23.069 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T07:05:23.149 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T07:05:23.153 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-11T07:05:23.234 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-11T07:05:23.234 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-11T07:05:23.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T07:05:23.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-11T07:05:23.390 DEBUG:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-11T07:05:23.440 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T07:05:23.532 DEBUG:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-11T07:05:23.543 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-11T07:05:23.557 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-11T07:05:23.649 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-11T07:05:23.660 DEBUG:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:05:23.662 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-11T07:05:23.708 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-11T07:05:23.708 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-11T07:05:23.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-11T07:05:23.710 INFO:tasks.ceph.mon.a:Started 2024-09-11T07:05:23.710 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-11T07:05:23.711 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-11T07:05:23.713 INFO:tasks.ceph.mon.c:Started 2024-09-11T07:05:23.713 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-11T07:05:23.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-11T07:05:23.753 INFO:tasks.ceph.mon.b:Started 2024-09-11T07:05:23.753 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-11T07:05:23.754 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-11T07:05:23.754 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-11T07:05:23.756 INFO:tasks.ceph.mgr.y:Started 2024-09-11T07:05:23.756 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-11T07:05:23.756 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-11T07:05:23.759 INFO:tasks.ceph.mgr.x:Started 2024-09-11T07:05:23.759 INFO:tasks.ceph:Setting crush tunables to default 2024-09-11T07:05:23.759 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd crush tunables default 2024-09-11T07:05:29.239 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2024-09-11T07:05:29.259 INFO:tasks.ceph:check_enable_crimson: False 2024-09-11T07:05:29.259 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-11T07:05:29.259 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:05:29.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-11T07:05:29.271 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:05:29.272 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-11T07:05:29.330 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:05:29.330 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-11T07:05:29.340 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:29.340+0000 7fd90171b180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T07:05:29.351 DEBUG:teuthology.orchestra.run.smithi079:> set -ex 2024-09-11T07:05:29.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-11T07:05:29.397 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:29.394+0000 7fed47b70180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-11T07:05:29.407 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:05:29.407 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-11T07:05:29.420 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:05:29.420 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-11T07:05:29.476 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:05:29.476 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-11T07:05:29.531 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-09-11T07:05:29.531 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-11T07:05:29.584 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 24d57cdb-2f3a-4a96-903d-11be7dc26a20 0 2024-09-11T07:05:29.857 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:29.856+0000 7fd90171b180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T07:05:29.929 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:29.926+0000 7fed47b70180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-11T07:05:29.956 INFO:teuthology.orchestra.run.smithi110.stderr:2024-09-11T07:05:29.954+0000 7f6da259c640 0 --2- 172.21.15.110:0/3065019287 >> v2:172.21.15.110:3300/0 conn(0x7f6da4142440 0x7f6da40af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-11T07:05:30.044 INFO:teuthology.orchestra.run.smithi110.stdout:0 2024-09-11T07:05:30.060 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new aa51dc1b-b783-4212-8736-1f666239613b 1 2024-09-11T07:05:30.072 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:30.072+0000 7fd90171b180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T07:05:30.120 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:30.118+0000 7fed47b70180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-11T07:05:30.263 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-09-11T07:05:30.279 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 141a913f-7353-44a9-9dbd-70219bcee638 2 2024-09-11T07:05:30.478 INFO:teuthology.orchestra.run.smithi110.stdout:2 2024-09-11T07:05:30.494 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 32550aeb-0c8d-4ca9-afd5-3e5258e7255b 3 2024-09-11T07:05:30.642 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:30.640+0000 7fd90171b180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T07:05:30.680 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:30.678+0000 7fed47b70180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-11T07:05:30.695 INFO:teuthology.orchestra.run.smithi110.stdout:3 2024-09-11T07:05:30.695 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:30.696+0000 7fd90171b180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T07:05:30.711 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc 4 2024-09-11T07:05:30.736 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:30.734+0000 7fed47b70180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-11T07:05:30.747 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:30.748+0000 7fd90171b180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T07:05:30.790 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:30.786+0000 7fed47b70180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-11T07:05:30.824 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:30.824+0000 7fd90171b180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T07:05:30.876 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:30.876+0000 7fd90171b180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T07:05:30.883 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:30.878+0000 7fed47b70180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-11T07:05:30.923 INFO:teuthology.orchestra.run.smithi110.stdout:4 2024-09-11T07:05:30.941 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 42c83053-328e-4c9b-bdaf-09e1a4cc8b7d 5 2024-09-11T07:05:30.941 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:30.938+0000 7fed47b70180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-11T07:05:30.953 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:30.952+0000 7fd90171b180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T07:05:31.005 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:31.004+0000 7fd90171b180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T07:05:31.023 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:31.018+0000 7fed47b70180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-11T07:05:31.078 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:31.074+0000 7fed47b70180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-11T07:05:31.157 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:31.156+0000 7fd90171b180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T07:05:31.182 INFO:teuthology.orchestra.run.smithi110.stdout:5 2024-09-11T07:05:31.199 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 0ab29b1f-3012-4528-8f47-2cac908122c9 6 2024-09-11T07:05:31.219 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:31.220+0000 7fd90171b180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T07:05:31.235 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:31.230+0000 7fed47b70180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-11T07:05:31.298 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:31.294+0000 7fed47b70180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-11T07:05:31.436 INFO:teuthology.orchestra.run.smithi110.stdout:6 2024-09-11T07:05:31.452 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new d9c7d12b-be93-41c9-a246-773faa65ecaf 7 2024-09-11T07:05:31.690 INFO:teuthology.orchestra.run.smithi110.stdout:7 2024-09-11T07:05:31.706 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-11T07:05:31.706 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-11T07:05:31.709 INFO:tasks.ceph.osd.0:Started 2024-09-11T07:05:31.709 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-11T07:05:31.709 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-11T07:05:31.711 INFO:tasks.ceph.osd.1:Started 2024-09-11T07:05:31.711 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-11T07:05:31.712 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-11T07:05:31.714 INFO:tasks.ceph.osd.2:Started 2024-09-11T07:05:31.714 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-11T07:05:31.714 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-11T07:05:31.716 INFO:tasks.ceph.osd.3:Started 2024-09-11T07:05:31.716 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-11T07:05:31.716 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-11T07:05:31.718 INFO:tasks.ceph.osd.4:Started 2024-09-11T07:05:31.718 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-11T07:05:31.718 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-11T07:05:31.720 INFO:tasks.ceph.osd.5:Started 2024-09-11T07:05:31.720 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-11T07:05:31.720 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-11T07:05:31.722 INFO:tasks.ceph.osd.6:Started 2024-09-11T07:05:31.722 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-11T07:05:31.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-11T07:05:31.724 INFO:tasks.ceph.osd.7:Started 2024-09-11T07:05:31.724 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T07:05:31.909 INFO:tasks.ceph.mgr.y.smithi079.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T07:05:31.909 INFO:tasks.ceph.mgr.y.smithi079.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T07:05:31.909 INFO:tasks.ceph.mgr.y.smithi079.stderr: from numpy import show_config as show_numpy_config 2024-09-11T07:05:31.919 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:05:31.919 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":10,"fsid":"e1313abd-54a9-4e53-ab67-469f744048b1","created":"2024-09-11T07:05:29.098467+0000","modified":"2024-09-11T07:05:31.688503+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T07:05:31.688503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"24d57cdb-2f3a-4a96-903d-11be7dc26a20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aa51dc1b-b783-4212-8736-1f666239613b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"141a913f-7353-44a9-9dbd-70219bcee638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"32550aeb-0c8d-4ca9-afd5-3e5258e7255b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"42c83053-328e-4c9b-bdaf-09e1a4cc8b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0ab29b1f-3012-4528-8f47-2cac908122c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d9c7d12b-be93-41c9-a246-773faa65ecaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T07:05:31.935 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-11T07:05:31.935 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-11T07:05:31.944 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:31.944+0000 7fd90171b180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T07:05:32.004 INFO:tasks.ceph.mgr.x.smithi110.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-11T07:05:32.004 INFO:tasks.ceph.mgr.x.smithi110.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-11T07:05:32.004 INFO:tasks.ceph.mgr.x.smithi110.stderr: from numpy import show_config as show_numpy_config 2024-09-11T07:05:32.058 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:32.054+0000 7fed47b70180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-11T07:05:32.089 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:32.088+0000 7fd90171b180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T07:05:32.235 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:32.230+0000 7fed47b70180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-11T07:05:32.269 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:32.268+0000 7fd90171b180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T07:05:32.349 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:32.348+0000 7fd90171b180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T07:05:32.385 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:32.382+0000 7fed47b70180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-11T07:05:32.448 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:32.446+0000 7fed47b70180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-11T07:05:32.484 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:32.484+0000 7fd90171b180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T07:05:32.583 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:32.578+0000 7fed47b70180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-11T07:05:32.741 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T07:05:32.884 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:05:32.884+0000 7f1c0d5957c0 -1 Falling back to public interface 2024-09-11T07:05:32.920 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:05:32.920+0000 7fcd48de17c0 -1 Falling back to public interface 2024-09-11T07:05:32.926 INFO:teuthology.misc.health.smithi079.stdout: 2024-09-11T07:05:32.926 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":10,"fsid":"e1313abd-54a9-4e53-ab67-469f744048b1","created":"2024-09-11T07:05:29.098467+0000","modified":"2024-09-11T07:05:31.688503+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T07:05:31.688503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"24d57cdb-2f3a-4a96-903d-11be7dc26a20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aa51dc1b-b783-4212-8736-1f666239613b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"141a913f-7353-44a9-9dbd-70219bcee638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"32550aeb-0c8d-4ca9-afd5-3e5258e7255b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"42c83053-328e-4c9b-bdaf-09e1a4cc8b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0ab29b1f-3012-4528-8f47-2cac908122c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d9c7d12b-be93-41c9-a246-773faa65ecaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T07:05:32.936 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:05:32.936+0000 7f8ec02dd7c0 -1 Falling back to public interface 2024-09-11T07:05:32.941 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T07:05:33.085 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:05:33.082+0000 7f5143e3e7c0 -1 Falling back to public interface 2024-09-11T07:05:33.101 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:33.100+0000 7fd90171b180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T07:05:33.161 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:33.158+0000 7fb45447a7c0 -1 Falling back to public interface 2024-09-11T07:05:33.178 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:33.176+0000 7fd90171b180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T07:05:33.185 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:05:33.182+0000 7fd950d6c7c0 -1 Falling back to public interface 2024-09-11T07:05:33.190 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:33.186+0000 7fed47b70180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-11T07:05:33.266 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:33.262+0000 7fed47b70180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-11T07:05:33.318 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:05:33.314+0000 7fe3edf2f7c0 -1 Falling back to public interface 2024-09-11T07:05:33.359 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:33.360+0000 7fd90171b180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T07:05:33.429 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:05:33.428+0000 7f56eb1a97c0 -1 Falling back to public interface 2024-09-11T07:05:33.432 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:33.432+0000 7fd90171b180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T07:05:33.447 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:33.442+0000 7fed47b70180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-11T07:05:33.521 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:33.518+0000 7fed47b70180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-11T07:05:33.723 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:33.720+0000 7fd90171b180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T07:05:33.784 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:33.784+0000 7fd90171b180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T07:05:33.810 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:33.806+0000 7fed47b70180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-11T07:05:33.872 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-09-11T07:05:33.870+0000 7fed47b70180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-11T07:05:34.833 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:34.832+0000 7fd8a8350640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-11T07:05:34.833 INFO:tasks.ceph.mgr.y.smithi079.stderr:2024-09-11T07:05:34.832+0000 7fd8a8350640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-11T07:05:36.870 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:05:36.868+0000 7f1c0d5957c0 -1 osd.1 0 log_to_monitors true 2024-09-11T07:05:36.979 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:05:36.980+0000 7fcd48de17c0 -1 osd.3 0 log_to_monitors true 2024-09-11T07:05:36.993 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:05:36.992+0000 7f8ec02dd7c0 -1 osd.2 0 log_to_monitors true 2024-09-11T07:05:37.078 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:05:37.074+0000 7f5143e3e7c0 -1 osd.7 0 log_to_monitors true 2024-09-11T07:05:37.185 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:37.182+0000 7fb45447a7c0 -1 osd.4 0 log_to_monitors true 2024-09-11T07:05:37.278 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:05:37.274+0000 7fd950d6c7c0 -1 osd.6 0 log_to_monitors true 2024-09-11T07:05:37.376 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:05:37.374+0000 7fe3edf2f7c0 -1 osd.5 0 log_to_monitors true 2024-09-11T07:05:37.698 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:05:37.696+0000 7f56eb1a97c0 -1 osd.0 0 log_to_monitors true 2024-09-11T07:05:39.747 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T07:05:40.019 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:05:40.014+0000 7fd94d527640 -1 osd.6 0 waiting for initial osdmap 2024-09-11T07:05:40.047 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:40.042+0000 7fb450423640 -1 osd.4 0 waiting for initial osdmap 2024-09-11T07:05:40.064 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:05:40.062+0000 7fd944b4a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T07:05:40.072 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:40.070+0000 7fb448258640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T07:05:40.111 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:05:40.106+0000 7f513fde7640 -1 osd.7 0 waiting for initial osdmap 2024-09-11T07:05:40.124 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:05:40.122+0000 7fe3e9ed8640 -1 osd.5 0 waiting for initial osdmap 2024-09-11T07:05:40.136 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:05:40.134+0000 7f5137c1c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T07:05:40.137 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:05:40.136+0000 7f56e7964640 -1 osd.0 0 waiting for initial osdmap 2024-09-11T07:05:40.137 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:05:40.136+0000 7f8ebc286640 -1 osd.2 0 waiting for initial osdmap 2024-09-11T07:05:40.148 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:05:40.146+0000 7fe3e1d0d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T07:05:40.165 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:05:40.164+0000 7f8eb40bb640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T07:05:40.165 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:05:40.164+0000 7f56def87640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T07:05:40.179 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:05:40.180+0000 7fcd44d8a640 -1 osd.3 0 waiting for initial osdmap 2024-09-11T07:05:40.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:05:40.196+0000 7f1c09d50640 -1 osd.1 0 waiting for initial osdmap 2024-09-11T07:05:40.203 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:05:40.204+0000 7fcd3cbbf640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T07:05:40.207 INFO:teuthology.misc.health.smithi079.stdout: 2024-09-11T07:05:40.207 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":12,"fsid":"e1313abd-54a9-4e53-ab67-469f744048b1","created":"2024-09-11T07:05:29.098467+0000","modified":"2024-09-11T07:05:38.823099+0000","last_up_change":"0.000000","last_in_change":"2024-09-11T07:05:31.688503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"24d57cdb-2f3a-4a96-903d-11be7dc26a20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"aa51dc1b-b783-4212-8736-1f666239613b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"141a913f-7353-44a9-9dbd-70219bcee638","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"32550aeb-0c8d-4ca9-afd5-3e5258e7255b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"42c83053-328e-4c9b-bdaf-09e1a4cc8b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0ab29b1f-3012-4528-8f47-2cac908122c9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"d9c7d12b-be93-41c9-a246-773faa65ecaf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T07:05:40.220 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:05:40.220+0000 7f1c01373640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-11T07:05:40.223 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-11T07:05:47.031 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-11T07:05:47.333 INFO:teuthology.misc.health.smithi079.stdout: 2024-09-11T07:05:47.333 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":16,"fsid":"e1313abd-54a9-4e53-ab67-469f744048b1","created":"2024-09-11T07:05:29.098467+0000","modified":"2024-09-11T07:05:44.059975+0000","last_up_change":"2024-09-11T07:05:41.051856+0000","last_in_change":"2024-09-11T07:05:31.688503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T07:05:41.897005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"24d57cdb-2f3a-4a96-903d-11be7dc26a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6825","nonce":1708235775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6827","nonce":1708235775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6831","nonce":1708235775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6829","nonce":1708235775}]},"public_addr":"172.21.15.79:6825/1708235775","cluster_addr":"172.21.15.79:6827/1708235775","heartbeat_back_addr":"172.21.15.79:6831/1708235775","heartbeat_front_addr":"172.21.15.79:6829/1708235775","state":["exists","up"]},{"osd":1,"uuid":"aa51dc1b-b783-4212-8736-1f666239613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6801","nonce":2076268206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6803","nonce":2076268206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6807","nonce":2076268206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6805","nonce":2076268206}]},"public_addr":"172.21.15.79:6801/2076268206","cluster_addr":"172.21.15.79:6803/2076268206","heartbeat_back_addr":"172.21.15.79:6807/2076268206","heartbeat_front_addr":"172.21.15.79:6805/2076268206","state":["exists","up"]},{"osd":2,"uuid":"141a913f-7353-44a9-9dbd-70219bcee638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6817","nonce":1904492349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6819","nonce":1904492349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6823","nonce":1904492349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6821","nonce":1904492349}]},"public_addr":"172.21.15.79:6817/1904492349","cluster_addr":"172.21.15.79:6819/1904492349","heartbeat_back_addr":"172.21.15.79:6823/1904492349","heartbeat_front_addr":"172.21.15.79:6821/1904492349","state":["exists","up"]},{"osd":3,"uuid":"32550aeb-0c8d-4ca9-afd5-3e5258e7255b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6809","nonce":1327328912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6811","nonce":1327328912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6815","nonce":1327328912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6813","nonce":1327328912}]},"public_addr":"172.21.15.79:6809/1327328912","cluster_addr":"172.21.15.79:6811/1327328912","heartbeat_back_addr":"172.21.15.79:6815/1327328912","heartbeat_front_addr":"172.21.15.79:6813/1327328912","state":["exists","up"]},{"osd":4,"uuid":"88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6809","nonce":4087452871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6811","nonce":4087452871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6815","nonce":4087452871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6813","nonce":4087452871}]},"public_addr":"172.21.15.110:6809/4087452871","cluster_addr":"172.21.15.110:6811/4087452871","heartbeat_back_addr":"172.21.15.110:6815/4087452871","heartbeat_front_addr":"172.21.15.110:6813/4087452871","state":["exists","up"]},{"osd":5,"uuid":"42c83053-328e-4c9b-bdaf-09e1a4cc8b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6825","nonce":2133006853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6827","nonce":2133006853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6831","nonce":2133006853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6829","nonce":2133006853}]},"public_addr":"172.21.15.110:6825/2133006853","cluster_addr":"172.21.15.110:6827/2133006853","heartbeat_back_addr":"172.21.15.110:6831/2133006853","heartbeat_front_addr":"172.21.15.110:6829/2133006853","state":["exists","up"]},{"osd":6,"uuid":"0ab29b1f-3012-4528-8f47-2cac908122c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6817","nonce":2083734892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6819","nonce":2083734892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6823","nonce":2083734892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6821","nonce":2083734892}]},"public_addr":"172.21.15.110:6817/2083734892","cluster_addr":"172.21.15.110:6819/2083734892","heartbeat_back_addr":"172.21.15.110:6823/2083734892","heartbeat_front_addr":"172.21.15.110:6821/2083734892","state":["exists","up"]},{"osd":7,"uuid":"d9c7d12b-be93-41c9-a246-773faa65ecaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6801","nonce":2322042784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6803","nonce":2322042784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6807","nonce":2322042784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6805","nonce":2322042784}]},"public_addr":"172.21.15.110:6801/2322042784","cluster_addr":"172.21.15.110:6803/2322042784","heartbeat_back_addr":"172.21.15.110:6807/2322042784","heartbeat_front_addr":"172.21.15.110:6805/2322042784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.653648+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.846269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.970884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.985630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.236412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.336953+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.306806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.104744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T07:05:47.350 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-11T07:05:47.350 INFO:tasks.ceph:Creating RBD pool 2024-09-11T07:05:47.351 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-11T07:05:48.133 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'rbd' created 2024-09-11T07:05:48.157 DEBUG:teuthology.orchestra.run.smithi079:> rbd --cluster ceph pool init rbd 2024-09-11T07:05:51.182 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-11T07:05:51.183 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-11T07:05:51.183 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-11T07:05:51.183 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-11T07:05:51.184 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-11T07:05:51.537 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:05:51.554 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":1375954229},{"type":"v1","addr":"172.21.15.79:6833","nonce":1375954229}]},"active_addr":"172.21.15.79:6833/1375954229","active_change":"2024-09-11T07:05:33.807047+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1588758006}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":732520181}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":3663245991}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.79:0","nonce":1525942413}]}]} 2024-09-11T07:05:51.557 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-11T07:05:51.558 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T07:05:51.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T07:05:51.853 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:05:51.853 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"e1313abd-54a9-4e53-ab67-469f744048b1","created":"2024-09-11T07:05:29.098467+0000","modified":"2024-09-11T07:05:51.143864+0000","last_up_change":"2024-09-11T07:05:41.051856+0000","last_in_change":"2024-09-11T07:05:31.688503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T07:05:41.897005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T07:05:47.687214+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"24d57cdb-2f3a-4a96-903d-11be7dc26a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6825","nonce":1708235775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6827","nonce":1708235775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6831","nonce":1708235775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6829","nonce":1708235775}]},"public_addr":"172.21.15.79:6825/1708235775","cluster_addr":"172.21.15.79:6827/1708235775","heartbeat_back_addr":"172.21.15.79:6831/1708235775","heartbeat_front_addr":"172.21.15.79:6829/1708235775","state":["exists","up"]},{"osd":1,"uuid":"aa51dc1b-b783-4212-8736-1f666239613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6801","nonce":2076268206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6803","nonce":2076268206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6807","nonce":2076268206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6805","nonce":2076268206}]},"public_addr":"172.21.15.79:6801/2076268206","cluster_addr":"172.21.15.79:6803/2076268206","heartbeat_back_addr":"172.21.15.79:6807/2076268206","heartbeat_front_addr":"172.21.15.79:6805/2076268206","state":["exists","up"]},{"osd":2,"uuid":"141a913f-7353-44a9-9dbd-70219bcee638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6817","nonce":1904492349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6819","nonce":1904492349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6823","nonce":1904492349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6821","nonce":1904492349}]},"public_addr":"172.21.15.79:6817/1904492349","cluster_addr":"172.21.15.79:6819/1904492349","heartbeat_back_addr":"172.21.15.79:6823/1904492349","heartbeat_front_addr":"172.21.15.79:6821/1904492349","state":["exists","up"]},{"osd":3,"uuid":"32550aeb-0c8d-4ca9-afd5-3e5258e7255b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6809","nonce":1327328912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6811","nonce":1327328912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6815","nonce":1327328912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6813","nonce":1327328912}]},"public_addr":"172.21.15.79:6809/1327328912","cluster_addr":"172.21.15.79:6811/1327328912","heartbeat_back_addr":"172.21.15.79:6815/1327328912","heartbeat_front_addr":"172.21.15.79:6813/1327328912","state":["exists","up"]},{"osd":4,"uuid":"88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6809","nonce":4087452871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6811","nonce":4087452871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6815","nonce":4087452871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6813","nonce":4087452871}]},"public_addr":"172.21.15.110:6809/4087452871","cluster_addr":"172.21.15.110:6811/4087452871","heartbeat_back_addr":"172.21.15.110:6815/4087452871","heartbeat_front_addr":"172.21.15.110:6813/4087452871","state":["exists","up"]},{"osd":5,"uuid":"42c83053-328e-4c9b-bdaf-09e1a4cc8b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6825","nonce":2133006853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6827","nonce":2133006853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6831","nonce":2133006853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6829","nonce":2133006853}]},"public_addr":"172.21.15.110:6825/2133006853","cluster_addr":"172.21.15.110:6827/2133006853","heartbeat_back_addr":"172.21.15.110:6831/2133006853","heartbeat_front_addr":"172.21.15.110:6829/2133006853","state":["exists","up"]},{"osd":6,"uuid":"0ab29b1f-3012-4528-8f47-2cac908122c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6817","nonce":2083734892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6819","nonce":2083734892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6823","nonce":2083734892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6821","nonce":2083734892}]},"public_addr":"172.21.15.110:6817/2083734892","cluster_addr":"172.21.15.110:6819/2083734892","heartbeat_back_addr":"172.21.15.110:6823/2083734892","heartbeat_front_addr":"172.21.15.110:6821/2083734892","state":["exists","up"]},{"osd":7,"uuid":"d9c7d12b-be93-41c9-a246-773faa65ecaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6801","nonce":2322042784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6803","nonce":2322042784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6807","nonce":2322042784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6805","nonce":2322042784}]},"public_addr":"172.21.15.110:6801/2322042784","cluster_addr":"172.21.15.110:6803/2322042784","heartbeat_back_addr":"172.21.15.110:6807/2322042784","heartbeat_front_addr":"172.21.15.110:6805/2322042784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.653648+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.846269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.970884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.985630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.236412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.336953+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.306806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.104744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T07:05:51.871 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T07:05:51.872 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T07:05:52.166 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:05:52.166 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"e1313abd-54a9-4e53-ab67-469f744048b1","created":"2024-09-11T07:05:29.098467+0000","modified":"2024-09-11T07:05:51.143864+0000","last_up_change":"2024-09-11T07:05:41.051856+0000","last_in_change":"2024-09-11T07:05:31.688503+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T07:05:41.897005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T07:05:47.687214+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"24d57cdb-2f3a-4a96-903d-11be7dc26a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6825","nonce":1708235775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6827","nonce":1708235775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6831","nonce":1708235775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6829","nonce":1708235775}]},"public_addr":"172.21.15.79:6825/1708235775","cluster_addr":"172.21.15.79:6827/1708235775","heartbeat_back_addr":"172.21.15.79:6831/1708235775","heartbeat_front_addr":"172.21.15.79:6829/1708235775","state":["exists","up"]},{"osd":1,"uuid":"aa51dc1b-b783-4212-8736-1f666239613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6801","nonce":2076268206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6803","nonce":2076268206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6807","nonce":2076268206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6805","nonce":2076268206}]},"public_addr":"172.21.15.79:6801/2076268206","cluster_addr":"172.21.15.79:6803/2076268206","heartbeat_back_addr":"172.21.15.79:6807/2076268206","heartbeat_front_addr":"172.21.15.79:6805/2076268206","state":["exists","up"]},{"osd":2,"uuid":"141a913f-7353-44a9-9dbd-70219bcee638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6817","nonce":1904492349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6819","nonce":1904492349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6823","nonce":1904492349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6821","nonce":1904492349}]},"public_addr":"172.21.15.79:6817/1904492349","cluster_addr":"172.21.15.79:6819/1904492349","heartbeat_back_addr":"172.21.15.79:6823/1904492349","heartbeat_front_addr":"172.21.15.79:6821/1904492349","state":["exists","up"]},{"osd":3,"uuid":"32550aeb-0c8d-4ca9-afd5-3e5258e7255b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6809","nonce":1327328912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6811","nonce":1327328912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6815","nonce":1327328912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6813","nonce":1327328912}]},"public_addr":"172.21.15.79:6809/1327328912","cluster_addr":"172.21.15.79:6811/1327328912","heartbeat_back_addr":"172.21.15.79:6815/1327328912","heartbeat_front_addr":"172.21.15.79:6813/1327328912","state":["exists","up"]},{"osd":4,"uuid":"88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6809","nonce":4087452871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6811","nonce":4087452871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6815","nonce":4087452871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6813","nonce":4087452871}]},"public_addr":"172.21.15.110:6809/4087452871","cluster_addr":"172.21.15.110:6811/4087452871","heartbeat_back_addr":"172.21.15.110:6815/4087452871","heartbeat_front_addr":"172.21.15.110:6813/4087452871","state":["exists","up"]},{"osd":5,"uuid":"42c83053-328e-4c9b-bdaf-09e1a4cc8b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6825","nonce":2133006853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6827","nonce":2133006853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6831","nonce":2133006853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6829","nonce":2133006853}]},"public_addr":"172.21.15.110:6825/2133006853","cluster_addr":"172.21.15.110:6827/2133006853","heartbeat_back_addr":"172.21.15.110:6831/2133006853","heartbeat_front_addr":"172.21.15.110:6829/2133006853","state":["exists","up"]},{"osd":6,"uuid":"0ab29b1f-3012-4528-8f47-2cac908122c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6817","nonce":2083734892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6819","nonce":2083734892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6823","nonce":2083734892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6821","nonce":2083734892}]},"public_addr":"172.21.15.110:6817/2083734892","cluster_addr":"172.21.15.110:6819/2083734892","heartbeat_back_addr":"172.21.15.110:6823/2083734892","heartbeat_front_addr":"172.21.15.110:6821/2083734892","state":["exists","up"]},{"osd":7,"uuid":"d9c7d12b-be93-41c9-a246-773faa65ecaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6801","nonce":2322042784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6803","nonce":2322042784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6807","nonce":2322042784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6805","nonce":2322042784}]},"public_addr":"172.21.15.110:6801/2322042784","cluster_addr":"172.21.15.110:6803/2322042784","heartbeat_back_addr":"172.21.15.110:6807/2322042784","heartbeat_front_addr":"172.21.15.110:6805/2322042784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.653648+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.846269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.970884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.985630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.236412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.336953+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.306806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.104744+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T07:05:52.184 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T07:05:52.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T07:05:52.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T07:05:52.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T07:05:52.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T07:05:52.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T07:05:52.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T07:05:52.187 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T07:05:52.437 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-11T07:05:52.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T07:05:52.442 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-11T07:05:52.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T07:05:52.443 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-09-11T07:05:52.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T07:05:52.450 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-09-11T07:05:52.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T07:05:52.451 INFO:teuthology.orchestra.run.smithi079.stdout:55834574852 2024-09-11T07:05:52.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T07:05:52.458 INFO:teuthology.orchestra.run.smithi079.stdout:55834574852 2024-09-11T07:05:52.458 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T07:05:52.464 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-11T07:05:52.465 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T07:05:52.470 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-11T07:05:52.470 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T07:05:52.937 INFO:teuthology.orchestra.run.smithi079.stdout:55834574851 2024-09-11T07:05:52.957 INFO:teuthology.orchestra.run.smithi079.stdout:55834574851 2024-09-11T07:05:52.958 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.3 2024-09-11T07:05:52.975 INFO:teuthology.orchestra.run.smithi079.stdout:55834574850 2024-09-11T07:05:52.977 INFO:teuthology.orchestra.run.smithi079.stdout:55834574852 2024-09-11T07:05:52.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.0 2024-09-11T07:05:52.997 INFO:teuthology.orchestra.run.smithi079.stdout:55834574850 2024-09-11T07:05:52.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.4 2024-09-11T07:05:53.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.7 2024-09-11T07:05:53.010 INFO:teuthology.orchestra.run.smithi079.stdout:55834574851 2024-09-11T07:05:53.016 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574850 for osd.1 2024-09-11T07:05:53.017 INFO:teuthology.orchestra.run.smithi079.stdout:55834574852 2024-09-11T07:05:53.028 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.5 2024-09-11T07:05:53.029 INFO:teuthology.orchestra.run.smithi079.stdout:55834574851 2024-09-11T07:05:53.040 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574852 for osd.6 2024-09-11T07:05:53.047 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.2 2024-09-11T07:05:53.959 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T07:05:53.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T07:05:53.999 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T07:05:54.004 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T07:05:54.017 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T07:05:54.030 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T07:05:54.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T07:05:54.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T07:05:54.439 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-11T07:05:54.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2024-09-11T07:05:54.463 DEBUG:teuthology.parallel:result is None 2024-09-11T07:05:54.506 INFO:teuthology.orchestra.run.smithi079.stdout:55834574852 2024-09-11T07:05:54.522 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-11T07:05:54.529 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-09-11T07:05:54.533 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2024-09-11T07:05:54.533 DEBUG:teuthology.parallel:result is None 2024-09-11T07:05:54.534 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-11T07:05:54.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-09-11T07:05:54.545 DEBUG:teuthology.parallel:result is None 2024-09-11T07:05:54.554 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-09-11T07:05:54.555 DEBUG:teuthology.parallel:result is None 2024-09-11T07:05:54.560 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-11T07:05:54.560 DEBUG:teuthology.parallel:result is None 2024-09-11T07:05:54.581 INFO:teuthology.orchestra.run.smithi079.stdout:55834574854 2024-09-11T07:05:54.590 INFO:teuthology.orchestra.run.smithi079.stdout:55834574852 2024-09-11T07:05:54.594 INFO:teuthology.orchestra.run.smithi079.stdout:55834574853 2024-09-11T07:05:54.599 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-09-11T07:05:54.599 DEBUG:teuthology.parallel:result is None 2024-09-11T07:05:54.615 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-09-11T07:05:54.615 DEBUG:teuthology.parallel:result is None 2024-09-11T07:05:54.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-09-11T07:05:54.617 DEBUG:teuthology.parallel:result is None 2024-09-11T07:05:54.617 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T07:05:54.618 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:05:54.923 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:05:54.923 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:05:54.939 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-11T07:05:53.819433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234628,"kb_used_data":1708,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740092,"statfs":{"total":773094113280,"available":772853854208,"internally_reserved":0,"allocated":1748992,"data_stored":1726110,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12760,"internal_metadata":238276136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.689360"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.290755+0000","last_change":"2024-09-11T07:05:51.290755+0000","last_active":"2024-09-11T07:05:51.290755+0000","last_peered":"2024-09-11T07:05:51.290755+0000","last_clean":"2024-09-11T07:05:51.290755+0000","last_became_active":"2024-09-11T07:05:49.149584+0000","last_became_peered":"2024-09-11T07:05:49.149584+0000","last_unstale":"2024-09-11T07:05:51.290755+0000","last_undegraded":"2024-09-11T07:05:51.290755+0000","last_fullsized":"2024-09-11T07:05:51.290755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:52.879340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074652400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.150991+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:05:51.150991+0000","last_peered":"2024-09-11T07:05:51.150991+0000","last_clean":"2024-09-11T07:05:51.150991+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:05:51.150991+0000","last_undegraded":"2024-09-11T07:05:51.150991+0000","last_fullsized":"2024-09-11T07:05:51.150991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.786713+0000","last_change":"2024-09-11T07:05:51.786713+0000","last_active":"2024-09-11T07:05:51.786713+0000","last_peered":"2024-09-11T07:05:51.786713+0000","last_clean":"2024-09-11T07:05:51.786713+0000","last_became_active":"2024-09-11T07:05:49.724679+0000","last_became_peered":"2024-09-11T07:05:49.724679+0000","last_unstale":"2024-09-11T07:05:51.786713+0000","last_undegraded":"2024-09-11T07:05:51.786713+0000","last_fullsized":"2024-09-11T07:05:51.786713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:36:43.830759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.151362+0000","last_change":"2024-09-11T07:05:51.151362+0000","last_active":"2024-09-11T07:05:51.151362+0000","last_peered":"2024-09-11T07:05:51.151362+0000","last_clean":"2024-09-11T07:05:51.151362+0000","last_became_active":"2024-09-11T07:05:49.725356+0000","last_became_peered":"2024-09-11T07:05:49.725356+0000","last_unstale":"2024-09-11T07:05:51.151362+0000","last_undegraded":"2024-09-11T07:05:51.151362+0000","last_fullsized":"2024-09-11T07:05:51.151362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:53.822013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.164067+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:05:51.164067+0000","last_peered":"2024-09-11T07:05:51.164067+0000","last_clean":"2024-09-11T07:05:51.164067+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:05:51.164067+0000","last_undegraded":"2024-09-11T07:05:51.164067+0000","last_fullsized":"2024-09-11T07:05:51.164067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.153018+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:05:51.153018+0000","last_peered":"2024-09-11T07:05:51.153018+0000","last_clean":"2024-09-11T07:05:51.153018+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:05:51.153018+0000","last_undegraded":"2024-09-11T07:05:51.153018+0000","last_fullsized":"2024-09-11T07:05:51.153018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.786715+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:05:51.786715+0000","last_peered":"2024-09-11T07:05:51.786715+0000","last_clean":"2024-09-11T07:05:51.786715+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:05:51.786715+0000","last_undegraded":"2024-09-11T07:05:51.786715+0000","last_fullsized":"2024-09-11T07:05:51.786715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.161621+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:05:51.161621+0000","last_peered":"2024-09-11T07:05:51.161621+0000","last_clean":"2024-09-11T07:05:51.161621+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:05:51.161621+0000","last_undegraded":"2024-09-11T07:05:51.161621+0000","last_fullsized":"2024-09-11T07:05:51.161621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.785564+0000","last_change":"2024-09-11T07:05:43.785344+0000","last_active":"2024-09-11T07:05:51.785564+0000","last_peered":"2024-09-11T07:05:51.785564+0000","last_clean":"2024-09-11T07:05:51.785564+0000","last_became_active":"2024-09-11T07:05:43.783090+0000","last_became_peered":"2024-09-11T07:05:43.783090+0000","last_unstale":"2024-09-11T07:05:51.785564+0000","last_undegraded":"2024-09-11T07:05:51.785564+0000","last_fullsized":"2024-09-11T07:05:51.785564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:32.027951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":262144,"data_stored":659264,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":262144,"data_stored":659264,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:05:54.940 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:05:55.209 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:05:55.209 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:05:55.226 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2024-09-11T07:05:53.819433+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234628,"kb_used_data":1708,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740092,"statfs":{"total":773094113280,"available":772853854208,"internally_reserved":0,"allocated":1748992,"data_stored":1726110,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12760,"internal_metadata":238276136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.689360"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.290755+0000","last_change":"2024-09-11T07:05:51.290755+0000","last_active":"2024-09-11T07:05:51.290755+0000","last_peered":"2024-09-11T07:05:51.290755+0000","last_clean":"2024-09-11T07:05:51.290755+0000","last_became_active":"2024-09-11T07:05:49.149584+0000","last_became_peered":"2024-09-11T07:05:49.149584+0000","last_unstale":"2024-09-11T07:05:51.290755+0000","last_undegraded":"2024-09-11T07:05:51.290755+0000","last_fullsized":"2024-09-11T07:05:51.290755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:52.879340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074652400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.150991+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:05:51.150991+0000","last_peered":"2024-09-11T07:05:51.150991+0000","last_clean":"2024-09-11T07:05:51.150991+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:05:51.150991+0000","last_undegraded":"2024-09-11T07:05:51.150991+0000","last_fullsized":"2024-09-11T07:05:51.150991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.786713+0000","last_change":"2024-09-11T07:05:51.786713+0000","last_active":"2024-09-11T07:05:51.786713+0000","last_peered":"2024-09-11T07:05:51.786713+0000","last_clean":"2024-09-11T07:05:51.786713+0000","last_became_active":"2024-09-11T07:05:49.724679+0000","last_became_peered":"2024-09-11T07:05:49.724679+0000","last_unstale":"2024-09-11T07:05:51.786713+0000","last_undegraded":"2024-09-11T07:05:51.786713+0000","last_fullsized":"2024-09-11T07:05:51.786713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:36:43.830759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.151362+0000","last_change":"2024-09-11T07:05:51.151362+0000","last_active":"2024-09-11T07:05:51.151362+0000","last_peered":"2024-09-11T07:05:51.151362+0000","last_clean":"2024-09-11T07:05:51.151362+0000","last_became_active":"2024-09-11T07:05:49.725356+0000","last_became_peered":"2024-09-11T07:05:49.725356+0000","last_unstale":"2024-09-11T07:05:51.151362+0000","last_undegraded":"2024-09-11T07:05:51.151362+0000","last_fullsized":"2024-09-11T07:05:51.151362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:53.822013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.164067+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:05:51.164067+0000","last_peered":"2024-09-11T07:05:51.164067+0000","last_clean":"2024-09-11T07:05:51.164067+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:05:51.164067+0000","last_undegraded":"2024-09-11T07:05:51.164067+0000","last_fullsized":"2024-09-11T07:05:51.164067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.153018+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:05:51.153018+0000","last_peered":"2024-09-11T07:05:51.153018+0000","last_clean":"2024-09-11T07:05:51.153018+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:05:51.153018+0000","last_undegraded":"2024-09-11T07:05:51.153018+0000","last_fullsized":"2024-09-11T07:05:51.153018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.786715+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:05:51.786715+0000","last_peered":"2024-09-11T07:05:51.786715+0000","last_clean":"2024-09-11T07:05:51.786715+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:05:51.786715+0000","last_undegraded":"2024-09-11T07:05:51.786715+0000","last_fullsized":"2024-09-11T07:05:51.786715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.161621+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:05:51.161621+0000","last_peered":"2024-09-11T07:05:51.161621+0000","last_clean":"2024-09-11T07:05:51.161621+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:05:51.161621+0000","last_undegraded":"2024-09-11T07:05:51.161621+0000","last_fullsized":"2024-09-11T07:05:51.161621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.785564+0000","last_change":"2024-09-11T07:05:43.785344+0000","last_active":"2024-09-11T07:05:51.785564+0000","last_peered":"2024-09-11T07:05:51.785564+0000","last_clean":"2024-09-11T07:05:51.785564+0000","last_became_active":"2024-09-11T07:05:43.783090+0000","last_became_peered":"2024-09-11T07:05:43.783090+0000","last_unstale":"2024-09-11T07:05:51.785564+0000","last_undegraded":"2024-09-11T07:05:51.785564+0000","last_fullsized":"2024-09-11T07:05:51.785564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:32.027951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":262144,"data_stored":659264,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":262144,"data_stored":659264,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:05:55.226 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T07:05:55.227 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-11T07:05:55.227 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-11T07:05:55.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-11T07:05:55.531 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:05:55.531 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-11T07:05:55.548 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-11T07:05:55.549 INFO:teuthology.run_tasks:Running task thrashosds... 2024-09-11T07:05:55.561 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-09-11T07:05:55.561 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'rbd qos iops burst': 100, 'rbd qos iops limit': 50, 'rbd qos schedule tick min': 100}, 'global': {'mon client directed command retry': 5, 'mon warn on pool no app': False, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zstd', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'but it is still running', 'objects unfound and apparently lost', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum', 'noscrub', 'nodeep-scrub'], 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'b53b6d3e9f4baeb64d08dfb72b9cb1112ce886fc'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'daaf78de334647fc0c800f4ac495cc9475a26bae'}} 2024-09-11T07:05:55.561 INFO:tasks.thrashosds:config is {'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-09-11T07:05:55.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-09-11T07:05:55.856 INFO:tasks.thrashosds:Beginning thrashosds... 2024-09-11T07:05:55.856 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T07:05:55.857 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:05:56.141 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:05:56.141 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:05:56.158 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T07:05:55.820041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234628,"kb_used_data":1708,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740092,"statfs":{"total":773094113280,"available":772853854208,"internally_reserved":0,"allocated":1748992,"data_stored":1726110,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12760,"internal_metadata":238276136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.678386"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.290755+0000","last_change":"2024-09-11T07:05:51.290755+0000","last_active":"2024-09-11T07:05:51.290755+0000","last_peered":"2024-09-11T07:05:51.290755+0000","last_clean":"2024-09-11T07:05:51.290755+0000","last_became_active":"2024-09-11T07:05:49.149584+0000","last_became_peered":"2024-09-11T07:05:49.149584+0000","last_unstale":"2024-09-11T07:05:51.290755+0000","last_undegraded":"2024-09-11T07:05:51.290755+0000","last_fullsized":"2024-09-11T07:05:51.290755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:52.879340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074652400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.150991+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:05:51.150991+0000","last_peered":"2024-09-11T07:05:51.150991+0000","last_clean":"2024-09-11T07:05:51.150991+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:05:51.150991+0000","last_undegraded":"2024-09-11T07:05:51.150991+0000","last_fullsized":"2024-09-11T07:05:51.150991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.786713+0000","last_change":"2024-09-11T07:05:51.786713+0000","last_active":"2024-09-11T07:05:51.786713+0000","last_peered":"2024-09-11T07:05:51.786713+0000","last_clean":"2024-09-11T07:05:51.786713+0000","last_became_active":"2024-09-11T07:05:49.724679+0000","last_became_peered":"2024-09-11T07:05:49.724679+0000","last_unstale":"2024-09-11T07:05:51.786713+0000","last_undegraded":"2024-09-11T07:05:51.786713+0000","last_fullsized":"2024-09-11T07:05:51.786713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:36:43.830759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.151362+0000","last_change":"2024-09-11T07:05:51.151362+0000","last_active":"2024-09-11T07:05:51.151362+0000","last_peered":"2024-09-11T07:05:51.151362+0000","last_clean":"2024-09-11T07:05:51.151362+0000","last_became_active":"2024-09-11T07:05:49.725356+0000","last_became_peered":"2024-09-11T07:05:49.725356+0000","last_unstale":"2024-09-11T07:05:51.151362+0000","last_undegraded":"2024-09-11T07:05:51.151362+0000","last_fullsized":"2024-09-11T07:05:51.151362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:53.822013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.164067+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:05:51.164067+0000","last_peered":"2024-09-11T07:05:51.164067+0000","last_clean":"2024-09-11T07:05:51.164067+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:05:51.164067+0000","last_undegraded":"2024-09-11T07:05:51.164067+0000","last_fullsized":"2024-09-11T07:05:51.164067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.153018+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:05:51.153018+0000","last_peered":"2024-09-11T07:05:51.153018+0000","last_clean":"2024-09-11T07:05:51.153018+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:05:51.153018+0000","last_undegraded":"2024-09-11T07:05:51.153018+0000","last_fullsized":"2024-09-11T07:05:51.153018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.786715+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:05:51.786715+0000","last_peered":"2024-09-11T07:05:51.786715+0000","last_clean":"2024-09-11T07:05:51.786715+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:05:51.786715+0000","last_undegraded":"2024-09-11T07:05:51.786715+0000","last_fullsized":"2024-09-11T07:05:51.786715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.161621+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:05:51.161621+0000","last_peered":"2024-09-11T07:05:51.161621+0000","last_clean":"2024-09-11T07:05:51.161621+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:05:51.161621+0000","last_undegraded":"2024-09-11T07:05:51.161621+0000","last_fullsized":"2024-09-11T07:05:51.161621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.785564+0000","last_change":"2024-09-11T07:05:43.785344+0000","last_active":"2024-09-11T07:05:51.785564+0000","last_peered":"2024-09-11T07:05:51.785564+0000","last_clean":"2024-09-11T07:05:51.785564+0000","last_became_active":"2024-09-11T07:05:43.783090+0000","last_became_peered":"2024-09-11T07:05:43.783090+0000","last_unstale":"2024-09-11T07:05:51.785564+0000","last_undegraded":"2024-09-11T07:05:51.785564+0000","last_fullsized":"2024-09-11T07:05:51.785564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:32.027951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":262144,"data_stored":659264,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":262144,"data_stored":659264,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:05:56.159 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:05:56.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:05:56.441 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:05:56.457 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-09-11T07:05:55.820041+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":161,"num_write_kb":2418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":120,"ondisk_log_size":120,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":234628,"kb_used_data":1708,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754740092,"statfs":{"total":773094113280,"available":772853854208,"internally_reserved":0,"allocated":1748992,"data_stored":1726110,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":12760,"internal_metadata":238276136},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.678386"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.290755+0000","last_change":"2024-09-11T07:05:51.290755+0000","last_active":"2024-09-11T07:05:51.290755+0000","last_peered":"2024-09-11T07:05:51.290755+0000","last_clean":"2024-09-11T07:05:51.290755+0000","last_became_active":"2024-09-11T07:05:49.149584+0000","last_became_peered":"2024-09-11T07:05:49.149584+0000","last_unstale":"2024-09-11T07:05:51.290755+0000","last_undegraded":"2024-09-11T07:05:51.290755+0000","last_fullsized":"2024-09-11T07:05:51.290755+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:52.879340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074652400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.150991+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:05:51.150991+0000","last_peered":"2024-09-11T07:05:51.150991+0000","last_clean":"2024-09-11T07:05:51.150991+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:05:51.150991+0000","last_undegraded":"2024-09-11T07:05:51.150991+0000","last_fullsized":"2024-09-11T07:05:51.150991+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.786713+0000","last_change":"2024-09-11T07:05:51.786713+0000","last_active":"2024-09-11T07:05:51.786713+0000","last_peered":"2024-09-11T07:05:51.786713+0000","last_clean":"2024-09-11T07:05:51.786713+0000","last_became_active":"2024-09-11T07:05:49.724679+0000","last_became_peered":"2024-09-11T07:05:49.724679+0000","last_unstale":"2024-09-11T07:05:51.786713+0000","last_undegraded":"2024-09-11T07:05:51.786713+0000","last_fullsized":"2024-09-11T07:05:51.786713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:36:43.830759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.151362+0000","last_change":"2024-09-11T07:05:51.151362+0000","last_active":"2024-09-11T07:05:51.151362+0000","last_peered":"2024-09-11T07:05:51.151362+0000","last_clean":"2024-09-11T07:05:51.151362+0000","last_became_active":"2024-09-11T07:05:49.725356+0000","last_became_peered":"2024-09-11T07:05:49.725356+0000","last_unstale":"2024-09-11T07:05:51.151362+0000","last_undegraded":"2024-09-11T07:05:51.151362+0000","last_fullsized":"2024-09-11T07:05:51.151362+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:53.822013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.164067+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:05:51.164067+0000","last_peered":"2024-09-11T07:05:51.164067+0000","last_clean":"2024-09-11T07:05:51.164067+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:05:51.164067+0000","last_undegraded":"2024-09-11T07:05:51.164067+0000","last_fullsized":"2024-09-11T07:05:51.164067+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.153018+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:05:51.153018+0000","last_peered":"2024-09-11T07:05:51.153018+0000","last_clean":"2024-09-11T07:05:51.153018+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:05:51.153018+0000","last_undegraded":"2024-09-11T07:05:51.153018+0000","last_fullsized":"2024-09-11T07:05:51.153018+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.786715+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:05:51.786715+0000","last_peered":"2024-09-11T07:05:51.786715+0000","last_clean":"2024-09-11T07:05:51.786715+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:05:51.786715+0000","last_undegraded":"2024-09-11T07:05:51.786715+0000","last_fullsized":"2024-09-11T07:05:51.786715+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.161621+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:05:51.161621+0000","last_peered":"2024-09-11T07:05:51.161621+0000","last_clean":"2024-09-11T07:05:51.161621+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:05:51.161621+0000","last_undegraded":"2024-09-11T07:05:51.161621+0000","last_fullsized":"2024-09-11T07:05:51.161621+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'117","reported_seq":170,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-11T07:05:51.785564+0000","last_change":"2024-09-11T07:05:43.785344+0000","last_active":"2024-09-11T07:05:51.785564+0000","last_peered":"2024-09-11T07:05:51.785564+0000","last_clean":"2024-09-11T07:05:51.785564+0000","last_became_active":"2024-09-11T07:05:43.783090+0000","last_became_peered":"2024-09-11T07:05:43.783090+0000","last_unstale":"2024-09-11T07:05:51.785564+0000","last_undegraded":"2024-09-11T07:05:51.785564+0000","last_fullsized":"2024-09-11T07:05:51.785564+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:32.027951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":262144,"data_stored":659264,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31396,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340444,"statfs":{"total":96636764160,"available":96604614656,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":204800,"data_stored":68896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":208896,"data_stored":68915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":262144,"data_stored":659264,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:05:56.458 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T07:05:56.458 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-09-11T07:05:56.729 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 20 2024-09-11T07:05:56.729 INFO:teuthology.orchestra.run.smithi079.stdout:fsid e1313abd-54a9-4e53-ab67-469f744048b1 2024-09-11T07:05:56.729 INFO:teuthology.orchestra.run.smithi079.stdout:created 2024-09-11T07:05:29.098467+0000 2024-09-11T07:05:56.729 INFO:teuthology.orchestra.run.smithi079.stdout:modified 2024-09-11T07:05:51.143864+0000 2024-09-11T07:05:56.729 INFO:teuthology.orchestra.run.smithi079.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-11T07:05:56.729 INFO:teuthology.orchestra.run.smithi079.stdout:crush_version 4 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:full_ratio 0.95 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:backfillfull_ratio 0.9 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:nearfull_ratio 0.85 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:require_min_compat_client luminous 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:min_compat_client jewel 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:require_osd_release squid 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:stretch_mode_enabled false 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 20 flags hashpspool,selfmanaged_snaps stripe_width 0 application rbd read_balance_score 1.99 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout: removed_snaps_queue [2~1] 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:max_osd 8 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6824/1708235775,v1:172.21.15.79:6825/1708235775] [v2:172.21.15.79:6826/1708235775,v1:172.21.15.79:6827/1708235775] exists,up 24d57cdb-2f3a-4a96-903d-11be7dc26a20 2024-09-11T07:05:56.730 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/2076268206,v1:172.21.15.79:6801/2076268206] [v2:172.21.15.79:6802/2076268206,v1:172.21.15.79:6803/2076268206] exists,up aa51dc1b-b783-4212-8736-1f666239613b 2024-09-11T07:05:56.731 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6816/1904492349,v1:172.21.15.79:6817/1904492349] [v2:172.21.15.79:6818/1904492349,v1:172.21.15.79:6819/1904492349] exists,up 141a913f-7353-44a9-9dbd-70219bcee638 2024-09-11T07:05:56.731 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6808/1327328912,v1:172.21.15.79:6809/1327328912] [v2:172.21.15.79:6810/1327328912,v1:172.21.15.79:6811/1327328912] exists,up 32550aeb-0c8d-4ca9-afd5-3e5258e7255b 2024-09-11T07:05:56.731 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6808/4087452871,v1:172.21.15.110:6809/4087452871] [v2:172.21.15.110:6810/4087452871,v1:172.21.15.110:6811/4087452871] exists,up 88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc 2024-09-11T07:05:56.731 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6824/2133006853,v1:172.21.15.110:6825/2133006853] [v2:172.21.15.110:6826/2133006853,v1:172.21.15.110:6827/2133006853] exists,up 42c83053-328e-4c9b-bdaf-09e1a4cc8b7d 2024-09-11T07:05:56.731 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6816/2083734892,v1:172.21.15.110:6817/2083734892] [v2:172.21.15.110:6818/2083734892,v1:172.21.15.110:6819/2083734892] exists,up 0ab29b1f-3012-4528-8f47-2cac908122c9 2024-09-11T07:05:56.731 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6800/2322042784,v1:172.21.15.110:6801/2322042784] [v2:172.21.15.110:6802/2322042784,v1:172.21.15.110:6803/2322042784] exists,up d9c7d12b-be93-41c9-a246-773faa65ecaf 2024-09-11T07:05:56.747 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6824/1708235775,v1:172.21.15.79:6825/1708235775] [v2:172.21.15.79:6826/1708235775,v1:172.21.15.79:6827/1708235775] exists,up 24d57cdb-2f3a-4a96-903d-11be7dc26a20', 'osd.1 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6800/2076268206,v1:172.21.15.79:6801/2076268206] [v2:172.21.15.79:6802/2076268206,v1:172.21.15.79:6803/2076268206] exists,up aa51dc1b-b783-4212-8736-1f666239613b', 'osd.2 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6816/1904492349,v1:172.21.15.79:6817/1904492349] [v2:172.21.15.79:6818/1904492349,v1:172.21.15.79:6819/1904492349] exists,up 141a913f-7353-44a9-9dbd-70219bcee638', 'osd.3 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.79:6808/1327328912,v1:172.21.15.79:6809/1327328912] [v2:172.21.15.79:6810/1327328912,v1:172.21.15.79:6811/1327328912] exists,up 32550aeb-0c8d-4ca9-afd5-3e5258e7255b', 'osd.4 up in weight 1 up_from 13 up_thru 0 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6808/4087452871,v1:172.21.15.110:6809/4087452871] [v2:172.21.15.110:6810/4087452871,v1:172.21.15.110:6811/4087452871] exists,up 88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc', 'osd.5 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6824/2133006853,v1:172.21.15.110:6825/2133006853] [v2:172.21.15.110:6826/2133006853,v1:172.21.15.110:6827/2133006853] exists,up 42c83053-328e-4c9b-bdaf-09e1a4cc8b7d', 'osd.6 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6816/2083734892,v1:172.21.15.110:6817/2083734892] [v2:172.21.15.110:6818/2083734892,v1:172.21.15.110:6819/2083734892] exists,up 0ab29b1f-3012-4528-8f47-2cac908122c9', 'osd.7 up in weight 1 up_from 13 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.110:6800/2322042784,v1:172.21.15.110:6801/2322042784] [v2:172.21.15.110:6802/2322042784,v1:172.21.15.110:6803/2322042784] exists,up d9c7d12b-be93-41c9-a246-773faa65ecaf'] 2024-09-11T07:05:56.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-09-11T07:05:56.851 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "name": "mon.a", 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster": "ceph", 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "admin_socket_mode": "", 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_client_required": "cephx, none", 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_cluster_required": "cephx", 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_debug": "true", 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-09-11T07:05:56.852 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_service_required": "cephx", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_service_ticket_ttl": "240.000000", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "auth_supported": "cephx", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_aio": "true", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_aio_max_queue_depth": "1024", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_aio_poll_ms": "250", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_aio_reap_max": "16", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_async_discard": "false", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_block_size": "4096", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_debug_aio": "false", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_debug_inflight_ios": "false", 2024-09-11T07:05:56.853 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_enable_discard": "false", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_flock_retry": "3", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_flock_retry_interval": "0.100000", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_inject_crash": "0", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_inject_crash_flush_delay": "2", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_ioring": "false", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_ioring_hipri": "false", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_ioring_sqthread_poll": "false", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_read_buffer_alignment": "4096", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_stalled_read_warn_lifetime": "86400", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_stalled_read_warn_threshold": "1", 2024-09-11T07:05:56.854 INFO:teuthology.orchestra.run.smithi079.stdout: "bdev_type": "", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_alloc_size": "1048576", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_allocator": "hybrid", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_buffered_io": "true", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_check_for_zeros": "false", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_check_volume_selector_often": "false", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_compact_log_sync": "false", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_log_compact_min_size": "16777216", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_log_replay_check_allocations": "true", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_max_log_runway": "4194304", 2024-09-11T07:05:56.855 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_max_prefetch": "1048576", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_min_flush_size": "524288", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_min_log_runway": "1048576", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_replay_recovery": "false", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_shared_alloc_size": "65536", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluefs_sync_write": "false", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_allocation_from_file": "true", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_allocator": "hybrid", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-09-11T07:05:56.856 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bdev_label_multi": "true", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bdev_label_multi_upgrade": "false", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bdev_label_require_all": "true", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_blobid_prealloc": "10240", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_create": "true", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_db_create": "false", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_db_path": "", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_db_size": "0", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_path": "", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_preallocate_file": "false", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_size": "107374182400", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_wal_create": "false", 2024-09-11T07:05:56.857 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_wal_path": "", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_block_wal_size": "100663296", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bluefs": "true", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bluefs_env_mirror": "false", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_autotune": "true", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-09-11T07:05:56.858 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_size": "0", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cache_type": "2q", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_clone_cow": "true", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_algorithm": "snappy", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_max_blob_size": "0", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_min_blob_size": "0", 2024-09-11T07:05:56.859 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_mode": "none", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_csum_type": "crc32c", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_enforce_settings": "default", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_freelist": "false", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_fsck_abort": "false", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_inject_read_err": "false", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_legacy_omap": "false", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-09-11T07:05:56.860 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_small_allocations": "0", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_default_buffered_read": "true", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_default_buffered_write": "false", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_deferred_batch_ops": "0", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_elastic_shared_blobs": "true", 2024-09-11T07:05:56.861 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fail_eio": "false", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_mkfs": "true", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_mount": "false", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-09-11T07:05:56.862 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_umount": "false", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_ignore_data_csum": "false", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_kvbackend": "rocksdb", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-09-11T07:05:56.863 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_log_op_age": "5.000000", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_alloc_size": "0", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_blob_size": "0", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_defer_interval": "3.000000", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_max_deferred_txc": "32", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_min_alloc_size": "0", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_nid_prealloc": "1024", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_prefer_deferred_size": "0", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-09-11T07:05:56.864 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_qfsck_on_mount": "true", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_retry_disk_reads": "3", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_rocksdb_cf": "true", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_rocksdb_options_annex": "", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_slow_ops_warn_lifetime": "86400", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_slow_ops_warn_threshold": "1", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_spdk_coremask": "0x1", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_spdk_io_sleep": "5", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_spdk_max_io_completion": "0", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_spdk_mem": "512", 2024-09-11T07:05:56.865 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_sync_submit_transaction": "false", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_bytes": "67108864", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_cost_per_io": "0", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_tracing": "false", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_volume_selection_reserved": "0", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-09-11T07:05:56.866 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "bluestore_zero_block_detection": "false", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_action_update_interval": "2", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_mount_timeout": "10", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-09-11T07:05:56.867 INFO:teuthology.orchestra.run.smithi079.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_cluster_require_signatures": "false", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_cluster_require_version": "2", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_require_signatures": "false", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_require_version": "2", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_service_require_signatures": "false", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_service_require_version": "2", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "cephx_sign_messages": "true", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "chdir": "", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client_acl_type": "", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client_asio_thread_count": "2", 2024-09-11T07:05:56.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client_cache_mid": "0.750000", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_cache_size": "16384", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_caps_release_delay": "5", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_check_pool_perm": "true", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_collect_and_send_global_metrics": "false", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_debug_force_sync_read": "false", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_debug_getattr_caps": "false", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_debug_inject_features": "", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_debug_inject_tick_delay": "0", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_die_on_failed_remount": "false", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_dirsize_rbytes": "true", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_force_lazyio": "false", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_fs": "", 2024-09-11T07:05:56.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_inject_fixed_oldest_tid": "false", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_inject_release_failure": "false", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_max_inline_size": "4096", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_max_retries_on_remount_failure": "5", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_mds_namespace": "", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_metadata": "", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_mount_gid": "-1", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_mount_timeout": "300", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_mount_uid": "-1", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_mountpoint": "/", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_notify_timeout": "10", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc": "true", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc_max_dirty": "104857600", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc_max_dirty_age": "5.000000", 2024-09-11T07:05:56.870 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc_max_objects": "1000", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc_size": "209715200", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_oc_target_dirty": "8388608", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_permissions": "true", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_quota": "true", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_quota_df": "true", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_readahead_max_bytes": "0", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_readahead_max_periods": "4", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_readahead_min": "131072", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_reconnect_stale": "false", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_shutdown_timeout": "30", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_snapdir": ".snap", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_tick_interval": "1", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_trace": "", 2024-09-11T07:05:56.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_try_dentry_invalidate": "false", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_use_faked_inos": "false", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_use_random_mds": "false", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_graylog": "false", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_graylog_port": "12201", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_monitors": "default=true", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_syslog": "false", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "clog_to_syslog_level": "info", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "-", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_network": "", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_network_interface": "", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "compressor_zlib_isal": "false", 2024-09-11T07:05:56.872 INFO:teuthology.orchestra.run.smithi079.stdout: "compressor_zlib_level": "5", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "compressor_zlib_winsize": "-15", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "compressor_zstd_level": "1", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_alien_op_num_threads": "6", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_alien_thread_cpu_cores": "", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_osd_obc_lru_size": "512", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_osd_stat_interval": "0", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_seastar_cpu_cores": "", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crimson_seastar_num_threads": "0", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_location": "", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_location_hook": "", 2024-09-11T07:05:56.873 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_location_hook_timeout": "10", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "daemonize": "false", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "daos_pool": "tank", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "dbstore_db_name_prefix": "dbstore", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_alienstore": "0/5", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_allow_any_pool_priority": "false", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_asok": "1/5", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_asok_assert_abort": "false", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_asserts_on_shutdown": "true", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_auth": "20/20", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_bdev": "1/3", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_bluefs": "1/5", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_bluestore": "1/5", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_buffer": "0/1", 2024-09-11T07:05:56.874 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_ceph_exporter": "1/5", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_cephfs_mirror": "0/5", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_cephsqlite": "0/5", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_client": "0/5", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_compressor": "1/5", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_context": "0/1", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_crimson_interrupt": "0/5", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_crush": "1/1", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_crypto": "1/5", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_cyanstore": "0/5", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_deliberately_leak_memory": "false", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_disable_randomized_ping": "false", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_dpdk": "1/5", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_eventtrace": "1/5", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_filer": "0/1", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_filestore": "1/3", 2024-09-11T07:05:56.875 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_finisher": "1/1", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_fuse": "1/5", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_heartbeat_testing_span": "0", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_heartbeatmap": "1/5", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_immutable_obj_cache": "0/5", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_javaclient": "1/5", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_journal": "1/3", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_journaler": "0/5", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_kstore": "1/5", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_lockdep": "0/1", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mclock": "1/5", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds": "1/5", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_balancer": "1/5", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_locker": "1/5", 2024-09-11T07:05:56.876 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_log": "1/5", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_log_expire": "1/5", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_migrator": "1/5", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mds_quiesce": "3/5", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_memstore": "1/5", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mgr": "2/5", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mgrc": "1/5", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_mon": "20/20", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_monc": "0/10", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_ms": "1/1", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_none": "0/5", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_objclass": "0/5", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_objectcacher": "0/5", 2024-09-11T07:05:56.877 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_objecter": "0/1", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_optracker": "0/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_osd": "1/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_paxos": "20/20", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_perfcounter": "1/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_prioritycache": "1/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rados": "0/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rbd": "0/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rbd_mirror": "0/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rbd_pwl": "0/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rbd_replay": "0/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_refs": "0/0", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_reserver": "1/1", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw": "1/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_access": "1/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_datacache": "1/5", 2024-09-11T07:05:56.878 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_dbstore": "1/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_flight": "1/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_lifecycle": "1/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rgw_sync": "1/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_rocksdb": "4/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore": "0/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_backref": "0/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_cache": "0/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_cleaner": "0/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_device": "0/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_epm": "0/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_journal": "0/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_lba": "0/5", 2024-09-11T07:05:56.879 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_odata": "0/5", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_omap": "0/5", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_onode": "0/5", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_t": "0/5", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_seastore_tm": "0/5", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_striper": "0/1", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_test": "0/5", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_throttle": "1/1", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_timer": "0/1", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_tp": "0/5", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "debug_trace": "1/5", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "device_failure_prediction_mode": "none", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-09-11T07:05:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "err_to_graylog": "false", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "err_to_journald": "false", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "err_to_stderr": "true", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "err_to_syslog": "false", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event_tracing": "false", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_addr": "0.0.0.0", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_http_port": "9926", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_prio_limit": "5", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_sort_metrics": "true", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "exporter_stats_period": "5", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "fake_statfs_for_testing": "0", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "fatal_signal_handlers": "true", 2024-09-11T07:05:56.881 INFO:teuthology.orchestra.run.smithi079.stdout: "filer_max_purge_ops": "10", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filer_max_truncate_ops": "128", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_apply_finisher_threads": "1", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_blackhole": "false", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_btrfs_clone_range": "true", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_btrfs_snap": "true", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_caller_concurrency": "10", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_collect_device_partition_information": "true", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_commit_timeout": "600.000000", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_debug_inject_read_err": "false", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_debug_omap_check": "false", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_debug_random_read_err": "0.000000", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_debug_verify_split": "false", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_dump_file": "", 2024-09-11T07:05:56.882 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fadvise": "true", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fail_eio": "true", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fd_cache_shards": "16", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fd_cache_size": "128", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fiemap": "false", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fiemap_threshold": "4096", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_index_retry_probability": "0.000000", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_inject_stall": "0", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_journal_parallel": "false", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_journal_trailing": "false", 2024-09-11T07:05:56.883 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_journal_writeahead": "false", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_kill_at": "0", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattr_size": "0", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattrs": "0", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattrs_other": "2", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_sync_interval": "5.000000", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_xattr_value_size": "0", 2024-09-11T07:05:56.884 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_merge_threshold": "-10", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_min_sync_interval": "0.010000", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_odsync_write": "false", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_omap_backend": "rocksdb", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_omap_backend_path": "", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_omap_header_cache_size": "1024", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_ondisk_finisher_threads": "1", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_op_thread_timeout": "60", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_op_threads": "2", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_punch_hole": "false", 2024-09-11T07:05:56.885 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_max_bytes": "104857600", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_queue_max_ops": "50", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_seek_data_hole": "false", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_sloppy_crc": "false", 2024-09-11T07:05:56.886 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_splice": "false", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_split_multiple": "2", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_split_rand_factor": "20", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_update_to": "1000", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_enable": "true", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-09-11T07:05:56.887 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_xfs_extsize": "false", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "filestore_zfs_snap": "false", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "fio_dir": "/tmp/fio", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "e1313abd-54a9-4e53-ab67-469f744048b1", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_allow_other": "true", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_atomic_o_trunc": "true", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_big_writes": "true", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_debug": "false", 2024-09-11T07:05:56.888 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_default_permissions": "false", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_disable_pagecache": "false", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_max_write": "0", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_multithreaded": "true", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_require_active_mds": "true", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_set_user_groups": "true", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_splice_move": "true", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_splice_read": "true", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_splice_write": "true", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_syncfs_on_mksnap": "true", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "fuse_use_invalidate_cb": "true", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "gss_target_name": "ceph", 2024-09-11T07:05:56.889 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_file": "", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_inject_failure": "0", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_interval": "5", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "host": "smithi079", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_max_size": "1073741824", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-09-11T07:05:56.890 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "immutable_object_cache_watermark": "0.900000", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "inject_early_sigterm": "false", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "jaeger_agent_port": "6799", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "jaeger_tracing_enable": "false", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_aio": "true", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_align_min_size": "65536", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_block_align": "true", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_block_size": "4096", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_dio": "true", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_discard": "false", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_force_aio": "false", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_ignore_corruption": "false", 2024-09-11T07:05:56.891 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_max_write_bytes": "10485760", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_max_write_entries": "100", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_replay_from": "0", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_throttle_high_multiple": "0.000000", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_throttle_max_multiple": "0.000000", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_write_header_frequency": "0", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journal_zero_on_create": "false", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journaler_prefetch_periods": "10", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journaler_prezero_periods": "5", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "journaler_write_head_interval": "15", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "key": "", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "keyfile": "", 2024-09-11T07:05:56.892 INFO:teuthology.orchestra.run.smithi079.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_backend": "rocksdb", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_default_stripe_size": "65536", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_fsck_on_mount": "false", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_fsck_on_mount_deep": "true", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_max_bytes": "67108864", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_max_ops": "512", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_nid_prealloc": "1024", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_onode_map_size": "1024", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_sync_submit_transaction": "false", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "kstore_sync_transaction": "false", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "librados_thread_count": "2", 2024-09-11T07:05:56.893 INFO:teuthology.orchestra.run.smithi079.stdout: "lockdep": "false", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "lockdep_force_backtrace": "false", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_coarse_timestamps": "true", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_flush_on_exit": "false", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_graylog_host": "127.0.0.1", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_graylog_port": "12201", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_max_new": "1000", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_max_recent": "10000", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_stderr_prefix": "", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_stop_at_utilization": "0.970000", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_file": "true", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_graylog": "false", 2024-09-11T07:05:56.894 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_journald": "false", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_stderr": "false", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "log_to_syslog": "false", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "max_rotating_auth_attempts": "10", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_action_on_write_error": "1", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_alternate_name_max": "8192", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_asio_thread_count": "2", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_export_pin": "true", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_fragment_dirs": "true", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_fragment_interval": "5", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_fragment_size_max": "100000", 2024-09-11T07:05:56.895 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_idle_threshold": "0.000000", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_interval": "10", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_max": "-1", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_max_until": "-1", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_merge_size": "50", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_midchunk": "0.300000", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_min_rebalance": "0.100000", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_min_start": "0.200000", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_minchunk": "0.001000", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_mode": "0", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_need_max": "1.200000", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_need_min": "0.800000", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_overload_epochs": "2", 2024-09-11T07:05:56.896 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_sample_interval": "3.000000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_split_bits": "3", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_split_rd": "25000.000000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_split_size": "10000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_split_wr": "10000.000000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_target_decay": "10.000000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_beacon_grace": "15.000000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_beacon_interval": "4.000000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_beacon_mon_down_grace": "60", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_memory_limit": "4294967296", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_mid": "0.700000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-09-11T07:05:56.897 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_quiesce_delay": "0", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_quiesce_sleep": "200", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_quiesce_splitauth": "true", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_quiesce_threshold": "524288", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_release_free_interval": "10", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_reservation": "0.050000", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_trim_interval": "1", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cache_trim_threshold": "262144", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_client_delegate_inos_pct": "50", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_client_prealloc_inos": "1000", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-09-11T07:05:56.898 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_connect_bootstrapping": "false", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_damage_table_max_entries": "10000", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_debug_auth_pins": "false", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_debug_frag": "false", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_debug_scatterstat": "false", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_debug_subtrees": "false", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_decay_halflife": "5.000000", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_default_dir_hash": "2", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_defer_session_stale": "true", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_deny_all_reconnect": "false", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dir_keys_per_op": "16384", 2024-09-11T07:05:56.899 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dir_max_commit_size": "10", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dir_max_entries": "0", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dir_prefetch": "true", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dirstat_min_interval": "1.000000", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dump_cache_after_rejoin": "false", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dump_cache_on_map": "false", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dump_cache_threshold_file": "0", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_early_reply": "true", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_enable_op_tracker": "true", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_enforce_unique_name": "true", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_export_ephemeral_distributed": "true", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_export_ephemeral_random": "true", 2024-09-11T07:05:56.900 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_forward_all_requests_to_auth": "false", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_health_cache_threshold": "1.500000", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_health_summarize_threshold": "10", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_heartbeat_grace": "15.000000", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_heartbeat_reset_grace": "1000", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_health_dummy": "false", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-09-11T07:05:56.901 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_migrator_session_race": "false", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_join_fs": "", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_journal_format": "1", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_after_journal_logs_flushed": "false", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_create_at": "0", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_export_at": "0", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_import_at": "0", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_journal_at": "0", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_journal_expire_at": "0", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_journal_replay_at": "0", 2024-09-11T07:05:56.902 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_link_at": "0", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_mdstable_at": "0", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_openc_at": "0", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_rename_at": "0", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_kill_shutdown_at": "0", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_event_large_threshold": "524288", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_events_per_segment": "1024", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_major_segment_event_ratio": "12", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_max_events": "-1", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_max_segments": "128", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_pause": "false", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_segment_size": "0", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_skip_corrupt_events": "false", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_skip_unbounded_events": "false", 2024-09-11T07:05:56.903 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_trim_threshold": "128", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_log_warn_factor": "2.000000", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_caps_per_client": "1048576", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_completed_flushes": "100000", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_completed_requests": "100000", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_export_size": "20971520", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_file_recover": "32", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_purge_files": "64", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_purge_ops": "8192", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_max_snaps_per_dir": "100", 2024-09-11T07:05:56.904 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_metrics_update_interval": "2", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_min_caps_per_client": "100", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_min_caps_working_set": "10000", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_numa_node": "-1", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_complaint_time": "30.000000", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_history_duration": "600", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_history_size": "20", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_history_slow_op_size": "20", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_history_slow_op_threshold": "10", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_op_log_threshold": "5", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_ping_grace": "15", 2024-09-11T07:05:56.905 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_ping_interval": "5", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_max_caps": "30000", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_max_decay_threshold": "131072", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_recall_warning_threshold": "262144", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_reconnect_timeout": "45.000000", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_replay_interval": "1.000000", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_root_ino_gid": "0", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_root_ino_uid": "0", 2024-09-11T07:05:56.906 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_blocklist_on_evict": "true", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_blocklist_on_timeout": "true", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_session_metadata_threshold": "16777216", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_shutdown_check": "0", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_skip_ino": "0", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_sleep_rank_change": "0.000000", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_snap_max_uid": "4294967294", 2024-09-11T07:05:56.907 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_snap_min_uid": "0", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_snap_rstat": "false", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_standby_replay_damaged": "false", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_symlink_recovery": "true", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_task_status_update_interval": "2.000000", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_thrash_exports": "0", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_thrash_fragments": "0", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_tick_interval": "5.000000", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_valgrind_exit": "false", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_verify_backtrace": "1", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_verify_scatter": "false", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_wipe_ino_prealloc": "false", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mds_wipe_sessions": "false", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "mempool_debug": "false", 2024-09-11T07:05:56.908 INFO:teuthology.orchestra.run.smithi079.stdout: "memstore_debug_omit_block_device_write": "false", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "memstore_device_bytes": "1073741824", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "memstore_page_set": "false", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "memstore_page_size": "65536", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_client_bytes": "134217728", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_client_messages": "512", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_connect_retry_interval": "1.000000", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_disabled_modules": "", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_enable_op_tracker": "true", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-09-11T07:05:56.909 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_max_pg_num_change": "128", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_mds_bytes": "134217728", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_mds_messages": "128", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_mon_bytes": "134217728", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_mon_messages": "128", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_num_op_tracker_shard": "32", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_op_complaint_time": "30.000000", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_op_history_duration": "600", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_op_history_size": "20", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_op_history_slow_op_size": "20", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_op_history_slow_op_threshold": "10.000000", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_op_log_threshold": "5", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_osd_bytes": "536870912", 2024-09-11T07:05:56.910 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_osd_messages": "8192", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_pool": "true", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_service_beacon_grace": "60.000000", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_standby_modules": "true", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_stats_period": "5", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_stats_threshold": "5", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_tick_period": "2", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_accept_timeout_factor": "2.000000", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_allow_pool_delete": "true", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_allow_pool_size_one": "true", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_auth_validate_all_caps": "true", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-09-11T07:05:56.911 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_bytes": "104857600", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_directed_command_retry": "5", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_hunt_interval": "3.000000", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_hunt_parallel": "3", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_log_interval": "1.000000", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_ping_interval": "10.000000", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_ping_timeout": "30.000000", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_client_target_rank": "-1", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_clock_drift_allowed": "1.000000", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-09-11T07:05:56.912 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_file_level": "debug", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_file": "true", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_graylog": "false", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_journald": "false", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_stderr": "false", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_compact_on_bootstrap": "false", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_compact_on_start": "false", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_compact_on_trim": "true", 2024-09-11T07:05:56.913 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_con_tracker_persist_interval": "10", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_con_tracker_score_halflife": "43200", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_config_key_max_entry_size": "65536", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_cpu_threads": "4", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_crush_min_required_version": "hammer", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_daemon_bytes": "419430400", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_data_avail_crit": "5", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_data_avail_warn": "5", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_data_size_warn": "16106127360", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_block_osdmap_trim": "false", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_dump_json": "false", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-09-11T07:05:56.914 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_dump_transactions": "false", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_extra_checks": "false", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_no_require_reef": "false", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_no_require_squid": "false", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_delta_reset_interval": "10.000000", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_dns_srv_name": "ceph-mon", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_down_mkfs_grace": "120", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_down_uptime_grace": "60", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_election_default_strategy": "1", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_election_timeout": "5.000000", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-09-11T07:05:56.915 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_elector_ping_divisor": "2", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_elector_ping_timeout": "2.000000", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_enable_op_tracker": "true", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_fake_pool_delete": "false", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_force_quorum_join": "false", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_fsmap_prune_threshold": "300", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_globalid_prealloc": "10000", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_detail_to_clog": "false", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_log_update_period": "5", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_max_detail": "50", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_to_clog": "true", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_to_clog_interval": "600", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-09-11T07:05:56.916 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_host": "172.21.15.79,[v2:172.21.15.79:3301,v1:172.21.15.79:6790],172.21.15.110", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_host_override": "", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_initial_members": "", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_keyvaluedb": "rocksdb", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_lease": "5.000000", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_log_full_interval": "50", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_log_max": "10000", 2024-09-11T07:05:56.917 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_log_max_summary": "50", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_log_entries_per_event": "4096", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_log_epochs": "500", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_mdsmap_epochs": "500", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_mgrmap_epochs": "500", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_osd": "10000", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_pg_per_osd": "10000", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_pool_pg_num": "65536", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mds_force_trim_to": "0", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mds_skip_sanity": "false", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_memory_autotune": "true", 2024-09-11T07:05:56.918 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_memory_target": "2147483648", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_beacon_grace": "30", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_digest_period": "5", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_inactive_grace": "60", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_mkfs_grace": "240", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_min_osdmap_epochs": "500", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_complaint_time": "30", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_history_duration": "600", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_history_size": "20", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_history_slow_op_size": "20", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_history_slow_op_threshold": "10", 2024-09-11T07:05:56.919 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_op_log_threshold": "5", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_auto_mark_in": "false", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_auto_mark_new_in": "true", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_cache_size": "500", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_cache_size_min": "134217728", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_crush_smoke_test": "true", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_destroyed_out_interval": "600", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_down_out_interval": "600", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-09-11T07:05:56.920 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_force_trim_to": "0", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_full_ratio": "0.950000", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_laggy_halflife": "3600", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_laggy_max_interval": "300", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_laggy_weight": "0.300000", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_max_creating_pgs": "1024", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_max_initial_pgs": "1024", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_min_down_reporters": "2", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-09-11T07:05:56.921 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_prime_pg_temp": "true", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_report_timeout": "900", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_warn_num_repaired": "10", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osd_warn_op_age": "32.000000", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osdmap_full_prune_interval": "10", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osdmap_full_prune_min": "10000", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-09-11T07:05:56.922 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_stuck_threshold": "60", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_warn_min_objects": "10000", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_warn_min_per_osd": "0", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pool_quota_crit_threshold": "0", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_pool_quota_warn_threshold": "0", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_probe_timeout": "2.000000", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_reweight_max_change": "0.050000", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_reweight_max_osds": "4", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-09-11T07:05:56.923 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_scrub_interval": "86400", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_scrub_max_keys": "100", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_scrub_timeout": "300", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_session_timeout": "300", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_smart_report_timeout": "5", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_stat_smooth_intervals": "6", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_stretch_pool_min_size": "2", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_stretch_pool_size": "4", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_subscribe_interval": "86400.000000", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_debug": "false", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_max_payload_keys": "2000", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_max_payload_size": "1048576", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_provider_kill_at": "0", 2024-09-11T07:05:56.924 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_requester_kill_at": "0", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_sync_timeout": "60.000000", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_target_pg_per_osd": "100", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_tick_interval": "5", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_timecheck_interval": "300.000000", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_use_min_delay_socket": "false", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_older_version_delay": "604800", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_filestore_osds": "false", 2024-09-11T07:05:56.925 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_misplaced": "false", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_older_version": "true", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_pool_no_app": "false", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_on_too_few_osds": "false", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-09-11T07:05:56.926 INFO:teuthology.orchestra.run.smithi079.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "monmap": "", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "motr_tracing_enabled": "false", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_op_threads": "3", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_buffer_size": "131072", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_cm": "false", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_device_name": "", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_dscp": "96", 2024-09-11T07:05:56.927 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_gid_idx": "0", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_local_gid": "", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_polling_us": "1000", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_port_num": "1", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_roce_ver": "1", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_send_buffers": "1024", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_sl": "3", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_support_srq": "true", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_rdma_type": "ib", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_async_reap_threshold": "5", 2024-09-11T07:05:56.928 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_before_connect": "false", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_ipv4": "true", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_ipv6": "false", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_msgr1": "true", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_msgr2": "true", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_port_max": "7568", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_port_min": "6800", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_prefer_ipv4": "false", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_retry_count": "3", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_bind_retry_delay": "5", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_blackhole_client": "false", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_blackhole_mds": "false", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_blackhole_mgr": "false", 2024-09-11T07:05:56.929 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_blackhole_mon": "false", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_blackhole_osd": "false", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_client_mode": "crc secure", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_cluster_mode": "crc secure", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_cluster_type": "", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_compress_secure": "false", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_connection_idle_timeout": "900", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_connection_ready_timeout": "10", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_crc_data": "true", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_crc_header": "true", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_die_on_bad_msg": "false", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_die_on_bug": "true", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_die_on_old_message": "true", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_die_on_skipped_message": "false", 2024-09-11T07:05:56.930 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_die_on_unhandled_msg": "false", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_coremask": "0xF", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_devs_allowlist": "", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_enable_tso": "true", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_hugepages": "", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_hw_flow_control": "true", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_lro": "true", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_memory_channel": "4", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-09-11T07:05:56.931 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_pmd": "", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_port_id": "0", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dump_corrupt_message_level": "1", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_dump_on_send": "false", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_initial_backoff": "0.200000", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_delay_max": "1.000000", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_delay_probability": "0.000000", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_delay_type": "", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_internal_delays": "0.000000", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_network_congestion": "0", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_inject_socket_failures": "5000", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_learn_addr_from_peer": "true", 2024-09-11T07:05:56.932 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_max_accept_failures": "4", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_max_backoff": "15.000000", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_mon_client_mode": "secure crc", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_mon_cluster_mode": "secure crc", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_mon_service_mode": "secure crc", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_osd_compress_min_size": "1024", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_osd_compress_mode": "none", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_osd_compression_algorithm": "snappy", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_pq_min_cost": "65536", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_public_type": "", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_service_mode": "crc secure", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_tcp_listen_backlog": "512", 2024-09-11T07:05:56.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_tcp_nodelay": "true", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_tcp_rcvbuf": "0", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "ms_type": "async+posix", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "no_config_file": "false", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_completion_locks_per_session": "32", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_debug_inject_relock_delay": "false", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_inflight_op_bytes": "104857600", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_inflight_ops": "1024", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_inject_no_watch_ping": "false", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_tick_interval": "5.000000", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "objecter_timeout": "10.000000", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "objectstore_blackhole": "false", 2024-09-11T07:05:56.934 INFO:teuthology.orchestra.run.smithi079.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "openssl_engine_opts": "", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_delay_time": "5.000000", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_hist_halflife": "1000", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_max_low_ops": "2", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_max_ops": "4", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_quantize_effort": "0.100000", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_agent_slop": "0.020000", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_allow_recovery_below_min_size": "true", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_asio_thread_count": "2", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_async_recovery_min_cost": "100", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_auto_mark_unfound_lost": "false", 2024-09-11T07:05:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backfill_retry_interval": "30.000000", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backfill_scan_max": "512", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backfill_scan_min": "64", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backoff_on_degraded": "false", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backoff_on_peering": "false", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_backoff_on_unfound": "true", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_beacon_report_interval": "300", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bench_duration": "30", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bench_max_block_size": "67108864", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_bench_small_size_max_iops": "100", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_blkin_trace_all": "false", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_blocked_scrub_grace_period": "120", 2024-09-11T07:05:56.936 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_check_for_log_corruption": "false", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_class_update_on_start": "true", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_client_message_cap": "256", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_client_message_size_cap": "524288000", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_client_op_priority": "63", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_client_watch_timeout": "30", 2024-09-11T07:05:56.937 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_command_max_records": "256", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_compact_on_start": "false", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_crush_chooseleaf_type": "0", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_crush_initial_weight": "-1.000000", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_crush_update_on_start": "true", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_crush_update_weight_set": "true", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_drop_ping_duration": "0", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_feed_pullee": "-1", 2024-09-11T07:05:56.938 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_misdirected_ops": "false", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_no_acting_change": "false", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_no_purge_strays": "false", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_op_order": "false", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_pg_log_writeout": "false", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_pretend_recovery_active": "false", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_shutdown": "false", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-09-11T07:05:56.939 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_trim_objects": "false", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_verify_cached_snaps": "false", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_verify_missing_on_start": "false", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_verify_snaps": "false", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_keys": "1024", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_stride": "524288", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_default_data_pool_replay_window": "5", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_default_notify_timeout": "30", 2024-09-11T07:05:56.940 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_delete_sleep": "0.000000", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_discard_disconnected_ops": "true", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_enable_op_tracker": "true", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_extblkdev_plugins": "vdo", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_fast_info": "true", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_fast_shutdown": "true", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-09-11T07:05:56.941 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_fast_shutdown_timeout": "15", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_function_tracing": "false", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_grace": "20", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_interval": "6", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_min_peers": "10", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_min_size": "2000", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_stale": "600", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_hit_set_max_size": "100000", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_hit_set_min_size": "1000", 2024-09-11T07:05:56.942 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_journal_flush_on_shutdown": "true", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_journal_size": "5120", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_kill_backfill_at": "0", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_loop_before_reset_tphandle": "64", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_map_cache_size": "50", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_map_dedup": "true", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_map_message_max": "40", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_map_message_max_bytes": "10485760", 2024-09-11T07:05:56.943 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_map_share_max_epochs": "40", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_attr_name_len": "100", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_attr_size": "0", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_backfills": "1", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_markdown_count": "5", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_markdown_period": "600", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_object_name_len": "2048", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_object_namespace_len": "256", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_object_size": "134217728", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_omap_entries_per_request": "1024", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_pg_blocked_by": "16", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_pg_log_entries": "10000", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-09-11T07:05:56.944 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_pgls": "1024", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_push_cost": "8388608", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_push_objects": "10", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_scrubs": "3", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_trimming_pgs": "2", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_write_op_reply_len": "64", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_max_write_size": "90", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-09-11T07:05:56.945 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_override_recovery_settings": "false", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_profile": "balanced", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mclock_skip_benchmark": "false", 2024-09-11T07:05:56.946 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_base": "805306368", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_cache_min": "134217728", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_target": "4294967296", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_target_autotune": "false", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_min_pg_log_entries": "250", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_min_recovery_priority": "0", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mon_heartbeat_interval": "30", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mon_report_interval": "5", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mon_report_max_in_flight": "2", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-09-11T07:05:56.947 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_num_cache_shards": "32", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_num_op_tracker_shard": "32", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_numa_auto_affinity": "true", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_numa_node": "-1", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_numa_prefer_iface": "true", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_objecter_finishers": "1", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_objectstore": "bluestore", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_objectstore_fuse": "false", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_objectstore_tracing": "false", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_complaint_time": "30.000000", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_history_duration": "600", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_history_size": "20", 2024-09-11T07:05:56.948 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_history_slow_op_size": "20", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_log_threshold": "5", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_shards": "0", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_shards_hdd": "5", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_shards_ssd": "8", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_threads_per_shard": "0", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_pq_min_cost": "65536", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_queue": "mclock_scheduler", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_queue_cut_off": "high", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_thread_suicide_timeout": "150", 2024-09-11T07:05:56.949 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_op_thread_timeout": "15", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_open_classes_on_start": "true", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_os_flags": "0", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_peering_op_priority": "255", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_delete_cost": "1048576", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_delete_priority": "5", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_log_dups_tracked": "3000", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_log_trim_max": "10000", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_log_trim_min": "100", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_object_context_cache_count": "64", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-09-11T07:05:56.950 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_crimson": "false", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_crush_rule": "-1", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_ec_fast_read": "false", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flag_bulk": "false", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flag_nodelete": "false", 2024-09-11T07:05:56.951 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_flags": "0", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_min_size": "0", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_pg_num": "32", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_pgp_num": "0", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_read_ratio": "70", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_size": "2", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_default_type": "replicated", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-09-11T07:05:56.952 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_pool_use_gmt_hitset": "true", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_push_per_object_cost": "1000", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_read_ec_check_for_errors": "false", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recover_clone_overlap": "true", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recover_clone_overlap_limit": "10", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_cost": "20971520", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_delay_start": "0.000000", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_active": "0", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_active_hdd": "3", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_active_ssd": "10", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_chunk": "8388608", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_max_single_start": "1", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_op_priority": "3", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_op_warn_multiple": "16", 2024-09-11T07:05:56.953 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_priority": "5", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_retry_interval": "30.000000", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_sleep": "0.000000", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_repair_during_recovery": "false", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_requested_scrub_priority": "120", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_rollback_to_cluster_snap": "", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_auto_repair": "false", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-09-11T07:05:56.954 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_begin_hour": "0", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_begin_week_day": "0", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_chunk_max": "25", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_chunk_min": "5", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_cost": "52428800", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_during_recovery": "false", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_end_hour": "0", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_end_week_day": "0", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_event_cost": "4096", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_invalid_stats": "true", 2024-09-11T07:05:56.955 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_load_threshold": "0.500000", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_max_interval": "604800.000000", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_max_preemptions": "5", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_min_interval": "86400.000000", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_priority": "5", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_scrub_sleep": "0.000000", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_shutdown_pgref_assert": "false", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_skip_data_digest": "false", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_smart_report_timeout": "5", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_cost": "1048576", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_priority": "5", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_sleep": "0.000000", 2024-09-11T07:05:56.956 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_stats_update_period_scrubbing": "15", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_target_transaction_size": "30", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-09-11T07:05:56.957 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_default_cache_mode": "writeback", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_tracing": "false", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_use_stale_snap": "false", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "osdc_blkin_trace_all": "false", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_kill_at": "0", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_max_join_drift": "10", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_min": "500", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_min_wait": "0.050000", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_propose_interval": "1.000000", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_service_trim_max": "500", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_service_trim_max_multiplier": "20", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_service_trim_min": "250", 2024-09-11T07:05:56.958 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_stash_full_interval": "25", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_trim_max": "500", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "paxos_trim_min": "250", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "perf": "true", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin_dir": "/usr/lib/ceph", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "-", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrv": "", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "public_bind_addr": "-", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "public_network": "", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "public_network_interface": "", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "qat_compressor_busy_polling": "false", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "qat_compressor_enabled": "false", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "qat_compressor_session_max_number": "256", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "rados_mon_op_timeout": "0", 2024-09-11T07:05:56.959 INFO:teuthology.orchestra.run.smithi079.stdout: "rados_osd_op_timeout": "0", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rados_tracing": "false", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_atime_update_interval": "60", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_balance_parent_reads": "false", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_balance_snap_reads": "false", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_blkin_trace_all": "false", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_blocklist_expire_seconds": "0", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_blocklist_on_break_lock": "true", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache": "true", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_block_writes_upfront": "false", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_max_dirty": "25165824", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-09-11T07:05:56.960 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_max_dirty_object": "0", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_policy": "writearound", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_size": "33554432", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_target_dirty": "16777216", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_clone_copy_on_read": "false", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_compression_hint": "none", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_concurrent_management_ops": "10", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_clone_format": "auto", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_data_pool": "", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_features": "61", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_format": "2", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_map_options": "", 2024-09-11T07:05:56.961 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_order": "22", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_pool": "rbd", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_stripe_count": "0", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_default_stripe_unit": "0", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_disable_zero_copy_writes": "true", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_discard_granularity_bytes": "65536", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_enable_alloc_hint": "true", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_io_scheduler": "simple", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_commit_age": "5.000000", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-09-11T07:05:56.962 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_object_flush_interval": "0", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_order": "24", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_pool": "", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_journal_splay_width": "4", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_localize_parent_reads": "false", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_localize_snap_reads": "false", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-09-11T07:05:56.963 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_policy_type": "simple", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_autotune": "true", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_base": "805306368", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-09-11T07:05:56.964 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_memory_target": "4294967296", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirroring_delete_delay": "0", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirroring_replay_delay": "0", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-09-11T07:05:56.965 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_move_to_trash_on_remove": "false", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_mtime_update_interval": "60", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_non_blocking_aio": "true", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_op_thread_timeout": "60", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_op_threads": "1", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_parent_cache_enabled": "false", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_persistent_cache_mode": "disabled", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_persistent_cache_path": "/tmp", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_persistent_cache_size": "1073741824", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_plugins": "", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_bps_burst": "0", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_bps_limit": "0", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_exclude_ops": "0", 2024-09-11T07:05:56.966 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_iops_burst": "0", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_iops_limit": "0", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_bps_burst": "0", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_bps_limit": "0", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_iops_burst": "0", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_read_iops_limit": "0", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_schedule_tick_min": "50", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_bps_burst": "0", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_bps_limit": "0", 2024-09-11T07:05:56.967 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_iops_burst": "0", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_qos_write_iops_limit": "0", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_quiesce_notification_attempts": "10", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_read_from_replica_policy": "default", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_readahead_max_bytes": "524288", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_readahead_trigger_requests": "10", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_request_timed_out_seconds": "30", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_skip_partial_discard": "true", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_tracing": "false", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_validate_names": "true", 2024-09-11T07:05:56.968 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd_validate_pool": "true", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "restapi_base_url": "", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "restapi_log_level": "", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_account_default_quota_max_size": "-1", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_acl_grants_max_num": "100", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_admin_entry": "admin", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_backend_store": "rados", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_barbican_url": "", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_beast_enable_async": "true", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_counters_cache": "false", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-09-11T07:05:56.969 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_index_max_aio": "128", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_quota_ttl": "600", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_cache_enabled": "true", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_cache_expiry_interval": "900", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_cache_lru_size": "25000", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_config_store": "rados", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_content_length_compat": "false", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_copy_obj_progress": "true", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_cors_rules_max_num": "100", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_cross_domain_policy": "", 2024-09-11T07:05:56.970 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_default_encryption_key": "", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_addr": "", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_ca_path": "", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_client_cert": "", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_client_key": "", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_password": "", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_kmip_username": "", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_require_ssl": "true", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-09-11T07:05:56.971 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_suppress_logs": "true", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_addr": "", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_auth": "token", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_namespace": "", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_prefix": "", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-09-11T07:05:56.972 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_token_file": "", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_curl_buffersize": "524288", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_curl_low_speed_limit": "1024", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_curl_low_speed_time": "300", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_curl_tcp_keepalive": "0", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-09-11T07:05:56.973 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_fadvise": "4", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d4n_host": "127.0.0.1", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_d4n_port": "6379", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_log_changes_size": "1000", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_log_num_shards": "128", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_log_window": "30", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_notify_interval_msec": "0", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_sync_poll_interval": "20", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_data_sync_spawn_window": "20", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-09-11T07:05:56.974 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_default_data_log_backing": "fifo", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_default_region_info_oid": "default.region", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_defer_to_bucket_acls": "", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_data_res": "500.000000", 2024-09-11T07:05:56.975 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dns_name": "", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dns_s3website_name": "", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_dynamic_resharding": "true", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_gc_threads": "true", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_lc_threads": "true", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_ops_log": "false", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_quota_threads": "true", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_static_website": "false", 2024-09-11T07:05:56.976 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enable_usage_log": "false", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_enforce_swift_acls": "true", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_exit_timeout_secs": "120", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_expose_bucket": "false", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_extended_http_attrs": "", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_filter": "none", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_frontends": "beast port=7480", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_concurrent_io": "10", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_deferred": "50", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_objs": "32", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_queue_size": "134213632", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_max_trim_chunk": "16", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_obj_min_wait": "7200", 2024-09-11T07:05:56.977 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_processor_max_time": "3600", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_gc_processor_period": "3600", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_get_obj_window_size": "16777216", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_healthcheck_disabling_path": "", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ignore_get_invalid_range": "false", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_init_timeout": "300", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_kafka_connection_idle": "300", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_kafka_message_timeout": "5000", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_kafka_sleep_timeout": "10", 2024-09-11T07:05:56.978 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_domain": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_password": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_password_path": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_project": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_tenant": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_token": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_token_path": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_admin_user": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_api_version": "2", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_barbican_domain": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_barbican_password": "", 2024-09-11T07:05:56.979 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_barbican_project": "", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_barbican_tenant": "", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_barbican_user": "", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_implicit_tenants": "false", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_service_token_enabled": "false", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_token_cache_size": "10000", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_url": "", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_keystone_verify_ssl": "true", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_debug_interval": "-1", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_lock_max_time": "90", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_max_objs": "32", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_max_rules": "1000", 2024-09-11T07:05:56.980 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_max_worker": "3", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_max_wp_worker": "3", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lc_thread_delay": "0", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_dnattr": "uid", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_searchfilter": "", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ldap_uri": "", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_log_http_headers": "", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_log_nonexistent_bucket": "false", 2024-09-11T07:05:56.981 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_log_object_name_utc": "false", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_attr_name_len": "0", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_attr_size": "0", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_attrs_num_in_req": "0", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_chunk_size": "4194304", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_concurrent_requests": "1024", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_dynamic_shards": "1999", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_listing_results": "1000", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_notify_retries": "10", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_objs_per_shard": "100000", 2024-09-11T07:05:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_put_param_size": "1048576", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_put_size": "5368709120", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_max_slo_entries": "1000", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_md_log_max_shards": "64", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_md_notify_interval_msec": "200", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_meta_sync_poll_interval": "20", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_meta_sync_spawn_window": "20", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_mp_lock_max_time": "600", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_multipart_min_part_size": "5242880", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_fhcache_size": "2017", 2024-09-11T07:05:56.983 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_lru_lanes": "5", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_max_gc": "300", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_run_gc_threads": "false", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_run_lc_threads": "false", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_run_quota_threads": "false", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_run_sync_thread": "false", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_num_async_rados_threads": "32", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_num_control_oids": "8", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_numa_node": "-1", 2024-09-11T07:05:56.984 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_obj_stripe_size": "4194304", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_objexp_chunk_size": "100", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_objexp_gc_interval": "600", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_objexp_hints_num_shards": "127", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_op_thread_timeout": "600", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_op_tracing": "false", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_opa_token": "", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_opa_url": "", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_opa_verify_ssl": "true", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ops_log_rados": "false", 2024-09-11T07:05:56.985 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_ops_log_socket_path": "", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_period_push_interval": "2.000000", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_period_push_interval_max": "30.000000", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_period_root_pool": ".rgw.root", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_posix_cache_lanes": "3", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_posix_cache_max_buckets": "100", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_posix_cache_partitions": "3", 2024-09-11T07:05:56.986 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_print_continue": "true", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_print_prohibited_content_length": "false", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_rados_tracing": "false", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_realm": "", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_realm_id": "", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_region": "", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_region_root_pool": ".rgw.root", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_relaxed_region_enforcement": "false", 2024-09-11T07:05:56.987 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_request_uri": "", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_reshard_batch_size": "64", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_reshard_max_aio": "128", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_reshard_num_logs": "16", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_reshard_thread_interval": "600", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_resolve_cname": "false", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_rest_getusage_op_compat": "false", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_run_sync_thread": "true", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-09-11T07:05:56.988 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_use_keystone": "false", 2024-09-11T07:05:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_use_ldap": "false", 2024-09-11T07:05:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_use_rados": "true", 2024-09-11T07:05:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_auth_use_sts": "false", 2024-09-11T07:05:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-09-11T07:05:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_s3_success_create_obj_status": "0", 2024-09-11T07:05:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-09-11T07:05:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_scheduler_type": "throttler", 2024-09-11T07:05:56.989 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_script_uri": "", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_service_provider_name": "", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_client_id": "", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_client_secret": "", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_entry": "sts", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_key": "sts", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_max_session_duration": "43200", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_min_session_duration": "900", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sts_token_introspection_url": "", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_account_in_url": "false", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_auth_entry": "auth", 2024-09-11T07:05:56.990 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_auth_url": "", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_custom_header": "", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_enforce_content_length": "false", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_need_stats": "true", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_tenant_name": "", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_token_expiration": "86400", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_url": "", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_url_prefix": "swift", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_swift_versioning_enabled": "false", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_lease_period": "120", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_log_trim_interval": "1200", 2024-09-11T07:05:56.991 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_obj_etag_verify": "false", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_trace_history_size": "4096", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_thread_pool_size": "512", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_topic_persistency_max_retries": "0", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_topic_require_publish_policy": "false", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_comment": "", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_createby": "", 2024-09-11T07:05:56.992 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_encoding": "", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_flag": "false", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_max_size": "5368709120", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_origin": "", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_sha_unit": "524288", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_torrent_tracker": "", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_trust_forwarded_https": "false", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_usage_log_tick_interval": "30", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_usage_max_shards": "32", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_usage_max_user_shards": "1", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_use_opa_authz": "false", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_counters_cache": "false", 2024-09-11T07:05:56.993 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_counters_cache_size": "10000", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_default_quota_max_size": "-1", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_max_buckets": "1000", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_policies_max_num": "100", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_quota_sync_interval": "86400", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_user_unique_email": "true", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_verify_ssl": "true", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_website_routing_rules_max_num": "50", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zone": "", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zone_id": "", 2024-09-11T07:05:56.994 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zonegroup": "", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zonegroup_id": "", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rgwlc_auto_session_clear": "true", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rgwlc_skip_bucket_step": "false", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_block_size": "4096", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_shard_bits": "4", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_size": "536870912", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cache_type": "binned_lru", 2024-09-11T07:05:56.995 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_collect_compaction_stats": "false", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_collect_extended_stats": "false", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_collect_memory_stats": "false", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_index_type": "binary_search", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_log_to_ceph_log": "true", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_metadata_block_size": "4096", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_partition_filters": "false", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_perf": "false", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-09-11T07:05:56.996 INFO:teuthology.orchestra.run.smithi079.stdout: "rotating_keys_renewal_timeout": "10", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "run_dir": "/var/run/ceph", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_block_create": "true", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_cache_lru_size": "67108864", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_cbjournal_size": "5368709120", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_data_delta_based_overwrite": "0", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_default_max_object_size": "16777216", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_device_size": "53687091200", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_disable_end_to_end_data_protection": "true", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_full_integrity_check": "false", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_journal_batch_capacity": "16", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-09-11T07:05:56.997 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_journal_iodepth_limit": "5", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_main_device_type": "SSD", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_max_concurrent_transactions": "8", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_max_data_allocation_size": "32768", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "seastore_segment_size": "67108864", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "set_keepcaps": "false", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "setgroup": "", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "setuser": "", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "setuser_match_path": "", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_misplaced_ratio": "0.050000", 2024-09-11T07:05:56.998 INFO:teuthology.orchestra.run.smithi079.stdout: "thp": "false", 2024-09-11T07:05:56.999 INFO:teuthology.orchestra.run.smithi079.stdout: "threadpool_default_timeout": "60", 2024-09-11T07:05:56.999 INFO:teuthology.orchestra.run.smithi079.stdout: "threadpool_empty_queue_max_wait": "2", 2024-09-11T07:05:56.999 INFO:teuthology.orchestra.run.smithi079.stdout: "throttler_perf_counter": "true" 2024-09-11T07:05:56.999 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:05:57.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-09-11T07:05:57.140 INFO:teuthology.orchestra.run.smithi079.stdout:mon.a: {} 2024-09-11T07:05:57.140 INFO:teuthology.orchestra.run.smithi079.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T07:05:57.153 INFO:teuthology.orchestra.run.smithi079.stdout:mon.b: {} 2024-09-11T07:05:57.153 INFO:teuthology.orchestra.run.smithi079.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T07:05:57.163 INFO:teuthology.orchestra.run.smithi079.stdout:mon.c: {} 2024-09-11T07:05:57.163 INFO:teuthology.orchestra.run.smithi079.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T07:05:57.178 DEBUG:teuthology.orchestra.run.smithi079:> type ceph-objectstore-tool 2024-09-11T07:05:57.183 INFO:teuthology.orchestra.run.smithi079.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T07:05:57.183 DEBUG:teuthology.orchestra.run.smithi110:> type ceph-objectstore-tool 2024-09-11T07:05:57.189 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-09-11T07:05:57.190 INFO:teuthology.run_tasks:Running task rbd_fsx... 2024-09-11T07:05:57.207 INFO:tasks.rbd_fsx:starting rbd_fsx... 2024-09-11T07:05:57.207 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-09-11T07:05:57.207 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:05:57.207 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:05:57.208 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-11T07:05:57.208 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T07:05:57.209 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-09-11T07:05:57.209 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-09-11T07:05:57.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:05:57.210 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-09-11T07:05:57.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:05:57.211 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-09-11T07:05:57.211 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:05:57.212 DEBUG:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster ceph --id 0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 pool_client.0 image_client.0 2024-09-11T07:05:57.238 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:57.234+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:05:57.251 INFO:teuthology.orchestra.run.smithi079.stdout:mapped writes DISABLED 2024-09-11T07:05:57.251 INFO:teuthology.orchestra.run.smithi079.stdout:mapped reads DISABLED 2024-09-11T07:05:57.251 INFO:teuthology.orchestra.run.smithi079.stdout:Seed set to 7044 2024-09-11T07:05:57.311 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:05:57.306+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:05:57.347 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:05:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:05:57.347 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:05:57.347 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:05:57.363 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:05:57.412 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:05:57.410+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:05:57.441 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:05:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:05:57.458 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:05:57.458 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:05:57.477 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:57.477 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:57.489 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:05:57.490 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:05:57.490 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:05:57.520 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:05:57.520 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:05:57.520 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:05:57.520+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:05:57.554 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:05:57.554 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:05:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:05:57.565 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:05:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 20, 2024-09-11T07:05:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "e1313abd-54a9-4e53-ab67-469f744048b1", 2024-09-11T07:05:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-11T07:05:29.098467+0000", 2024-09-11T07:05:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-11T07:05:51.143864+0000", 2024-09-11T07:05:57.565 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-11T07:05:41.051856+0000", 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-11T07:05:31.688503+0000", 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T07:05:57.566 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 2, 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "squid", 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:41.897005+0000", 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-11T07:05:57.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-11T07:05:57.568 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:05:57.569 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:05:57.570 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:05:57.571 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-11T07:05:57.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 8, 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 8, 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.25, 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:47.687214+0000", 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:05:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:05:57.575 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "20", 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 2, 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 20, 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:05:57.576 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:05:57.577 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:05:57.578 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.9900000095367432, 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.9900000095367432, 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.75, 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.75, 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-11T07:05:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "24d57cdb-2f3a-4a96-903d-11be7dc26a20", 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:05:57.580 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 0, 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:05:57.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.582 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.583 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.584 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/1708235775", 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/1708235775", 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/1708235775", 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/1708235775", 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "aa51dc1b-b783-4212-8736-1f666239613b", 2024-09-11T07:05:57.585 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.586 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-11T07:05:57.587 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.588 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.589 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/2076268206", 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/2076268206", 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/2076268206", 2024-09-11T07:05:57.590 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/2076268206", 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "141a913f-7353-44a9-9dbd-70219bcee638", 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:05:57.591 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.592 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/1904492349", 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/1904492349", 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/1904492349", 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/1904492349", 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:05:57.596 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "32550aeb-0c8d-4ca9-afd5-3e5258e7255b", 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 0, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:05:57.597 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.598 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.600 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.601 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/1327328912", 2024-09-11T07:05:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/1327328912", 2024-09-11T07:05:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/1327328912", 2024-09-11T07:05:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/1327328912", 2024-09-11T07:05:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:05:57.602 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:05:57.603 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc", 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 0, 2024-09-11T07:05:57.604 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6808", 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6809", 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:05:57.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6810", 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6811", 2024-09-11T07:05:57.606 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6814", 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6815", 2024-09-11T07:05:57.607 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6812", 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6813", 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6809/4087452871", 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6811/4087452871", 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6815/4087452871", 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6813/4087452871", 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "42c83053-328e-4c9b-bdaf-09e1a4cc8b7d", 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:05:57.610 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6824", 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6825", 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.611 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6826", 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6827", 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6830", 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6831", 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6828", 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6829", 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6825/2133006853", 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6827/2133006853", 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6831/2133006853", 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6829/2133006853", 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "0ab29b1f-3012-4528-8f47-2cac908122c9", 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:05:57.615 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6816", 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6817", 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6818", 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6819", 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6822", 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6823", 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6820", 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6821", 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6817/2083734892", 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6819/2083734892", 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6823/2083734892", 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6821/2083734892", 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d9c7d12b-be93-41c9-a246-773faa65ecaf", 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:05:57.621 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6800", 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6801", 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.622 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6802", 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6803", 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.623 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6806", 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6807", 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6804", 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6805", 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6801/2322042784", 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6803/2322042784", 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2322042784", 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2322042784", 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.626 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.653648+0000", 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:05:57.627 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.846269+0000", 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.970884+0000", 2024-09-11T07:05:57.628 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.985630+0000", 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:05:57.629 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.236412+0000", 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:05:57.630 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.336953+0000", 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.306806+0000", 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.104744+0000", 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-11T07:05:57.632 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [ 2024-09-11T07:05:57.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 2, 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 1 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [ 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-11T07:05:57.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 2, 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 1 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-11T07:05:57.635 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-11T07:05:57.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:05:57.636 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:05:57.637 INFO:tasks.thrashosds.thrasher:j is {'epoch': 20, 'fsid': 'e1313abd-54a9-4e53-ab67-469f744048b1', 'created': '2024-09-11T07:05:29.098467+0000', 'modified': '2024-09-11T07:05:51.143864+0000', 'last_up_change': '2024-09-11T07:05:41.051856+0000', 'last_in_change': '2024-09-11T07:05:31.688503+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 2, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T07:05:41.897005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T07:05:47.687214+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '24d57cdb-2f3a-4a96-903d-11be7dc26a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6825', 'nonce': 1708235775}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6826', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 1708235775}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6830', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 1708235775}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6829', 'nonce': 1708235775}]}, 'public_addr': '172.21.15.79:6825/1708235775', 'cluster_addr': '172.21.15.79:6827/1708235775', 'heartbeat_back_addr': '172.21.15.79:6831/1708235775', 'heartbeat_front_addr': '172.21.15.79:6829/1708235775', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa51dc1b-b783-4212-8736-1f666239613b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 2076268206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 2076268206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 2076268206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 2076268206}]}, 'public_addr': '172.21.15.79:6801/2076268206', 'cluster_addr': '172.21.15.79:6803/2076268206', 'heartbeat_back_addr': '172.21.15.79:6807/2076268206', 'heartbeat_front_addr': '172.21.15.79:6805/2076268206', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '141a913f-7353-44a9-9dbd-70219bcee638', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6817', 'nonce': 1904492349}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6818', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1904492349}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6822', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 1904492349}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6821', 'nonce': 1904492349}]}, 'public_addr': '172.21.15.79:6817/1904492349', 'cluster_addr': '172.21.15.79:6819/1904492349', 'heartbeat_back_addr': '172.21.15.79:6823/1904492349', 'heartbeat_front_addr': '172.21.15.79:6821/1904492349', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '32550aeb-0c8d-4ca9-afd5-3e5258e7255b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 1327328912}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 1327328912}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 1327328912}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 1327328912}]}, 'public_addr': '172.21.15.79:6809/1327328912', 'cluster_addr': '172.21.15.79:6811/1327328912', 'heartbeat_back_addr': '172.21.15.79:6815/1327328912', 'heartbeat_front_addr': '172.21.15.79:6813/1327328912', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 0, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 4087452871}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 4087452871}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 4087452871}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 4087452871}]}, 'public_addr': '172.21.15.110:6809/4087452871', 'cluster_addr': '172.21.15.110:6811/4087452871', 'heartbeat_back_addr': '172.21.15.110:6815/4087452871', 'heartbeat_front_addr': '172.21.15.110:6813/4087452871', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '42c83053-328e-4c9b-bdaf-09e1a4cc8b7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 2133006853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 2133006853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 2133006853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 2133006853}]}, 'public_addr': '172.21.15.110:6825/2133006853', 'cluster_addr': '172.21.15.110:6827/2133006853', 'heartbeat_back_addr': '172.21.15.110:6831/2133006853', 'heartbeat_front_addr': '172.21.15.110:6829/2133006853', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0ab29b1f-3012-4528-8f47-2cac908122c9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 2083734892}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 2083734892}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 2083734892}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 2083734892}]}, 'public_addr': '172.21.15.110:6817/2083734892', 'cluster_addr': '172.21.15.110:6819/2083734892', 'heartbeat_back_addr': '172.21.15.110:6823/2083734892', 'heartbeat_front_addr': '172.21.15.110:6821/2083734892', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'd9c7d12b-be93-41c9-a246-773faa65ecaf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2322042784}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2322042784}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2322042784}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2322042784}]}, 'public_addr': '172.21.15.110:6801/2322042784', 'cluster_addr': '172.21.15.110:6803/2322042784', 'heartbeat_back_addr': '172.21.15.110:6807/2322042784', 'heartbeat_front_addr': '172.21.15.110:6805/2322042784', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.653648+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.846269+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.970884+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.985630+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.236412+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.336953+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.306806+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.104744+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 2, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_removed_snaps': [{'pool': 2, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T07:05:57.638 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-11T07:05:57.638 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:05:57.638 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:05:57.639 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:57.639 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:57.639 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:05:57.639 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:05:57.640 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:05:57.640 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:05:57.641 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:05:57.641 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:57.634+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:05:57.738 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:05:57.736+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:05:57.792 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:57.793 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:57.806 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:05:57.838 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:05:57.838+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:05:57.940 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:57.938+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:05:57.962 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:57.962 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:57.974 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:05:58.041 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:05:58.040+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:05:58.084 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:58.084 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:58.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:05:58.183 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:05:58.184+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:05:58.188 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:05:58.243 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:05:58.238+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:05:58.263 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:58.263 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:58.277 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:05:58.344 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:05:58.342+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:05:58.397 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:58.397 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:58.411 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:05:58.445 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:05:58.442+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:05:58.530 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:58.530 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:58.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:05:58.545 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:05:58.544+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:05:58.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:05:58.644+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:05:58.661 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:58.661 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:58.675 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:05:58.747 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:58.742+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:05:58.848 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:05:58.846+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:05:58.854 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:58.854 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:58.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:05:58.948 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:58.946+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:05:58.988 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:58.988 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:59.002 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:05:59.052 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:59.050+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:05:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:59.133 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:59.146 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:05:59.188 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:05:59.186+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:05:59.250 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:59.246+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:05:59.312 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:59.312 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:59.327 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:05:59.372 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:59.370+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:05:59.452 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:05:59.450+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:05:59.496 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:59.496 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:59.510 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:05:59.556 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:05:59.554+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:05:59.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:05:59.653 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:05:59.650+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:05:59.678 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:59.678 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:59.692 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:05:59.755 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:05:59.756+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:05:59.804 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:05:59.804 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:05:59.821 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:05:59.822 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:05:59.838 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:05:59.839 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:05:59.855 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:05:59.855 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:05:59.855 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:05:59.850+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:05:59.860 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:05:59.860 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:05:59.874 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:05:59.875 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:05:59.876 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:05:59.893 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:05:59.893 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:05:59.914 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:05:59.915 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:05:59.933 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:05:59.933 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:05:59.960 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:05:59.958+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4232.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18)", 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:49.148570+0000", 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.885506255999999, 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0078436760000000008, 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:00.034 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4232", 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/328839221", 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.148570+0000", 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.148570+0000", 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.148577+0000", 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8739999999999997e-06 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.148588+0000", 2024-09-11T07:06:00.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0443e-05 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.148612+0000", 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4258999999999999e-05 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.148632+0000", 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0094000000000001e-05 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.148756+0000", 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012435199999999999 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.148770+0000", 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3983e-05 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.152460+0000", 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036901909999999998 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.152770+0000", 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030927800000000002 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.153104+0000", 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033456099999999998 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.154604+0000", 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001499675 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.156165+0000", 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015611850000000001 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.156304+0000", 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013912500000000001 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.156414+0000", 2024-09-11T07:06:00.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109656 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4232.0:1 2.3 e18/17 ondisk, result = 0)", 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:49.155962+0000", 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.878114722999999, 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00046861299999999999, 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.155962+0000", 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.155962+0000", 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.155963+0000", 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.466e-06 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.155972+0000", 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6139999999999992e-06 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.155993+0000", 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1226e-05 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.156007+0000", 2024-09-11T07:06:00.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4037e-05 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.156124+0000", 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011727600000000001 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.156146+0000", 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1290000000000001e-05 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.156430+0000", 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028470399999999999 2024-09-11T07:06:00.044 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.045 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:00.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.045 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4232.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-11T07:06:00.045 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:49.160201+0000", 2024-09-11T07:06:00.046 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.873875139000001, 2024-09-11T07:06:00.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00039119399999999998, 2024-09-11T07:06:00.046 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:00.046 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:00.046 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4232", 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/328839221", 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 2 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.160201+0000", 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.160201+0000", 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.160204+0000", 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.424e-06 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.160215+0000", 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1372999999999999e-05 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.160247+0000", 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1319000000000003e-05 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.160262+0000", 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5400000000000002e-05 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.160379+0000", 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116883 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.160593+0000", 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000213795 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4232.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18)", 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:49.161023+0000", 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.873053885000001, 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035558600000000002, 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:00.050 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4232", 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/328839221", 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 3 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.161023+0000", 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.161023+0000", 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.161025+0000", 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9369999999999998e-06 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:00.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.161036+0000", 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1358999999999999e-05 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.161068+0000", 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1619999999999999e-05 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.161102+0000", 2024-09-11T07:06:00.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4489999999999997e-05 2024-09-11T07:06:00.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.161203+0000", 2024-09-11T07:06:00.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100918 2024-09-11T07:06:00.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:00.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:49.161378+0000", 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000175262 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4232.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19)", 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:50.150976+0000", 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.8831009499999993, 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0066311449999999997, 2024-09-11T07:06:00.055 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4232", 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/328839221", 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 5 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.150976+0000", 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.150976+0000", 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.150979+0000", 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2660000000000002e-06 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.150995+0000", 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6520000000000001e-05 2024-09-11T07:06:00.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.151031+0000", 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5759000000000001e-05 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.151050+0000", 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536999999999999e-05 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.151191+0000", 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014112599999999999 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.151201+0000", 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0200000000000001e-05 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.154359+0000", 2024-09-11T07:06:00.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031583520000000001 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.154691+0000", 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033143400000000003 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.155077+0000", 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038602999999999999 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:00.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.156994+0000", 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001917242 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157447+0000", 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00045312 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157529+0000", 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1916000000000006e-05 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:00.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157607+0000", 2024-09-11T07:06:00.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7643000000000002e-05 2024-09-11T07:06:00.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.062 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:00.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.062 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4232.0:5 2.2 e19/17 ondisk, result = 0)", 2024-09-11T07:06:00.063 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:50.157284+0000", 2024-09-11T07:06:00.064 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.876792343, 2024-09-11T07:06:00.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033659100000000002, 2024-09-11T07:06:00.064 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:00.064 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:00.064 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:00.064 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:00.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:00.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157284+0000", 2024-09-11T07:06:00.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:00.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157284+0000", 2024-09-11T07:06:00.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157286+0000", 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0339999999999999e-06 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157296+0000", 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4259999999999992e-06 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157322+0000", 2024-09-11T07:06:00.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6840000000000001e-05 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157337+0000", 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4157e-05 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157426+0000", 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9488999999999996e-05 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:00.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157439+0000", 2024-09-11T07:06:00.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2737e-05 2024-09-11T07:06:00.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:00.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:50.157621+0000", 2024-09-11T07:06:00.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018190799999999999 2024-09-11T07:06:00.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.068 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4232.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20)", 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:51.153529+0000", 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.8805470450000001, 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010606614, 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4232", 2024-09-11T07:06:00.069 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/328839221", 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.153529+0000", 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:00.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.153529+0000", 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.153533+0000", 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7799999999999998e-06 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.153549+0000", 2024-09-11T07:06:00.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6220000000000001e-05 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.153586+0000", 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6616000000000003e-05 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.153604+0000", 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7572999999999999e-05 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.153735+0000", 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130982 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op must wait for map", 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.153745+0000", 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0803e-05 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.161249+0000", 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00750389 2024-09-11T07:06:00.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.161395+0000", 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000145895 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 1", 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.161632+0000", 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023655900000000001 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.163214+0000", 2024-09-11T07:06:00.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001581867 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.163978+0000", 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00076450800000000001 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.164065+0000", 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6592e-05 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.164136+0000", 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1328999999999994e-05 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop_reply(client.4232.0:7 2.2 e20/17 ondisk, result = 0)", 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:51.163739+0000", 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.8703377840000002, 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00041025700000000003, 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:00.076 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:00.077 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:00.077 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:00.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:00.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.163739+0000", 2024-09-11T07:06:00.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:00.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.163739+0000", 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.163740+0000", 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7370000000000001e-06 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.163750+0000", 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4029999999999996e-06 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.163776+0000", 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5953e-05 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.163790+0000", 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.163954+0000", 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016463900000000001 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.163969+0000", 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4527e-05 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:51.164149+0000", 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018005500000000001 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:00.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:00.081 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:00.082 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:00.082 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:00.078+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:00.183 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:00.184+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:00.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:06:00.242 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:00.242 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:00.243 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:00.243 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:00.256 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:00.304 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:00.302+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:00.381 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:00.381 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:00.381 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:00.381 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:00.381 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:00.385 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:00.384+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:00.395 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:00.486 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:00.482+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:00.560 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [] 2024-09-11T07:06:00.561 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:00.574 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:00.616 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:00.614+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:00.688 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:00.688+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:00.737 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:00.737 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:00.737 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:00.737 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:00.751 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:00.788 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:00.788+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:00.809 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:06:00.878 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:00.878 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:00.878 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:00.888 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:00.886+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:00.891 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:00.989 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:00.986+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.993861048999999, 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.066 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:06:01.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:06:01.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:85 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940473+0000", 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.121697302000001, 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010826193, 2024-09-11T07:06:01.073 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 85 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940473+0000", 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940473+0000", 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940475+0000", 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7600000000000001e-06 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940486+0000", 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1156e-05 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940506+0000", 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9925999999999999e-05 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940522+0000", 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5457000000000001e-05 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.943943+0000", 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034213609999999999 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.944183+0000", 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240385 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.944540+0000", 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035704399999999999 2024-09-11T07:06:01.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950870+0000", 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063301140000000004 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950981+0000", 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011061300000000001 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951136+0000", 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015498500000000001 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951299+0000", 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000163392 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940545+0000", 2024-09-11T07:06:01.079 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.121625265999999, 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011233303, 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 86 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940545+0000", 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940545+0000", 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940547+0000", 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3999999999999999e-06 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940557+0000", 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0566e-05 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940581+0000", 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4066999999999998e-05 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940599+0000", 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.802e-05 2024-09-11T07:06:01.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.945443+0000", 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048435459999999998 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.945699+0000", 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025649199999999998 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.946048+0000", 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034892000000000001 2024-09-11T07:06:01.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950883+0000", 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048349789999999997 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951603+0000", 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00072007799999999997 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951681+0000", 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8002000000000003e-05 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951779+0000", 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7232999999999996e-05 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.085 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940649+0000", 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.121521371, 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012003827999999999, 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940649+0000", 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940649+0000", 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940651+0000", 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.73e-06 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940781+0000", 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013028900000000001 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940839+0000", 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7813999999999999e-05 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940856+0000", 2024-09-11T07:06:01.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7462999999999999e-05 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.946932+0000", 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060756860000000003 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.947149+0000", 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021673499999999999 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.947520+0000", 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037156800000000002 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950893+0000", 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033723199999999998 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.952399+0000", 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015064519999999999 2024-09-11T07:06:01.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.952549+0000", 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014964199999999999 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.952653+0000", 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010412900000000001 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940888+0000", 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.121282516000001, 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012343412, 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 88 2024-09-11T07:06:01.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940888+0000", 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940888+0000", 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940890+0000", 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.81e-06 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940902+0000", 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2207e-05 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940923+0000", 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0866e-05 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940956+0000", 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3189999999999999e-05 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.949744+0000", 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008788176 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.949873+0000", 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129085 2024-09-11T07:06:01.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950072+0000", 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019907900000000001 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951334+0000", 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012619269999999999 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.953038+0000", 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017033370000000001 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.953124+0000", 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5835999999999996e-05 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.953231+0000", 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107899 2024-09-11T07:06:01.097 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104385+0000", 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.957785758, 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011221050999999999, 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.098 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104385+0000", 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104385+0000", 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104386+0000", 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2869999999999999e-06 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104478+0000", 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1875999999999999e-05 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104494+0000", 2024-09-11T07:06:01.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6327000000000001e-05 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104503+0000", 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1859999999999998e-06 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.112017+0000", 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0075131690000000001 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.112142+0000", 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000125683 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.112347+0000", 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020447799999999999 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114485+0000", 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021379569999999998 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115419+0000", 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00093446899999999995 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115496+0000", 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6353000000000006e-05 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115606+0000", 2024-09-11T07:06:01.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110266 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104521+0000", 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.957649362000002, 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014408172, 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 110 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104521+0000", 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104521+0000", 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104522+0000", 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0860000000000001e-06 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104531+0000", 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3999999999999992e-06 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104541+0000", 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0277e-05 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104548+0000", 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3100000000000003e-06 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114581+0000", 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01003277 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114706+0000", 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124902 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114894+0000", 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018778800000000001 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118539+0000", 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003645279 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118689+0000", 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000150345 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118763+0000", 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3720000000000006e-05 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118929+0000", 2024-09-11T07:06:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016629500000000001 2024-09-11T07:06:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.110 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104561+0000", 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.957609416, 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014554475000000001, 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 111 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104561+0000", 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104561+0000", 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104562+0000", 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4399999999999999e-07 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104571+0000", 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000005e-06 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104581+0000", 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6760000000000002e-06 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104588+0000", 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1169999999999998e-06 2024-09-11T07:06:01.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115711+0000", 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011123141 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115986+0000", 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027494800000000001 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.116341+0000", 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035464999999999997 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118669+0000", 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023285519999999998 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118945+0000", 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027566100000000002 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119016+0000", 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0915999999999997e-05 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119116+0000", 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9820000000000003e-05 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104600+0000", 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.957570058999998, 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016285293999999999, 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104600+0000", 2024-09-11T07:06:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104600+0000", 2024-09-11T07:06:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104601+0000", 2024-09-11T07:06:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-11T07:06:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104791+0000", 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018977100000000001 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104805+0000", 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4226999999999999e-05 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104815+0000", 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000006e-06 2024-09-11T07:06:01.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.117204+0000", 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012389331 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.117328+0000", 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012422900000000001 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.117544+0000", 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021566900000000001 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120679+0000", 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003135245 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120698+0000", 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8753000000000002e-05 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120769+0000", 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1229999999999994e-05 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120886+0000", 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011668899999999999 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104833+0000", 2024-09-11T07:06:01.123 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.957337071000001, 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021630725999999999, 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 113 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104833+0000", 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104833+0000", 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104835+0000", 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104842+0000", 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2429999999999999e-06 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104852+0000", 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0414000000000001e-05 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104860+0000", 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5460000000000003e-06 2024-09-11T07:06:01.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119211+0000", 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014351126000000001 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119441+0000", 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023001799999999999 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119799+0000", 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035755699999999999 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.122532+0000", 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027336890000000001 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126211+0000", 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036784090000000001 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126342+0000", 2024-09-11T07:06:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131882 2024-09-11T07:06:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126464+0000", 2024-09-11T07:06:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121712 2024-09-11T07:06:01.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104874+0000", 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.957296258, 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021780498999999998, 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 114 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104874+0000", 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104874+0000", 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104875+0000", 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9299999999999997e-07 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104881+0000", 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1e-06 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104909+0000", 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7433e-05 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104917+0000", 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2770000000000005e-06 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.121050+0000", 2024-09-11T07:06:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016133179000000001 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.121288+0000", 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023799800000000001 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.121656+0000", 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036769 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126030+0000", 2024-09-11T07:06:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043747439999999999 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126487+0000", 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00045610900000000001 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126556+0000", 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9423000000000003e-05 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126655+0000", 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8752999999999995e-05 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.957239014999999, 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021917907, 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105093+0000", 2024-09-11T07:06:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016076900000000001 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105133+0000", 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0006999999999998e-05 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105146+0000", 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2612999999999999e-05 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.122642+0000", 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017495825 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.122911+0000", 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026968800000000002 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.123283+0000", 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037215399999999997 2024-09-11T07:06:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126185+0000", 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029011639999999999 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126684+0000", 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00049918599999999999 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126753+0000", 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8786000000000002e-05 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126849+0000", 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6829000000000004e-05 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.105166+0000", 2024-09-11T07:06:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.957004974, 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023310450999999999, 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105166+0000", 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105166+0000", 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105167+0000", 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105174+0000", 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1199999999999996e-06 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105188+0000", 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4426e-05 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105196+0000", 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.52e-06 2024-09-11T07:06:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.124500+0000", 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019304808 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.124754+0000", 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025354899999999999 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.125141+0000", 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038675299999999999 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128258+0000", 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031168459999999999 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128278+0000", 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9922999999999999e-05 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128358+0000", 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0729999999999994e-05 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128476+0000", 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117719 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.105209+0000", 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.956961680999999, 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023639472000000002, 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-09-11T07:06:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105209+0000", 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105209+0000", 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105210+0000", 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7000000000000003e-07 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105218+0000", 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1370000000000002e-06 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105231+0000", 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3132999999999999e-05 2024-09-11T07:06:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105240+0000", 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3100000000000006e-06 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126951+0000", 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021710526000000001 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.127194+0000", 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024300799999999999 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.127570+0000", 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000375798 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128630+0000", 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001060538 2024-09-11T07:06:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128675+0000", 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4946e-05 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128749+0000", 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3880000000000004e-05 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128848+0000", 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9326000000000004e-05 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.605952+0000", 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.456218287999999, 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010697577999999999, 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 140 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.605952+0000", 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.605952+0000", 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.605954+0000", 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5030000000000001e-06 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606106+0000", 2024-09-11T07:06:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015273899999999999 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606135+0000", 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8127e-05 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606159+0000", 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4153000000000001e-05 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.613885+0000", 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0077264380000000004 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.613932+0000", 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6820999999999998e-05 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614045+0000", 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000112596 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.615450+0000", 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001405681 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.616601+0000", 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011509420000000001 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.616628+0000", 2024-09-11T07:06:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7152999999999999e-05 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.616650+0000", 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1424999999999999e-05 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.606193+0000", 2024-09-11T07:06:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 16.455977123, 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011487111, 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 141 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606193+0000", 2024-09-11T07:06:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606193+0000", 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606195+0000", 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606208+0000", 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3497e-05 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606235+0000", 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6747e-05 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606256+0000", 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0869999999999998e-05 2024-09-11T07:06:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614487+0000", 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082313420000000009 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614637+0000", 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000149574 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614806+0000", 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168863 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.615807+0000", 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010008770000000001 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.617561+0000", 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001753831 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.617632+0000", 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1007999999999995e-05 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.617681+0000", 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9016e-05 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:156 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337363+0000", 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.724807846000001, 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011142044, 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 156 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337363+0000", 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337363+0000", 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337364+0000", 2024-09-11T07:06:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0359999999999999e-06 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337374+0000", 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0297e-05 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337386+0000", 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337393+0000", 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.396e-06 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.343057+0000", 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056641759999999999 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.343311+0000", 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000253945 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.343681+0000", 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037009 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348060+0000", 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00437828 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348257+0000", 2024-09-11T07:06:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000197102 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348398+0000", 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014153200000000001 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348505+0000", 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000106593 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337407+0000", 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.724763772999999, 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011354912, 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 157 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337407+0000", 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337407+0000", 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337408+0000", 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7300000000000005e-07 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337420+0000", 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2627e-05 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337431+0000", 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0817e-05 2024-09-11T07:06:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337439+0000", 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.746e-06 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.344911+0000", 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.007472299 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.345169+0000", 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025795400000000002 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.345374+0000", 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020457900000000001 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348216+0000", 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0028425640000000001 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348530+0000", 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031385799999999998 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348662+0000", 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013236500000000001 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348762+0000", 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9329999999999999e-05 2024-09-11T07:06:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337451+0000", 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.724719177000001, 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015895230999999999, 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337451+0000", 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337451+0000", 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337452+0000", 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9699999999999995e-07 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337581+0000", 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012876900000000001 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337594+0000", 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2897e-05 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337602+0000", 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2830000000000001e-06 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.346160+0000", 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0085578100000000008 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.346406+0000", 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024632099999999997 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.346774+0000", 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000367924 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348797+0000", 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020230180000000001 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.353084+0000", 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042867369999999997 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.353239+0000", 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015480600000000001 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.353347+0000", 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010786899999999999 2024-09-11T07:06:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337618+0000", 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 15.724552482, 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018603607000000001, 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 159 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337618+0000", 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337618+0000", 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337619+0000", 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9699999999999994e-07 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337633+0000", 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4123e-05 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337645+0000", 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1347e-05 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337652+0000", 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7770000000000002e-06 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348854+0000", 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011201823 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.349013+0000", 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000158522 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.349220+0000", 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020700499999999999 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.350829+0000", 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001609388 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.355974+0000", 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051445670000000001 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.356123+0000", 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014918200000000001 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.356222+0000", 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8876000000000007e-05 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:01.192 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:01.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:01.194 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:01.192+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:01.297 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:01.290+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:01.318 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:01.318 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:01.318 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:01.319 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:01.332 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:01.395 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:01.390+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:01.453 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:01.453 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:01.453 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:01.453 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:01.453 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:01.468 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:01.495 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:01.494+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:01.595 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:01.595 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:01.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:01.595 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:18 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'8, mlcod=15'5)", 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.820400+0000", 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.773875559, 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029838669999999999, 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.820400+0000", 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.820400+0000", 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.820402+0000", 2024-09-11T07:06:01.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5770000000000001e-06 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.820415+0000", 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3106e-05 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.820438+0000", 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3710000000000002e-05 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.820459+0000", 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0526999999999998e-05 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.820557+0000", 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8245000000000006e-05 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.820602+0000", 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5234000000000001e-05 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.823298+0000", 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026950989999999998 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.823384+0000", 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6368999999999999e-05 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:73 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'47, mlcod=15'43)", 2024-09-11T07:06:01.600 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.919952+0000", 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.674323934, 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032222219999999998, 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.919952+0000", 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.919952+0000", 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.919953+0000", 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4330000000000001e-06 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.920092+0000", 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000139276 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.920158+0000", 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5430000000000002e-05 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.920172+0000", 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4183e-05 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.920288+0000", 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115955 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.920326+0000", 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8257000000000003e-05 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.923105+0000", 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002779185 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.923174+0000", 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8503000000000005e-05 2024-09-11T07:06:01.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:74 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'48, mlcod=15'43)", 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.921230+0000", 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.673045613999999, 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046482040000000004, 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921230+0000", 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921230+0000", 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921231+0000", 2024-09-11T07:06:01.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.277e-06 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921240+0000", 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2530000000000004e-06 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921261+0000", 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1897000000000001e-05 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921273+0000", 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1576000000000001e-05 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921399+0000", 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012553600000000001 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921430+0000", 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1690000000000003e-05 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.925789+0000", 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004358603 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.925878+0000", 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9371999999999997e-05 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:82 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'52, mlcod=15'50)", 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.942014+0000", 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.652261387999999, 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046046150000000003, 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942014+0000", 2024-09-11T07:06:01.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942014+0000", 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942016+0000", 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-06 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942028+0000", 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1939999999999999e-05 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942057+0000", 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8643e-05 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942070+0000", 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3093e-05 2024-09-11T07:06:01.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942185+0000", 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115049 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942219+0000", 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4100000000000002e-05 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.946497+0000", 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042781499999999997 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.946619+0000", 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012181299999999999 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:83 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'50)", 2024-09-11T07:06:01.614 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.942993+0000", 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.651282295000001, 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039014829999999999, 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942993+0000", 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942993+0000", 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942995+0000", 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0430000000000002e-06 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.943012+0000", 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6670000000000001e-05 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.943047+0000", 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4876999999999998e-05 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.943068+0000", 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0916000000000001e-05 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.943195+0000", 2024-09-11T07:06:01.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012704599999999999 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.943225+0000", 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0042000000000001e-05 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.946817+0000", 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035918970000000001 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.946895+0000", 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7991999999999995e-05 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:85 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'55, mlcod=15'50)", 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.945750+0000", 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.648525165999999, 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046609199999999998, 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945750+0000", 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945750+0000", 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945753+0000", 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1730000000000002e-06 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945768+0000", 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4970000000000001e-05 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945801+0000", 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2982999999999999e-05 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945819+0000", 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8127000000000001e-05 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945956+0000", 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013683200000000001 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945995+0000", 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9382999999999999e-05 2024-09-11T07:06:01.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.950324+0000", 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043285930000000004 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.950411+0000", 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7859e-05 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:86 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'56, mlcod=15'50)", 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.947190+0000", 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.647085211, 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051138299999999998, 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947190+0000", 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947190+0000", 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947192+0000", 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.747e-06 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947202+0000", 2024-09-11T07:06:01.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0142999999999999e-05 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947226+0000", 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3997000000000001e-05 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947239+0000", 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2666e-05 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947322+0000", 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3316e-05 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947350+0000", 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.745e-05 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.952210+0000", 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048603789999999997 2024-09-11T07:06:01.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.952304+0000", 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4131999999999999e-05 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:87 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'57, mlcod=15'50)", 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.948738+0000", 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.645537633, 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043227960000000003, 2024-09-11T07:06:01.628 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948738+0000", 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948738+0000", 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948739+0000", 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8999999999999995e-07 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948819+0000", 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0558999999999999e-05 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948839+0000", 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9199999999999999e-05 2024-09-11T07:06:01.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948850+0000", 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.147e-05 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948974+0000", 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012396299999999999 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.949029+0000", 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5333e-05 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.952986+0000", 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039564689999999998 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.953061+0000", 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4912000000000004e-05 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:129 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'87, mlcod=15'85)", 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.605706+0000", 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.988569302999998, 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678345, 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605706+0000", 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605706+0000", 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605708+0000", 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.99e-06 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605721+0000", 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2767e-05 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605757+0000", 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6349e-05 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605777+0000", 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9307e-05 2024-09-11T07:06:01.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605937+0000", 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000160645 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605994+0000", 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6746000000000002e-05 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.609257+0000", 2024-09-11T07:06:01.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032630350000000001 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.609385+0000", 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127506 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:130 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'88, mlcod=15'85)", 2024-09-11T07:06:01.637 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.606280+0000", 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.987995981000001, 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037782639999999999, 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606280+0000", 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606280+0000", 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606281+0000", 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606295+0000", 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4224e-05 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606327+0000", 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1606000000000002e-05 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606383+0000", 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6292999999999998e-05 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606725+0000", 2024-09-11T07:06:01.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034160800000000003 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606764+0000", 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9212000000000003e-05 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.609957+0000", 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003192706 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.610058+0000", 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000101032 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:131 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=15'85)", 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.606954+0000", 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.987321629, 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003239385, 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606954+0000", 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606954+0000", 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606956+0000", 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.686e-06 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.607067+0000", 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011171300000000001 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.607095+0000", 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7909999999999999e-05 2024-09-11T07:06:01.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.607114+0000", 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9072999999999998e-05 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.607352+0000", 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023767499999999999 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.607387+0000", 2024-09-11T07:06:01.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5135999999999997e-05 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.610067+0000", 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026796760000000002 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.610193+0000", 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012651599999999999 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.646 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:138 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'96, mlcod=16'90)", 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.613592+0000", 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.980683288000002, 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0030871000000000002, 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.613592+0000", 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.613592+0000", 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.613594+0000", 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4470000000000001e-06 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.613606+0000", 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.208e-05 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.613630+0000", 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.446e-05 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.613646+0000", 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6172999999999999e-05 2024-09-11T07:06:01.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.614335+0000", 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00068854099999999998 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.614369+0000", 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4455999999999997e-05 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.616623+0000", 2024-09-11T07:06:01.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002253587 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.616679+0000", 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6356e-05 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:143 1.0 e16/14 1:30306672:devicehealth::main.db.0000000000000000:head v 16'101, mlcod=16'98)", 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.620472+0000", 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.973803124, 2024-09-11T07:06:01.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003729432, 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620472+0000", 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620472+0000", 2024-09-11T07:06:01.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620473+0000", 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9699999999999994e-07 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620630+0000", 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015667200000000001 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620662+0000", 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1875999999999998e-05 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620677+0000", 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4600000000000001e-05 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620772+0000", 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5602999999999999e-05 2024-09-11T07:06:01.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620808+0000", 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5363e-05 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.624109+0000", 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003301614 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.624202+0000", 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2707000000000005e-05 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:144 1.0 e16/14 1:30306672:devicehealth::main.db.0000000000000000:head v 16'102, mlcod=16'98)", 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.621438+0000", 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.972837408, 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055383699999999999, 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.656 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621438+0000", 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621438+0000", 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621440+0000", 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.967e-06 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621534+0000", 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3945999999999998e-05 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621555+0000", 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1308999999999999e-05 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621570+0000", 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5004000000000001e-05 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621720+0000", 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000149579 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621752+0000", 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2376000000000003e-05 2024-09-11T07:06:01.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.626921+0000", 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051684069999999999 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.626977+0000", 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5782000000000002e-05 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:145 1.0 e16/14 1:30306672:devicehealth::main.db.0000000000000000:head v 16'103, mlcod=16'98)", 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.622301+0000", 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.971974204999999, 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047136870000000003, 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622301+0000", 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622301+0000", 2024-09-11T07:06:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622302+0000", 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.04e-06 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622435+0000", 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132683 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622470+0000", 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5142999999999999e-05 2024-09-11T07:06:01.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622485+0000", 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4236000000000001e-05 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622567+0000", 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2663000000000005e-05 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622596+0000", 2024-09-11T07:06:01.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9295999999999999e-05 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.626981+0000", 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043843859999999997 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.627015+0000", 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4239999999999997e-05 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:158 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'108)", 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:45.348000+0000", 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.246275989000001, 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056739099999999999, 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348000+0000", 2024-09-11T07:06:01.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348000+0000", 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348001+0000", 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.24e-06 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348108+0000", 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107339 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348127+0000", 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9040000000000001e-05 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348146+0000", 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8879999999999999e-05 2024-09-11T07:06:01.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348234+0000", 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7756999999999993e-05 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348247+0000", 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3057000000000001e-05 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.353637+0000", 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005390181 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.353674+0000", 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6415999999999998e-05 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:159 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'113, mlcod=16'110)", 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:45.350384+0000", 2024-09-11T07:06:01.671 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.243891697999999, 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0062316070000000001, 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350384+0000", 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350384+0000", 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350385+0000", 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2330000000000001e-06 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350393+0000", 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2670000000000006e-06 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350413+0000", 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.982e-05 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350428+0000", 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.504e-05 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350582+0000", 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015388199999999999 2024-09-11T07:06:01.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350598+0000", 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6004000000000001e-05 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.356580+0000", 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059817500000000001 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.356616+0000", 2024-09-11T07:06:01.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5611000000000002e-05 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:162 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'116, mlcod=16'114)", 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:45.363592+0000", 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.230683896999999, 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072654709999999999, 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.676 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363592+0000", 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363592+0000", 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363593+0000", 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-06 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363601+0000", 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0600000000000008e-06 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363621+0000", 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9692999999999999e-05 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363639+0000", 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8179999999999999e-05 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363730+0000", 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0997999999999998e-05 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363743+0000", 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3016e-05 2024-09-11T07:06:01.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.370822+0000", 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070786429999999999 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.370857+0000", 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5630999999999998e-05 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:00.829529+0000", 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.76474616299999998, 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003731528, 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-09-11T07:06:01.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829529+0000", 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829529+0000", 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829532+0000", 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4040000000000002e-06 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829543+0000", 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0808000000000001e-05 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829564+0000", 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1376e-05 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829577+0000", 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2696e-05 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829667+0000", 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9951999999999995e-05 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829885+0000", 2024-09-11T07:06:01.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000218743 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.830186+0000", 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030077899999999999 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.831758+0000", 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001571926 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.833163+0000", 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001405089 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.833216+0000", 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2710999999999997e-05 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.833261+0000", 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5043999999999998e-05 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:15 3.1f 3:fa654f18:::rbd_id.image_client.0:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:00.846353+0000", 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.74792215900000003, 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033113959999999999, 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:01.687 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846353+0000", 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846353+0000", 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846354+0000", 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6500000000000008e-07 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846361+0000", 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.127e-06 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846372+0000", 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1507e-05 2024-09-11T07:06:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846378+0000", 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0909999999999998e-06 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846428+0000", 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9437000000000001e-05 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846495+0000", 2024-09-11T07:06:01.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6934999999999995e-05 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.849665+0000", 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031703339999999999 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:01.691 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:01.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:01.693 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:01.692+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:01.794 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:01.790+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:01.855 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:01.856 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:01.856 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:01.856 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:01.869 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:01.915 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:01.916+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:01.951 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:01.992 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:01.992 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:01.995 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:01.994+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:02.005 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:02.096 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:02.096+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:02.097 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:02.098 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:02.115 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:02.115 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:02.131 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:02.131 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:02.147 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:02.147 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:02.158 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:02.159 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:02.168 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:02.168 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:02.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:02.188 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:02.188 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:02.197 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:02.194+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:02.209 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:02.209 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:02.230 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:02.230 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:02.298 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:02.296+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:02.299 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:02.300 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:02.313 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:02.399 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:02.400+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:02.469 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:02.469 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:02.482 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:02.501 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:02.498+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:02.601 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:02.602+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:02.638 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:06:02.638 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:06:02.639 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-11T07:06:02.639 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T07:06:02.639 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T07:06:02.639 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-11T07:06:02.647 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:02.647 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:02.663 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:02.702 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:02.698+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:02.773 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:02.773 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T07:06:02.774 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:02.787 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:02.787 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:02.789 INFO:teuthology.orchestra.run.smithi079.stdout:skipping zero size read 2024-09-11T07:06:02.789 INFO:teuthology.orchestra.run.smithi079.stdout:skipping zero size read 2024-09-11T07:06:02.790 INFO:teuthology.orchestra.run.smithi079.stdout:truncating to largest ever: 0x22f865d 2024-09-11T07:06:02.792 INFO:teuthology.orchestra.run.smithi079.stdout:3 trunc from 0x0 to 0x22f865d 2024-09-11T07:06:02.802 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:02.811 INFO:teuthology.orchestra.run.smithi079.stdout:4 writesame 0x303989e thru 0x303e69f data_size 0x5(0x4e02 bytes) 2024-09-11T07:06:02.811 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:02.811 INFO:teuthology.orchestra.run.smithi079.stdout:7 writesame 0x302da36 thru 0x30343ec data_size 0x1f(0x69b7 bytes) 2024-09-11T07:06:02.816 INFO:teuthology.orchestra.run.smithi079.stdout:9 read 0x1da448f thru 0x1daf99b (0xb50d bytes) 2024-09-11T07:06:02.816 INFO:teuthology.orchestra.run.smithi079.stdout:truncating to largest ever: 0xe1ffec6 2024-09-11T07:06:02.830 INFO:teuthology.orchestra.run.smithi079.stdout:10 trunc from 0x303e6a0 to 0xe1ffec6 2024-09-11T07:06:02.832 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:02.830+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:02.836 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:06:02.839 INFO:teuthology.orchestra.run.smithi079.stdout:12 write 0x146d6d4 thru 0x1472b8b (0x54b8 bytes) 2024-09-11T07:06:02.843 INFO:teuthology.orchestra.run.smithi079.stdout:14 read 0xdaf9fa3 thru 0xdb023e8 (0x8446 bytes) 2024-09-11T07:06:02.843 INFO:teuthology.orchestra.run.smithi079.stdout:15 read 0x823cab7 thru 0x8243027 (0x6571 bytes) 2024-09-11T07:06:02.843 INFO:teuthology.orchestra.run.smithi079.stdout:16 read 0x497d015 thru 0x4987f6b (0xaf57 bytes) 2024-09-11T07:06:02.843 INFO:teuthology.orchestra.run.smithi079.stdout:17 punch from 0x2d49718 to 0x2d5109c, (0x7984 bytes) 2024-09-11T07:06:02.843 INFO:teuthology.orchestra.run.smithi079.stdout:19 read 0xae02579 thru 0xae06a0c (0x4494 bytes) 2024-09-11T07:06:02.845 INFO:teuthology.orchestra.run.smithi079.stdout:21 trunc from 0xe1ffec6 to 0xc9d0f5c 2024-09-11T07:06:02.855 INFO:teuthology.orchestra.run.smithi079.stdout:22 read 0x85545b9 thru 0x855b927 (0x736f bytes) 2024-09-11T07:06:02.855 INFO:teuthology.orchestra.run.smithi079.stdout:24 punch from 0x331a569 to 0x33296c0, (0xf157 bytes) 2024-09-11T07:06:02.856 INFO:teuthology.orchestra.run.smithi079.stdout:25 read 0x212d6b1 thru 0x213cc6d (0xf5bd bytes) 2024-09-11T07:06:02.856 INFO:teuthology.orchestra.run.smithi079.stdout:26 read 0x31e50b6 thru 0x31e58bd (0x808 bytes) 2024-09-11T07:06:02.856 INFO:teuthology.orchestra.run.smithi079.stdout:27 read 0x35d2f4a thru 0x35db1eb (0x82a2 bytes) 2024-09-11T07:06:02.856 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:02.856 INFO:teuthology.orchestra.run.smithi079.stdout:29 punch from 0x16cdf7f to 0x16d5b96, (0x7c17 bytes) 2024-09-11T07:06:02.857 INFO:teuthology.orchestra.run.smithi079.stdout:31 writesame 0x968e910 thru 0x969d3e7 data_size 0xa(0xead8 bytes) 2024-09-11T07:06:02.862 INFO:teuthology.orchestra.run.smithi079.stdout:33 writesame 0xb63bb7e thru 0xb646718 data_size 0x1(0xab9b bytes) 2024-09-11T07:06:02.887 INFO:teuthology.orchestra.run.smithi079.stdout:34 write 0xa83caa7 thru 0xa84815c (0xb6b6 bytes) 2024-09-11T07:06:02.894 INFO:teuthology.orchestra.run.smithi079.stdout:35 write 0xbaff7cc thru 0xbb02cff (0x3534 bytes) 2024-09-11T07:06:02.901 INFO:teuthology.orchestra.run.smithi079.stdout:36 punch from 0x4326eb6 to 0x43282ef, (0x1439 bytes) 2024-09-11T07:06:02.901 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:02.902 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:02.902 INFO:teuthology.orchestra.run.smithi079.stdout:40 writesame 0x39b6860 thru 0x39bd79f data_size 0x59(0x6f40 bytes) 2024-09-11T07:06:02.904 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:02.904+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:02.908 INFO:teuthology.orchestra.run.smithi079.stdout:41 write 0x30a8943 thru 0x30a977b (0xe39 bytes) 2024-09-11T07:06:02.917 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:02.918 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:02.920 INFO:teuthology.orchestra.run.smithi079.stdout:44 trunc from 0xc9d0f5c to 0x4d648cc 2024-09-11T07:06:02.933 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:02.945 INFO:teuthology.orchestra.run.smithi079.stdout:48 read 0xa7925f thru 0xa86535 (0xd2d7 bytes) 2024-09-11T07:06:02.945 INFO:teuthology.orchestra.run.smithi079.stdout:49 read 0x2e07d8e thru 0x2e177bd (0xfa30 bytes) 2024-09-11T07:06:02.945 INFO:teuthology.orchestra.run.smithi079.stdout:50 read 0x1887295 thru 0x188e320 (0x708c bytes) 2024-09-11T07:06:02.945 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:02.945 INFO:teuthology.orchestra.run.smithi079.stdout:52 read 0x20e17ad thru 0x20edde5 (0xc639 bytes) 2024-09-11T07:06:02.945 INFO:teuthology.orchestra.run.smithi079.stdout:53 write 0x30c3b31 thru 0x30c5c92 (0x2162 bytes) 2024-09-11T07:06:02.947 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:02.947 INFO:teuthology.orchestra.run.smithi079.stdout:55 writesame 0x4c9d81a thru 0x4ca4447 data_size 0x2(0x6c2e bytes) 2024-09-11T07:06:02.972 INFO:teuthology.orchestra.run.smithi079.stdout:56 write 0x5cca517 thru 0x5cced1f (0x4809 bytes) 2024-09-11T07:06:02.977 INFO:teuthology.orchestra.run.smithi079.stdout:57 read 0x29b265e thru 0x29b7006 (0x49a9 bytes) 2024-09-11T07:06:02.977 INFO:teuthology.orchestra.run.smithi079.stdout:59 write 0x1ddfb5d thru 0x1deeb0e (0xefb2 bytes) 2024-09-11T07:06:02.985 INFO:teuthology.orchestra.run.smithi079.stdout:60 read 0x334f29f thru 0x335d817 (0xe579 bytes) 2024-09-11T07:06:02.986 INFO:teuthology.orchestra.run.smithi079.stdout:62 read 0x229edc8 thru 0x229f06d (0x2a6 bytes) 2024-09-11T07:06:02.986 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.005 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:03.002+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:03.008 INFO:teuthology.orchestra.run.smithi079.stdout:66 writesame 0xd81c0cb thru 0xd82b7e0 data_size 0x1(0xf716 bytes) 2024-09-11T07:06:03.008 INFO:teuthology.orchestra.run.smithi079.stdout:67 punch from 0xb65e27 to 0xb68024, (0x21fd bytes) 2024-09-11T07:06:03.008 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.008 INFO:teuthology.orchestra.run.smithi079.stdout:69 write 0x282f6b7 thru 0x283172b (0x2075 bytes) 2024-09-11T07:06:03.014 INFO:teuthology.orchestra.run.smithi079.stdout:72 write 0x777ab23 thru 0x7781b3f (0x701d bytes) 2024-09-11T07:06:03.022 INFO:teuthology.orchestra.run.smithi079.stdout:73 writesame 0xb35bb2f thru 0xb36b470 data_size 0x2d(0xf942 bytes) 2024-09-11T07:06:03.030 INFO:teuthology.orchestra.run.smithi079.stdout:74 read 0x3fad240 thru 0x3fb0798 (0x3559 bytes) 2024-09-11T07:06:03.030 INFO:teuthology.orchestra.run.smithi079.stdout:75 read 0xa356012 thru 0xa3575b1 (0x15a0 bytes) 2024-09-11T07:06:03.033 INFO:teuthology.orchestra.run.smithi079.stdout:76 trunc from 0xd82b7e1 to 0xb66d73f 2024-09-11T07:06:03.046 INFO:teuthology.orchestra.run.smithi079.stdout:77 write 0x25ba663 thru 0x25baa0f (0x3ad bytes) 2024-09-11T07:06:03.053 INFO:teuthology.orchestra.run.smithi079.stdout:78 read 0x90d432c thru 0x90e40c7 (0xfd9c bytes) 2024-09-11T07:06:03.053 INFO:teuthology.orchestra.run.smithi079.stdout:83 write 0x2132857 thru 0x213c242 (0x99ec bytes) 2024-09-11T07:06:03.060 INFO:teuthology.orchestra.run.smithi079.stdout:85 read 0x70248f8 thru 0x7029b1d (0x5226 bytes) 2024-09-11T07:06:03.060 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.060 INFO:teuthology.orchestra.run.smithi079.stdout:90 read 0x3fdb40b thru 0x3fde0ce (0x2cc4 bytes) 2024-09-11T07:06:03.060 INFO:teuthology.orchestra.run.smithi079.stdout:91 read 0x90429ad thru 0x904c07d (0x96d1 bytes) 2024-09-11T07:06:03.060 INFO:teuthology.orchestra.run.smithi079.stdout:92 write 0x820fba thru 0x823e81 (0x2ec8 bytes) 2024-09-11T07:06:03.068 INFO:teuthology.orchestra.run.smithi079.stdout:93 punch from 0xa7ebcb8 to 0xa7f6a3a, (0xad82 bytes) 2024-09-11T07:06:03.068 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.068 INFO:teuthology.orchestra.run.smithi079.stdout:97 write 0xa45889 thru 0xa555ff (0xfd77 bytes) 2024-09-11T07:06:03.072 INFO:teuthology.orchestra.run.smithi079.stdout:98 read 0x2bd6f5c thru 0x2bdf9f9 (0x8a9e bytes) 2024-09-11T07:06:03.072 INFO:teuthology.orchestra.run.smithi079.stdout:100 read 0x6585a21 thru 0x6592eb3 (0xd493 bytes) 2024-09-11T07:06:03.073 INFO:teuthology.orchestra.run.smithi079.stdout:101 read 0x213c88f thru 0x213ef3f (0x26b1 bytes) 2024-09-11T07:06:03.073 INFO:teuthology.orchestra.run.smithi079.stdout:102 read 0x9127967 thru 0x912f0ea (0x7784 bytes) 2024-09-11T07:06:03.073 INFO:teuthology.orchestra.run.smithi079.stdout:103 punch from 0x8f9dd41 to 0x8fa73e4, (0x96a3 bytes) 2024-09-11T07:06:03.073 INFO:teuthology.orchestra.run.smithi079.stdout:106 writesame 0x7f4aa0d thru 0x7f4ef36 data_size 0x27(0x452a bytes) 2024-09-11T07:06:03.076 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:03.076 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:03.082 INFO:teuthology.orchestra.run.smithi079.stdout:107 trunc from 0xb66d73f to 0xa30d6da 2024-09-11T07:06:03.091 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:03.104 INFO:teuthology.orchestra.run.smithi079.stdout:108 read 0x403f5cb thru 0x40420cb (0x2b01 bytes) 2024-09-11T07:06:03.104 INFO:teuthology.orchestra.run.smithi079.stdout:110 read 0x57cb0f5 thru 0x57d24c0 (0x73cc bytes) 2024-09-11T07:06:03.105 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.106 INFO:teuthology.orchestra.run.smithi079.stdout:113 trunc from 0xa30d6da to 0x8ac28c0 2024-09-11T07:06:03.115 INFO:teuthology.orchestra.run.smithi079.stdout:114 writesame 0x61233cd thru 0x6131593 data_size 0x17(0xe1c7 bytes) 2024-09-11T07:06:03.122 INFO:teuthology.orchestra.run.smithi079.stdout:116 read 0x2e91710 thru 0x2e93410 (0x1d01 bytes) 2024-09-11T07:06:03.122 INFO:teuthology.orchestra.run.smithi079.stdout:117 write 0x176a2fb thru 0x17711c4 (0x6eca bytes) 2024-09-11T07:06:03.125 INFO:teuthology.orchestra.run.smithi079.stdout:119 write 0x5af0e20 thru 0x5af639f (0x5580 bytes) 2024-09-11T07:06:03.132 INFO:teuthology.orchestra.run.smithi079.stdout:120 write 0x1332107 thru 0x133983f (0x7739 bytes) 2024-09-11T07:06:03.136 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:03.134+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:03.137 INFO:teuthology.orchestra.run.smithi079.stdout:121 punch from 0x89cb107 to 0x89d6e84, (0xbd7d bytes) 2024-09-11T07:06:03.137 INFO:teuthology.orchestra.run.smithi079.stdout:122 write 0x16abc39 thru 0x16b77fa (0xbbc2 bytes) 2024-09-11T07:06:03.141 INFO:teuthology.orchestra.run.smithi079.stdout:123 trunc from 0x8ac28c0 to 0x870278b 2024-09-11T07:06:03.154 INFO:teuthology.orchestra.run.smithi079.stdout:124 trunc from 0x870278b to 0xaa59dbd 2024-09-11T07:06:03.162 INFO:teuthology.orchestra.run.smithi079.stdout:126 read 0x7caefdd thru 0x7cb3173 (0x4197 bytes) 2024-09-11T07:06:03.163 INFO:teuthology.orchestra.run.smithi079.stdout:127 write 0x413c125 thru 0x4144cfa (0x8bd6 bytes) 2024-09-11T07:06:03.170 INFO:teuthology.orchestra.run.smithi079.stdout:128 write 0x33e95a2 thru 0x33f5b93 (0xc5f2 bytes) 2024-09-11T07:06:03.172 INFO:teuthology.orchestra.run.smithi079.stdout:133 writesame 0x77447e0 thru 0x77480c1 data_size 0x3(0x38e2 bytes) 2024-09-11T07:06:03.177 INFO:teuthology.orchestra.run.smithi079.stdout:134 read 0x8836953 thru 0x8836cb5 (0x363 bytes) 2024-09-11T07:06:03.178 INFO:teuthology.orchestra.run.smithi079.stdout:135 trunc from 0xaa59dbd to 0xa352b3c 2024-09-11T07:06:03.188 INFO:teuthology.orchestra.run.smithi079.stdout:138 read 0x8175024 thru 0x817cfb7 (0x7f94 bytes) 2024-09-11T07:06:03.203 INFO:teuthology.orchestra.run.smithi079.stdout:139 writesame 0xb77410c thru 0xb77a61d data_size 0x11(0x6512 bytes) 2024-09-11T07:06:03.203 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.203 INFO:teuthology.orchestra.run.smithi079.stdout:142 read 0x6b1f7ba thru 0x6b1fdc4 (0x60b bytes) 2024-09-11T07:06:03.203 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.206 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:03.204+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:03.207 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:06:03.225 INFO:teuthology.orchestra.run.smithi079.stdout:144 write 0xdb65862 thru 0xdb741cc (0xe96b bytes) 2024-09-11T07:06:03.232 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.232 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:03.232 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:03.237 INFO:teuthology.orchestra.run.smithi079.stdout:146 trunc from 0xdb741cd to 0x8be5098 2024-09-11T07:06:03.247 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:03.257 INFO:teuthology.orchestra.run.smithi079.stdout:147 punch from 0x2f5af6a to 0x2f623b0, (0x7446 bytes) 2024-09-11T07:06:03.257 INFO:teuthology.orchestra.run.smithi079.stdout:148 read 0x70f5f7a thru 0x71017a7 (0xb82e bytes) 2024-09-11T07:06:03.258 INFO:teuthology.orchestra.run.smithi079.stdout:149 punch from 0x13611a0 to 0x1370ddf, (0xfc3f bytes) 2024-09-11T07:06:03.258 INFO:teuthology.orchestra.run.smithi079.stdout:151 read 0x820563c thru 0x820c590 (0x6f55 bytes) 2024-09-11T07:06:03.258 INFO:teuthology.orchestra.run.smithi079.stdout:152 write 0x4115602 thru 0x41206b9 (0xb0b8 bytes) 2024-09-11T07:06:03.261 INFO:teuthology.orchestra.run.smithi079.stdout:154 writesame 0x35a4a9e thru 0x35a59cf data_size 0x5(0xf32 bytes) 2024-09-11T07:06:03.267 INFO:teuthology.orchestra.run.smithi079.stdout:156 write 0x625a4d3 thru 0x625e9b1 (0x44df bytes) 2024-09-11T07:06:03.269 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.269 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.281 INFO:teuthology.orchestra.run.smithi079.stdout:161 write 0xa99ebfe thru 0xa9a5009 (0x640c bytes) 2024-09-11T07:06:03.290 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.290 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.290 INFO:teuthology.orchestra.run.smithi079.stdout:165 read 0x1e10b57 thru 0x1e1c478 (0xb922 bytes) 2024-09-11T07:06:03.292 INFO:teuthology.orchestra.run.smithi079.stdout:167 writesame 0x77011f0 thru 0x7710dc1 data_size 0x1(0xfbd2 bytes) 2024-09-11T07:06:03.336 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:03.334+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:03.355 INFO:teuthology.orchestra.run.smithi079.stdout:169 punch from 0x42bd394 to 0x42c82bf, (0xaf2b bytes) 2024-09-11T07:06:03.356 INFO:teuthology.orchestra.run.smithi079.stdout:170 read 0x3ea8f12 thru 0x3eb611d (0xd20c bytes) 2024-09-11T07:06:03.356 INFO:teuthology.orchestra.run.smithi079.stdout:172 read 0x4d1da94 thru 0x4d2bbd9 (0xe146 bytes) 2024-09-11T07:06:03.356 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.356 INFO:teuthology.orchestra.run.smithi079.stdout:174 write 0x310a7cd thru 0x3113765 (0x8f99 bytes) 2024-09-11T07:06:03.360 INFO:teuthology.orchestra.run.smithi079.stdout:177 write 0x9fb6c3d thru 0x9fc36f1 (0xcab5 bytes) 2024-09-11T07:06:03.366 INFO:teuthology.orchestra.run.smithi079.stdout:179 read 0x5757f96 thru 0x5762903 (0xa96e bytes) 2024-09-11T07:06:03.366 INFO:teuthology.orchestra.run.smithi079.stdout:180 punch from 0x4990f09 to 0x4999c04, (0x8cfb bytes) 2024-09-11T07:06:03.367 INFO:teuthology.orchestra.run.smithi079.stdout:181 read 0x94ac2dc thru 0x94b09d6 (0x46fb bytes) 2024-09-11T07:06:03.367 INFO:teuthology.orchestra.run.smithi079.stdout:182 write 0x3a277fb thru 0x3a2eadf (0x72e5 bytes) 2024-09-11T07:06:03.370 INFO:teuthology.orchestra.run.smithi079.stdout:183 read 0x4de1a6 thru 0x4e4a71 (0x68cc bytes) 2024-09-11T07:06:03.371 INFO:teuthology.orchestra.run.smithi079.stdout:184 read 0x7f57071 thru 0x7f59b87 (0x2b17 bytes) 2024-09-11T07:06:03.371 INFO:teuthology.orchestra.run.smithi079.stdout:185 writesame 0x4026e3d thru 0x402dbbd data_size 0x11(0x6d81 bytes) 2024-09-11T07:06:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:186 read 0x520efa thru 0x52dbb8 (0xccbf bytes) 2024-09-11T07:06:03.376 INFO:teuthology.orchestra.run.smithi079.stdout:187 write 0x6fc4e18 thru 0x6fc90bd (0x42a6 bytes) 2024-09-11T07:06:03.383 INFO:teuthology.orchestra.run.smithi079.stdout:188 write 0x4165058 thru 0x416f413 (0xa3bc bytes) 2024-09-11T07:06:03.387 INFO:teuthology.orchestra.run.smithi079.stdout:192 write 0x7b27dfd thru 0x7b2abf2 (0x2df6 bytes) 2024-09-11T07:06:03.409 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:03.408+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:03.409 INFO:teuthology.orchestra.run.smithi079.stdout:193 trunc from 0xa9a500a to 0x3923d3d 2024-09-11T07:06:03.423 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:03.423 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:03.440 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:03.442 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.442 INFO:teuthology.orchestra.run.smithi079.stdout:195 read 0x258ddd thru 0x25d29e (0x44c2 bytes) 2024-09-11T07:06:03.442 INFO:teuthology.orchestra.run.smithi079.stdout:196 punch from 0x298599f to 0x29914d1, (0xbb32 bytes) 2024-09-11T07:06:03.442 INFO:teuthology.orchestra.run.smithi079.stdout:197 read 0xaa4d8a thru 0xaaa278 (0x54ef bytes) 2024-09-11T07:06:03.443 INFO:teuthology.orchestra.run.smithi079.stdout:198 read 0x163d857 thru 0x164ae43 (0xd5ed bytes) 2024-09-11T07:06:03.444 INFO:teuthology.orchestra.run.smithi079.stdout:201 writesame 0x22845d3 thru 0x229205a data_size 0x15(0xda88 bytes) 2024-09-11T07:06:03.462 INFO:teuthology.orchestra.run.smithi079.stdout:203 write 0x4bd882f thru 0x4bd9c23 (0x13f5 bytes) 2024-09-11T07:06:03.503 INFO:teuthology.orchestra.run.smithi079.stdout:204 writesame 0xe30cef4 thru 0xe31a78a data_size 0x7(0xd897 bytes) 2024-09-11T07:06:03.503 INFO:teuthology.orchestra.run.smithi079.stdout:205 writesame 0xaac9914 thru 0xaacaff3 data_size 0x18(0x16e0 bytes) 2024-09-11T07:06:03.508 INFO:teuthology.orchestra.run.smithi079.stdout:206 punch from 0x8a30a1 to 0x8b16fb, (0xe65a bytes) 2024-09-11T07:06:03.508 INFO:teuthology.orchestra.run.smithi079.stdout:207 read 0x724507f thru 0x7246717 (0x1699 bytes) 2024-09-11T07:06:03.508 INFO:teuthology.orchestra.run.smithi079.stdout:208 writesame 0x3e3b7b0 thru 0x3e4afe0 data_size 0x1(0xf831 bytes) 2024-09-11T07:06:03.509 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:03.508+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:03.545 INFO:teuthology.orchestra.run.smithi079.stdout:210 punch from 0x6bfc9c2 to 0x6c063f2, (0x9a30 bytes) 2024-09-11T07:06:03.560 INFO:teuthology.orchestra.run.smithi079.stdout:212 trunc from 0xe31a78b to 0x8d26a84 2024-09-11T07:06:03.577 INFO:teuthology.orchestra.run.smithi079.stdout:213 write 0x5bfb25d thru 0x5c07850 (0xc5f4 bytes) 2024-09-11T07:06:03.599 INFO:teuthology.orchestra.run.smithi079.stdout:218 write 0x934512a thru 0x934f5f3 (0xa4ca bytes) 2024-09-11T07:06:03.605 INFO:teuthology.orchestra.run.smithi079.stdout:219 read 0x7c9e910 thru 0x7ca3e51 (0x5542 bytes) 2024-09-11T07:06:03.606 INFO:teuthology.orchestra.run.smithi079.stdout:220 trunc from 0x934f5f4 to 0x8e15931 2024-09-11T07:06:03.610 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:03.608+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:03.619 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:03.619 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:03.623 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.633 INFO:teuthology.orchestra.run.smithi079.stdout:222 write 0x9069d21 thru 0x9071f87 (0x8267 bytes) 2024-09-11T07:06:03.635 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:03.638 INFO:teuthology.orchestra.run.smithi079.stdout:224 punch from 0xeaf536 to 0xeaf86f, (0x339 bytes) 2024-09-11T07:06:03.660 INFO:teuthology.orchestra.run.smithi079.stdout:225 write 0xe4a4079 thru 0xe4afce3 (0xbc6b bytes) 2024-09-11T07:06:03.665 INFO:teuthology.orchestra.run.smithi079.stdout:226 read 0x3acb135 thru 0x3ad3737 (0x8603 bytes) 2024-09-11T07:06:03.665 INFO:teuthology.orchestra.run.smithi079.stdout:227 read 0x308f862 thru 0x309db9b (0xe33a bytes) 2024-09-11T07:06:03.667 INFO:teuthology.orchestra.run.smithi079.stdout:229 read 0x4542c8 thru 0x45c1a0 (0x7ed9 bytes) 2024-09-11T07:06:03.667 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.667 INFO:teuthology.orchestra.run.smithi079.stdout:232 read 0xa4d338e thru 0xa4d9cd6 (0x6949 bytes) 2024-09-11T07:06:03.667 INFO:teuthology.orchestra.run.smithi079.stdout:233 punch from 0xc12d8c4 to 0xc12fd8e, (0x24ca bytes) 2024-09-11T07:06:03.667 INFO:teuthology.orchestra.run.smithi079.stdout:234 read 0xbd66a45 thru 0xbd767a4 (0xfd60 bytes) 2024-09-11T07:06:03.668 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.691 INFO:teuthology.orchestra.run.smithi079.stdout:236 trunc from 0xe4afce4 to 0x4dc19c7 2024-09-11T07:06:03.710 INFO:teuthology.orchestra.run.smithi079.stdout:237 write 0x30fe329 thru 0x310a296 (0xbf6e bytes) 2024-09-11T07:06:03.710 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:03.706+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:03.713 INFO:teuthology.orchestra.run.smithi079.stdout:238 read 0x459180c thru 0x4599a57 (0x824c bytes) 2024-09-11T07:06:03.714 INFO:teuthology.orchestra.run.smithi079.stdout:239 punch from 0x2fdb1c8 to 0x2fe63b4, (0xb1ec bytes) 2024-09-11T07:06:03.729 INFO:teuthology.orchestra.run.smithi079.stdout:240 writesame 0x649684f thru 0x64a63c7 data_size 0x45(0xfb79 bytes) 2024-09-11T07:06:03.730 INFO:teuthology.orchestra.run.smithi079.stdout:244 trunc from 0x64a63c8 to 0x6111eef 2024-09-11T07:06:03.764 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:03.764 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:03.765 INFO:teuthology.orchestra.run.smithi079.stdout:245 writesame 0xbbb8dc1 thru 0xbbc421e data_size 0x1(0xb45e bytes) 2024-09-11T07:06:03.778 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:03.784 INFO:teuthology.orchestra.run.smithi079.stdout:246 trunc from 0xbbc421f to 0x41bc0b2 2024-09-11T07:06:03.820 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:03.818+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:03.833 INFO:teuthology.orchestra.run.smithi079.stdout:247 writesame 0xccf14dd thru 0xccf2113 data_size 0x1(0xc37 bytes) 2024-09-11T07:06:03.844 INFO:teuthology.orchestra.run.smithi079.stdout:248 write 0xe1209f5 thru 0xe1290d0 (0x86dc bytes) 2024-09-11T07:06:03.848 INFO:teuthology.orchestra.run.smithi079.stdout:249 punch from 0xc42d785 to 0xc435ca9, (0x8524 bytes) 2024-09-11T07:06:03.854 INFO:teuthology.orchestra.run.smithi079.stdout:252 trunc from 0xe1290d1 to 0xb90ed01 2024-09-11T07:06:03.869 INFO:teuthology.orchestra.run.smithi079.stdout:253 writesame 0xb1c3008 thru 0xb1cc612 data_size 0x1(0x960b bytes) 2024-09-11T07:06:03.912 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:03.910+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:03.933 INFO:teuthology.orchestra.run.smithi079.stdout:254 writesame 0xdbbb663 thru 0xdbbe0d5 data_size 0x1(0x2a73 bytes) 2024-09-11T07:06:03.933 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.933 INFO:teuthology.orchestra.run.smithi079.stdout:256 read 0x4235ebe thru 0x42432d3 (0xd416 bytes) 2024-09-11T07:06:03.933 INFO:teuthology.orchestra.run.smithi079.stdout:257 read 0x7208e68 thru 0x7210076 (0x720f bytes) 2024-09-11T07:06:03.933 INFO:teuthology.orchestra.run.smithi079.stdout:260 read 0x8c4ded3 thru 0x8c4e535 (0x663 bytes) 2024-09-11T07:06:03.947 INFO:teuthology.orchestra.run.smithi079.stdout:262 writesame 0xe2ba9be thru 0xe2c069b data_size 0x1(0x5cde bytes) 2024-09-11T07:06:03.948 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:03.948 INFO:teuthology.orchestra.run.smithi079.stdout:265 read 0xdd561f4 thru 0xdd6061b (0xa428 bytes) 2024-09-11T07:06:03.948 INFO:teuthology.orchestra.run.smithi079.stdout:267 read 0xa618faf thru 0xa620c61 (0x7cb3 bytes) 2024-09-11T07:06:03.948 INFO:teuthology.orchestra.run.smithi079.stdout:268 write 0xd662c38 thru 0xd66f197 (0xc560 bytes) 2024-09-11T07:06:03.950 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:03.950 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:03.956 INFO:teuthology.orchestra.run.smithi079.stdout:269 writesame 0x21d7485 thru 0x21d80e6 data_size 0x5(0xc62 bytes) 2024-09-11T07:06:03.959 INFO:teuthology.orchestra.run.smithi079.stdout:271 read 0x183f1f0 thru 0x18403de (0x11ef bytes) 2024-09-11T07:06:03.960 INFO:teuthology.orchestra.run.smithi079.stdout:273 read 0xc82ec4a thru 0xc833c8b (0x5042 bytes) 2024-09-11T07:06:03.960 INFO:teuthology.orchestra.run.smithi079.stdout:277 read 0x685b5b4 thru 0x6861800 (0x624d bytes) 2024-09-11T07:06:03.964 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:03.970 INFO:teuthology.orchestra.run.smithi079.stdout:279 trunc from 0xe2c069c to 0xa8f9043 2024-09-11T07:06:03.989 INFO:teuthology.orchestra.run.smithi079.stdout:280 read 0x61aa05f thru 0x61b9359 (0xf2fb bytes) 2024-09-11T07:06:03.989 INFO:teuthology.orchestra.run.smithi079.stdout:281 read 0x840fd6 thru 0x84e315 (0xd340 bytes) 2024-09-11T07:06:03.989 INFO:teuthology.orchestra.run.smithi079.stdout:282 read 0x4834171 thru 0x483eade (0xa96e bytes) 2024-09-11T07:06:03.990 INFO:teuthology.orchestra.run.smithi079.stdout:283 write 0x808b503 thru 0x808ec39 (0x3737 bytes) 2024-09-11T07:06:04.013 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:04.012+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:04.015 INFO:teuthology.orchestra.run.smithi079.stdout:285 trunc from 0xa8f9043 to 0x376c7e6 2024-09-11T07:06:04.034 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:04.050 INFO:teuthology.orchestra.run.smithi079.stdout:287 writesame 0x5d2fb15 thru 0x5d3bdab data_size 0x51(0xc297 bytes) 2024-09-11T07:06:04.050 INFO:teuthology.orchestra.run.smithi079.stdout:288 read 0x49b5a0b thru 0x49b7813 (0x1e09 bytes) 2024-09-11T07:06:04.062 INFO:teuthology.orchestra.run.smithi079.stdout:289 write 0x730ee40 thru 0x7314306 (0x54c7 bytes) 2024-09-11T07:06:04.069 INFO:teuthology.orchestra.run.smithi079.stdout:292 read 0x352775b thru 0x3534400 (0xcca6 bytes) 2024-09-11T07:06:04.070 INFO:teuthology.orchestra.run.smithi079.stdout:293 write 0x50c363e thru 0x50d338f (0xfd52 bytes) 2024-09-11T07:06:04.076 INFO:teuthology.orchestra.run.smithi079.stdout:294 writesame 0x4cc049d thru 0x4cc5089 data_size 0x39(0x4bed bytes) 2024-09-11T07:06:04.083 INFO:teuthology.orchestra.run.smithi079.stdout:295 read 0x118561e thru 0x1188ee4 (0x38c7 bytes) 2024-09-11T07:06:04.084 INFO:teuthology.orchestra.run.smithi079.stdout:296 write 0x555dc79 thru 0x55678a4 (0x9c2c bytes) 2024-09-11T07:06:04.090 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:04.090 INFO:teuthology.orchestra.run.smithi079.stdout:301 read 0x2ddb852 thru 0x2ddcc31 (0x13e0 bytes) 2024-09-11T07:06:04.090 INFO:teuthology.orchestra.run.smithi079.stdout:302 read 0x302924e thru 0x302aaec (0x189f bytes) 2024-09-11T07:06:04.091 INFO:teuthology.orchestra.run.smithi079.stdout:303 read 0x3d6175f thru 0x3d6a6d7 (0x8f79 bytes) 2024-09-11T07:06:04.091 INFO:teuthology.orchestra.run.smithi079.stdout:304 read 0x121aa37 thru 0x12275e1 (0xcbab bytes) 2024-09-11T07:06:04.092 INFO:teuthology.orchestra.run.smithi079.stdout:305 write 0x525185 thru 0x52c93b (0x77b7 bytes) 2024-09-11T07:06:04.104 INFO:teuthology.orchestra.run.smithi079.stdout:307 trunc from 0x7314307 to 0x5423205 2024-09-11T07:06:04.114 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:04.110+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:04.140 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:04.140 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:04.154 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:04.161 INFO:teuthology.orchestra.run.smithi079.stdout:309 write 0xc0dcc91 thru 0xc0dddc7 (0x1137 bytes) 2024-09-11T07:06:04.168 INFO:teuthology.orchestra.run.smithi079.stdout:310 write 0x61cbcbe thru 0x61d9c5a (0xdf9d bytes) 2024-09-11T07:06:04.175 INFO:teuthology.orchestra.run.smithi079.stdout:311 write 0xb7714ff thru 0xb77dfb0 (0xcab2 bytes) 2024-09-11T07:06:04.181 INFO:teuthology.orchestra.run.smithi079.stdout:312 punch from 0x4c28e72 to 0x4c2ef60, (0x60ee bytes) 2024-09-11T07:06:04.212 INFO:teuthology.orchestra.run.smithi079.stdout:314 trunc from 0xc0dddc8 to 0x787886 2024-09-11T07:06:04.239 INFO:teuthology.orchestra.run.smithi079.stdout:315 punch from 0x296376 to 0x2977c9, (0x1453 bytes) 2024-09-11T07:06:04.259 INFO:teuthology.orchestra.run.smithi079.stdout:317 punch from 0x348229 to 0x350772, (0x8549 bytes) 2024-09-11T07:06:04.259 INFO:teuthology.orchestra.run.smithi079.stdout:318 punch from 0x46c0db to 0x46e1d5, (0x20fa bytes) 2024-09-11T07:06:04.259 INFO:teuthology.orchestra.run.smithi079.stdout:319 punch from 0x589746 to 0x58e848, (0x5102 bytes) 2024-09-11T07:06:04.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:04.260 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:04.238+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:04.285 INFO:teuthology.orchestra.run.smithi079.stdout:320 write 0xe9912f7 thru 0xe99a53f (0x9249 bytes) 2024-09-11T07:06:04.294 INFO:teuthology.orchestra.run.smithi079.stdout:321 trunc from 0xe99a540 to 0xdce47d6 2024-09-11T07:06:04.313 INFO:teuthology.orchestra.run.smithi079.stdout:322 read 0x96439c thru 0x965fe4 (0x1c49 bytes) 2024-09-11T07:06:04.313 INFO:teuthology.orchestra.run.smithi079.stdout:324 write 0xb7e325d thru 0xb7f1fc6 (0xed6a bytes) 2024-09-11T07:06:04.316 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:04.316+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:04.327 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:04.327 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:04.341 INFO:teuthology.orchestra.run.smithi079.stdout:326 trunc from 0xdce47d6 to 0x7dd7bf 2024-09-11T07:06:04.342 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:04.358 INFO:teuthology.orchestra.run.smithi079.stdout:327 read 0x69c985 thru 0x6a97cd (0xce49 bytes) 2024-09-11T07:06:04.384 INFO:teuthology.orchestra.run.smithi079.stdout:328 trunc from 0x7dd7bf to 0xe102e23 2024-09-11T07:06:04.393 INFO:teuthology.orchestra.run.smithi079.stdout:329 trunc from 0xe102e23 to 0xcf274b7 2024-09-11T07:06:04.401 INFO:teuthology.orchestra.run.smithi079.stdout:331 punch from 0x8e2e314 to 0x8e37efc, (0x9be8 bytes) 2024-09-11T07:06:04.401 INFO:teuthology.orchestra.run.smithi079.stdout:332 writesame 0x8eb9534 thru 0x8ec7517 data_size 0xa1(0xdfe4 bytes) 2024-09-11T07:06:04.405 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:04.415 INFO:teuthology.orchestra.run.smithi079.stdout:334 trunc from 0xcf274b7 to 0x61f3a44 2024-09-11T07:06:04.424 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:04.425 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:04.427 INFO:teuthology.orchestra.run.smithi079.stdout:335 read 0x25701ba thru 0x257fc71 (0xfab8 bytes) 2024-09-11T07:06:04.428 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:04.428 INFO:teuthology.orchestra.run.smithi079.stdout:339 punch from 0xb003a6 to 0xb07013, (0x6c6d bytes) 2024-09-11T07:06:04.428 INFO:teuthology.orchestra.run.smithi079.stdout:340 read 0x60b852e thru 0x60bfca7 (0x777a bytes) 2024-09-11T07:06:04.428 INFO:teuthology.orchestra.run.smithi079.stdout:341 writesame 0x36bfd thru 0x4041e data_size 0x3(0x9822 bytes) 2024-09-11T07:06:04.428 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:04.426+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:04.436 INFO:teuthology.orchestra.run.smithi079.stdout:343 read 0x1ea077d thru 0x1ea7e8b (0x770f bytes) 2024-09-11T07:06:04.436 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:04.442 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:04.442 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:04.448 INFO:teuthology.orchestra.run.smithi079.stdout:345 write 0x9663f67 thru 0x96644f0 (0x58a bytes) 2024-09-11T07:06:04.452 INFO:teuthology.orchestra.run.smithi079.stdout:346 read 0x86cf9f6 thru 0x86d2a73 (0x307e bytes) 2024-09-11T07:06:04.452 INFO:teuthology.orchestra.run.smithi079.stdout:347 read 0x177ceb7 thru 0x1786dc7 (0x9f11 bytes) 2024-09-11T07:06:04.459 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:04.460 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:04.466 INFO:teuthology.orchestra.run.smithi079.stdout:348 writesame 0xdd46dfc thru 0xdd4b192 data_size 0x1(0x4397 bytes) 2024-09-11T07:06:04.466 INFO:teuthology.orchestra.run.smithi079.stdout:350 punch from 0x37ce29d to 0x37ddf55, (0xfcb8 bytes) 2024-09-11T07:06:04.466 INFO:teuthology.orchestra.run.smithi079.stdout:351 read 0x8c0160b thru 0x8c113b0 (0xfda6 bytes) 2024-09-11T07:06:04.466 INFO:teuthology.orchestra.run.smithi079.stdout:354 write 0xcffd9c6 thru 0xd009014 (0xb64f bytes) 2024-09-11T07:06:04.471 INFO:teuthology.orchestra.run.smithi079.stdout:355 writesame 0x5bff950 thru 0x5c05888 data_size 0x1(0x5f39 bytes) 2024-09-11T07:06:04.479 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:04.479 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:04.489 INFO:teuthology.orchestra.run.smithi079.stdout:356 punch from 0x8e816aa to 0x8e8d96a, (0xc2c0 bytes) 2024-09-11T07:06:04.489 INFO:teuthology.orchestra.run.smithi079.stdout:359 punch from 0xb070608 to 0xb07eaa3, (0xe49b bytes) 2024-09-11T07:06:04.489 INFO:teuthology.orchestra.run.smithi079.stdout:361 write 0xa854bc thru 0xa9365e (0xe1a3 bytes) 2024-09-11T07:06:04.496 INFO:teuthology.orchestra.run.smithi079.stdout:362 read 0x126b399 thru 0x126e7ca (0x3432 bytes) 2024-09-11T07:06:04.496 INFO:teuthology.orchestra.run.smithi079.stdout:364 write 0xcca5014 thru 0xccaf716 (0xa703 bytes) 2024-09-11T07:06:04.497 INFO:teuthology.orchestra.run.smithi079.stdout:365 read 0x1b0e5ca thru 0x1b1a1d9 (0xbc10 bytes) 2024-09-11T07:06:04.498 INFO:teuthology.orchestra.run.smithi079.stdout:366 read 0x40966b6 thru 0x40981ec (0x1b37 bytes) 2024-09-11T07:06:04.498 INFO:teuthology.orchestra.run.smithi079.stdout:367 punch from 0xd47c335 to 0xd47c8fa, (0x5c5 bytes) 2024-09-11T07:06:04.498 INFO:teuthology.orchestra.run.smithi079.stdout:368 write 0xa3812f6 thru 0xa38e4b5 (0xd1c0 bytes) 2024-09-11T07:06:04.501 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:04.502 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:04.509 INFO:teuthology.orchestra.run.smithi079.stdout:369 trunc from 0xdd4b193 to 0xa89f997 2024-09-11T07:06:04.511 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:04.511 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:04.517 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:04.516+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:04.523 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:04.524 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:04.524 INFO:teuthology.orchestra.run.smithi079.stdout:370 read 0xd046ee thru 0xd0878a (0x409d bytes) 2024-09-11T07:06:04.527 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:04.533 INFO:teuthology.orchestra.run.smithi079.stdout:371 write 0xc8d9725 thru 0xc8e808f (0xe96b bytes) 2024-09-11T07:06:04.538 INFO:teuthology.orchestra.run.smithi079.stdout:374 read 0xbf13bd8 thru 0xbf1c557 (0x8980 bytes) 2024-09-11T07:06:04.538 INFO:teuthology.orchestra.run.smithi079.stdout:375 read 0xb4bde7 thru 0xb4fe51 (0x406b bytes) 2024-09-11T07:06:04.539 INFO:teuthology.orchestra.run.smithi079.stdout:376 read 0x9c886c7 thru 0x9c98447 (0xfd81 bytes) 2024-09-11T07:06:04.539 INFO:teuthology.orchestra.run.smithi079.stdout:377 write 0x59773b5 thru 0x597aaaa (0x36f6 bytes) 2024-09-11T07:06:04.540 INFO:teuthology.orchestra.run.smithi079.stdout:378 read 0x52db80a thru 0x52e1bd5 (0x63cc bytes) 2024-09-11T07:06:04.541 INFO:teuthology.orchestra.run.smithi079.stdout:379 write 0x1711f3f thru 0x1720733 (0xe7f5 bytes) 2024-09-11T07:06:04.543 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:04.543 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:04.545 INFO:teuthology.orchestra.run.smithi079.stdout:380 read 0x5490e7f thru 0x5498298 (0x741a bytes) 2024-09-11T07:06:04.545 INFO:teuthology.orchestra.run.smithi079.stdout:381 punch from 0x18661c1 to 0x1873625, (0xd464 bytes) 2024-09-11T07:06:04.546 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:04.554 INFO:teuthology.orchestra.run.smithi079.stdout:383 trunc from 0xc8e8090 to 0x6e00b5b 2024-09-11T07:06:04.562 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:04.562 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:04.575 INFO:teuthology.orchestra.run.smithi079.stdout:384 write 0x6e9b56b thru 0x6ea83c4 (0xce5a bytes) 2024-09-11T07:06:04.580 INFO:teuthology.orchestra.run.smithi079.stdout:385 punch from 0x29e061d to 0x29efbc7, (0xf5aa bytes) 2024-09-11T07:06:04.580 INFO:teuthology.orchestra.run.smithi079.stdout:386 read 0x4a5fa60 thru 0x4a62c11 (0x31b2 bytes) 2024-09-11T07:06:04.580 INFO:teuthology.orchestra.run.smithi079.stdout:388 write 0x1f3a866 thru 0x1f49d55 (0xf4f0 bytes) 2024-09-11T07:06:04.585 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:04.600 INFO:teuthology.orchestra.run.smithi079.stdout:390 write 0xb69b69b thru 0xb6a41cc (0x8b32 bytes) 2024-09-11T07:06:04.603 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:04.604 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:04.620 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:04.618+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:04.620 INFO:teuthology.orchestra.run.smithi079.stdout:393 trunc from 0xb6a41cd to 0xe6b59b 2024-09-11T07:06:04.666 INFO:teuthology.orchestra.run.smithi079.stdout:394 write 0xada8ac4 thru 0xadaddbe (0x52fb bytes) 2024-09-11T07:06:04.672 INFO:teuthology.orchestra.run.smithi079.stdout:395 punch from 0x8452e20 to 0x845e447, (0xb627 bytes) 2024-09-11T07:06:04.672 INFO:teuthology.orchestra.run.smithi079.stdout:truncating to largest ever: 0xe5911a2 2024-09-11T07:06:04.677 INFO:teuthology.orchestra.run.smithi079.stdout:396 trunc from 0xadaddbf to 0xe5911a2 2024-09-11T07:06:04.689 INFO:teuthology.orchestra.run.smithi079.stdout:397 write 0xe477345 thru 0xe47cf94 (0x5c50 bytes) 2024-09-11T07:06:04.695 INFO:teuthology.orchestra.run.smithi079.stdout:398 punch from 0xcb91871 to 0xcb9a89f, (0x902e bytes) 2024-09-11T07:06:04.695 INFO:teuthology.orchestra.run.smithi079.stdout:399 write 0x47cf4fb thru 0x47d7cb9 (0x87bf bytes) 2024-09-11T07:06:04.697 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:04.697 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:04.698 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [] 2024-09-11T07:06:04.698 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:04.701 INFO:teuthology.orchestra.run.smithi079.stdout:400 writesame 0x81755c6 thru 0x817d6bd data_size 0x4(0x80f8 bytes) 2024-09-11T07:06:04.713 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:04.716 INFO:teuthology.orchestra.run.smithi079.stdout:402 writesame 0x156af3d thru 0x157a12e data_size 0x6f(0xf1f2 bytes) 2024-09-11T07:06:04.723 INFO:teuthology.orchestra.run.smithi079.stdout:403 write 0x25eaed6 thru 0x25f9360 (0xe48b bytes) 2024-09-11T07:06:04.752 INFO:teuthology.orchestra.run.smithi079.stdout:405 trunc from 0xe5911a2 to 0x5747ab4 2024-09-11T07:06:04.756 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:04.754+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:04.771 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:04.771 INFO:teuthology.orchestra.run.smithi079.stdout:407 punch from 0x3463244 to 0x346d0fb, (0x9eb7 bytes) 2024-09-11T07:06:04.785 INFO:teuthology.orchestra.run.smithi079.stdout:410 write 0x72683c9 thru 0x7269da3 (0x19db bytes) 2024-09-11T07:06:04.791 INFO:teuthology.orchestra.run.smithi079.stdout:411 read 0x707561d thru 0x7081685 (0xc069 bytes) 2024-09-11T07:06:04.792 INFO:teuthology.orchestra.run.smithi079.stdout:412 clone 1 order 23 su 524288 sc 14 2024-09-11T07:06:04.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:04.820+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:04.881 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:04.881 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:04.881 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:04.881 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:04.895 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:04.944 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:04.942+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:05.020 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:05.020 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:05.023 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:05.024+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:05.034 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:05.124 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:05.122+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:05.204 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:05.204 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.132756690000001, 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.205 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:06:05.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:06:05.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:06:05.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:06:05.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:06:05.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:06:05.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:06:05.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:06:05.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:06:05.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:06:05.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:06:05.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:06:05.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:06:05.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:85 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940473+0000", 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.260592942999999, 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010826193, 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.213 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 85 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940473+0000", 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940473+0000", 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940475+0000", 2024-09-11T07:06:05.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7600000000000001e-06 2024-09-11T07:06:05.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940486+0000", 2024-09-11T07:06:05.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1156e-05 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940506+0000", 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9925999999999999e-05 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940522+0000", 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5457000000000001e-05 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.943943+0000", 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034213609999999999 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.944183+0000", 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240385 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.944540+0000", 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035704399999999999 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950870+0000", 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063301140000000004 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950981+0000", 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011061300000000001 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951136+0000", 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015498500000000001 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951299+0000", 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000163392 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940545+0000", 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.260520907, 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011233303, 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 86 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.220 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940545+0000", 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940545+0000", 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940547+0000", 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3999999999999999e-06 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940557+0000", 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0566e-05 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940581+0000", 2024-09-11T07:06:05.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4066999999999998e-05 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940599+0000", 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.802e-05 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.945443+0000", 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048435459999999998 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.945699+0000", 2024-09-11T07:06:05.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025649199999999998 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.946048+0000", 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034892000000000001 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950883+0000", 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048349789999999997 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951603+0000", 2024-09-11T07:06:05.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00072007799999999997 2024-09-11T07:06:05.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951681+0000", 2024-09-11T07:06:05.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8002000000000003e-05 2024-09-11T07:06:05.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951779+0000", 2024-09-11T07:06:05.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7232999999999996e-05 2024-09-11T07:06:05.226 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.226 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.227 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.227 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.227 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940649+0000", 2024-09-11T07:06:05.227 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.260417012000001, 2024-09-11T07:06:05.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012003827999999999, 2024-09-11T07:06:05.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.228 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87 2024-09-11T07:06:05.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.229 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940649+0000", 2024-09-11T07:06:05.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940649+0000", 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940651+0000", 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.73e-06 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940781+0000", 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013028900000000001 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940839+0000", 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7813999999999999e-05 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940856+0000", 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7462999999999999e-05 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.946932+0000", 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060756860000000003 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.947149+0000", 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021673499999999999 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.947520+0000", 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037156800000000002 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950893+0000", 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033723199999999998 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.952399+0000", 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015064519999999999 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.952549+0000", 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014964199999999999 2024-09-11T07:06:05.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.952653+0000", 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010412900000000001 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940888+0000", 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.260178156999999, 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012343412, 2024-09-11T07:06:05.234 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 88 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940888+0000", 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940888+0000", 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940890+0000", 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.81e-06 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940902+0000", 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2207e-05 2024-09-11T07:06:05.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940923+0000", 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0866e-05 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940956+0000", 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3189999999999999e-05 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.949744+0000", 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008788176 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.949873+0000", 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129085 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950072+0000", 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019907900000000001 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951334+0000", 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012619269999999999 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.953038+0000", 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017033370000000001 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.953124+0000", 2024-09-11T07:06:05.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5835999999999996e-05 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.953231+0000", 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107899 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.240 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104385+0000", 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.096681399000001, 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011221050999999999, 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.241 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104385+0000", 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104385+0000", 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104386+0000", 2024-09-11T07:06:05.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2869999999999999e-06 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104478+0000", 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1875999999999999e-05 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104494+0000", 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6327000000000001e-05 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104503+0000", 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1859999999999998e-06 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.112017+0000", 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0075131690000000001 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.112142+0000", 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000125683 2024-09-11T07:06:05.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.112347+0000", 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020447799999999999 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114485+0000", 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021379569999999998 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115419+0000", 2024-09-11T07:06:05.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00093446899999999995 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115496+0000", 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6353000000000006e-05 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115606+0000", 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110266 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104521+0000", 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.096545002999999, 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014408172, 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 110 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.247 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104521+0000", 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104521+0000", 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104522+0000", 2024-09-11T07:06:05.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0860000000000001e-06 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104531+0000", 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3999999999999992e-06 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104541+0000", 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0277e-05 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104548+0000", 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3100000000000003e-06 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114581+0000", 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01003277 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114706+0000", 2024-09-11T07:06:05.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124902 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114894+0000", 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018778800000000001 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118539+0000", 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003645279 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118689+0000", 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000150345 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118763+0000", 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3720000000000006e-05 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118929+0000", 2024-09-11T07:06:05.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016629500000000001 2024-09-11T07:06:05.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.253 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.253 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.253 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.253 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104561+0000", 2024-09-11T07:06:05.253 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.096505057000002, 2024-09-11T07:06:05.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014554475000000001, 2024-09-11T07:06:05.253 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.254 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.254 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.254 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.254 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.254 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.254 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 111 2024-09-11T07:06:05.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.255 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104561+0000", 2024-09-11T07:06:05.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104561+0000", 2024-09-11T07:06:05.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104562+0000", 2024-09-11T07:06:05.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4399999999999999e-07 2024-09-11T07:06:05.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104571+0000", 2024-09-11T07:06:05.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000005e-06 2024-09-11T07:06:05.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104581+0000", 2024-09-11T07:06:05.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6760000000000002e-06 2024-09-11T07:06:05.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104588+0000", 2024-09-11T07:06:05.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1169999999999998e-06 2024-09-11T07:06:05.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115711+0000", 2024-09-11T07:06:05.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011123141 2024-09-11T07:06:05.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115986+0000", 2024-09-11T07:06:05.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027494800000000001 2024-09-11T07:06:05.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.116341+0000", 2024-09-11T07:06:05.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035464999999999997 2024-09-11T07:06:05.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118669+0000", 2024-09-11T07:06:05.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023285519999999998 2024-09-11T07:06:05.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118945+0000", 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027566100000000002 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119016+0000", 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0915999999999997e-05 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119116+0000", 2024-09-11T07:06:05.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9820000000000003e-05 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104600+0000", 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.0964657, 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016285293999999999, 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104600+0000", 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104600+0000", 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104601+0000", 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104791+0000", 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018977100000000001 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104805+0000", 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4226999999999999e-05 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104815+0000", 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000006e-06 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.117204+0000", 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012389331 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.117328+0000", 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012422900000000001 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.117544+0000", 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021566900000000001 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120679+0000", 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003135245 2024-09-11T07:06:05.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120698+0000", 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8753000000000002e-05 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120769+0000", 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1229999999999994e-05 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120886+0000", 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011668899999999999 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104833+0000", 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.096232711999999, 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021630725999999999, 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.270 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 113 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104833+0000", 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104833+0000", 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104835+0000", 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104842+0000", 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2429999999999999e-06 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104852+0000", 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0414000000000001e-05 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104860+0000", 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5460000000000003e-06 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119211+0000", 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014351126000000001 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119441+0000", 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023001799999999999 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119799+0000", 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035755699999999999 2024-09-11T07:06:05.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.122532+0000", 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027336890000000001 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126211+0000", 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036784090000000001 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126342+0000", 2024-09-11T07:06:05.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131882 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126464+0000", 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121712 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104874+0000", 2024-09-11T07:06:05.276 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.096191899000001, 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021780498999999998, 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 114 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104874+0000", 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104874+0000", 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104875+0000", 2024-09-11T07:06:05.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9299999999999997e-07 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104881+0000", 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1e-06 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104909+0000", 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7433e-05 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104917+0000", 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2770000000000005e-06 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.121050+0000", 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016133179000000001 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.121288+0000", 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023799800000000001 2024-09-11T07:06:05.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.121656+0000", 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036769 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126030+0000", 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043747439999999999 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126487+0000", 2024-09-11T07:06:05.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00045610900000000001 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126556+0000", 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9423000000000003e-05 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126655+0000", 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8752999999999995e-05 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.096134656, 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021917907, 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-09-11T07:06:05.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.284 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:05.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:05.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105093+0000", 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016076900000000001 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105133+0000", 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0006999999999998e-05 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105146+0000", 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2612999999999999e-05 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.122642+0000", 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017495825 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.122911+0000", 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026968800000000002 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.123283+0000", 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037215399999999997 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126185+0000", 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029011639999999999 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126684+0000", 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00049918599999999999 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126753+0000", 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8786000000000002e-05 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126849+0000", 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6829000000000004e-05 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.105166+0000", 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.095900615000001, 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023310450999999999, 2024-09-11T07:06:05.289 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-09-11T07:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105166+0000", 2024-09-11T07:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105166+0000", 2024-09-11T07:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105167+0000", 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105174+0000", 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1199999999999996e-06 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105188+0000", 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4426e-05 2024-09-11T07:06:05.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105196+0000", 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.52e-06 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.124500+0000", 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019304808 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.124754+0000", 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025354899999999999 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.125141+0000", 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038675299999999999 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128258+0000", 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031168459999999999 2024-09-11T07:06:05.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128278+0000", 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9922999999999999e-05 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128358+0000", 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0729999999999994e-05 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128476+0000", 2024-09-11T07:06:05.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117719 2024-09-11T07:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.105209+0000", 2024-09-11T07:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 21.095857322000001, 2024-09-11T07:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023639472000000002, 2024-09-11T07:06:05.296 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-09-11T07:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105209+0000", 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105209+0000", 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105210+0000", 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7000000000000003e-07 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105218+0000", 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1370000000000002e-06 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105231+0000", 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3132999999999999e-05 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105240+0000", 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3100000000000006e-06 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126951+0000", 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021710526000000001 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.127194+0000", 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024300799999999999 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.127570+0000", 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000375798 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128630+0000", 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001060538 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128675+0000", 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4946e-05 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128749+0000", 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3880000000000004e-05 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128848+0000", 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9326000000000004e-05 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:05.302 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.605952+0000", 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.595113929, 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010697577999999999, 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 140 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.605952+0000", 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.605952+0000", 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.605954+0000", 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5030000000000001e-06 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606106+0000", 2024-09-11T07:06:05.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015273899999999999 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606135+0000", 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8127e-05 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606159+0000", 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4153000000000001e-05 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.613885+0000", 2024-09-11T07:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0077264380000000004 2024-09-11T07:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.613932+0000", 2024-09-11T07:06:05.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6820999999999998e-05 2024-09-11T07:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614045+0000", 2024-09-11T07:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000112596 2024-09-11T07:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.615450+0000", 2024-09-11T07:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001405681 2024-09-11T07:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.616601+0000", 2024-09-11T07:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0011509420000000001 2024-09-11T07:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.616628+0000", 2024-09-11T07:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7152999999999999e-05 2024-09-11T07:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.616650+0000", 2024-09-11T07:06:05.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1424999999999999e-05 2024-09-11T07:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.311 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.606193+0000", 2024-09-11T07:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 20.594872764000002, 2024-09-11T07:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011487111, 2024-09-11T07:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.312 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 141 2024-09-11T07:06:05.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606193+0000", 2024-09-11T07:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606193+0000", 2024-09-11T07:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606195+0000", 2024-09-11T07:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606208+0000", 2024-09-11T07:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3497e-05 2024-09-11T07:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606235+0000", 2024-09-11T07:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6747e-05 2024-09-11T07:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606256+0000", 2024-09-11T07:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0869999999999998e-05 2024-09-11T07:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614487+0000", 2024-09-11T07:06:05.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082313420000000009 2024-09-11T07:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614637+0000", 2024-09-11T07:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000149574 2024-09-11T07:06:05.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614806+0000", 2024-09-11T07:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168863 2024-09-11T07:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.615807+0000", 2024-09-11T07:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010008770000000001 2024-09-11T07:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.617561+0000", 2024-09-11T07:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001753831 2024-09-11T07:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.617632+0000", 2024-09-11T07:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1007999999999995e-05 2024-09-11T07:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.617681+0000", 2024-09-11T07:06:05.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9016e-05 2024-09-11T07:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:156 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337363+0000", 2024-09-11T07:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.863703486999999, 2024-09-11T07:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011142044, 2024-09-11T07:06:05.326 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 156 2024-09-11T07:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337363+0000", 2024-09-11T07:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337363+0000", 2024-09-11T07:06:05.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337364+0000", 2024-09-11T07:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0359999999999999e-06 2024-09-11T07:06:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337374+0000", 2024-09-11T07:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0297e-05 2024-09-11T07:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337386+0000", 2024-09-11T07:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-11T07:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337393+0000", 2024-09-11T07:06:05.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.396e-06 2024-09-11T07:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.343057+0000", 2024-09-11T07:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056641759999999999 2024-09-11T07:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.343311+0000", 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000253945 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.343681+0000", 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037009 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348060+0000", 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00437828 2024-09-11T07:06:05.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348257+0000", 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000197102 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348398+0000", 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014153200000000001 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348505+0000", 2024-09-11T07:06:05.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000106593 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337407+0000", 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.863659414000001, 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011354912, 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.336 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 157 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337407+0000", 2024-09-11T07:06:05.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337407+0000", 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337408+0000", 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7300000000000005e-07 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337420+0000", 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2627e-05 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337431+0000", 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0817e-05 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337439+0000", 2024-09-11T07:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.746e-06 2024-09-11T07:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.344911+0000", 2024-09-11T07:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.007472299 2024-09-11T07:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.345169+0000", 2024-09-11T07:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025795400000000002 2024-09-11T07:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.345374+0000", 2024-09-11T07:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020457900000000001 2024-09-11T07:06:05.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348216+0000", 2024-09-11T07:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0028425640000000001 2024-09-11T07:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348530+0000", 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031385799999999998 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348662+0000", 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013236500000000001 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348762+0000", 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9329999999999999e-05 2024-09-11T07:06:05.343 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337451+0000", 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.863614817999999, 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015895230999999999, 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337451+0000", 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337451+0000", 2024-09-11T07:06:05.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337452+0000", 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9699999999999995e-07 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337581+0000", 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012876900000000001 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337594+0000", 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2897e-05 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337602+0000", 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2830000000000001e-06 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.346160+0000", 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0085578100000000008 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.346406+0000", 2024-09-11T07:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024632099999999997 2024-09-11T07:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.346774+0000", 2024-09-11T07:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000367924 2024-09-11T07:06:05.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348797+0000", 2024-09-11T07:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020230180000000001 2024-09-11T07:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.353084+0000", 2024-09-11T07:06:05.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042867369999999997 2024-09-11T07:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.353239+0000", 2024-09-11T07:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015480600000000001 2024-09-11T07:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.353347+0000", 2024-09-11T07:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010786899999999999 2024-09-11T07:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:05.351 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337618+0000", 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.863448123000001, 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018603607000000001, 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 159 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337618+0000", 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337618+0000", 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337619+0000", 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9699999999999994e-07 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337633+0000", 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4123e-05 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337645+0000", 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1347e-05 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337652+0000", 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7770000000000002e-06 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348854+0000", 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011201823 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.349013+0000", 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000158522 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.349220+0000", 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020700499999999999 2024-09-11T07:06:05.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.350829+0000", 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001609388 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.355974+0000", 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051445670000000001 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:05.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.356123+0000", 2024-09-11T07:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014918200000000001 2024-09-11T07:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.356222+0000", 2024-09-11T07:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8876000000000007e-05 2024-09-11T07:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.357 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:05.358 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:05.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:06:05.359 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:05.358+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:05.360 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:05.460 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:05.460+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:05.486 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:05.486 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:05.486 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:05.486 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:05.490 INFO:teuthology.orchestra.run.smithi079.stdout:414 punch from 0x6d05536 to 0x6d132c4, (0xdd8e bytes) 2024-09-11T07:06:05.496 INFO:teuthology.orchestra.run.smithi079.stdout:416 punch from 0x6ee8ae7 to 0x6eedf9e, (0x54b7 bytes) 2024-09-11T07:06:05.497 INFO:teuthology.orchestra.run.smithi079.stdout:417 punch from 0x52b597 to 0x52fa8a, (0x44f3 bytes) 2024-09-11T07:06:05.498 INFO:teuthology.orchestra.run.smithi079.stdout:418 trunc from 0x7269da4 to 0x80fe04e 2024-09-11T07:06:05.504 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:05.524 INFO:teuthology.orchestra.run.smithi079.stdout:419 write 0xe15d47b thru 0xe163e2d (0x69b3 bytes) 2024-09-11T07:06:05.530 INFO:teuthology.orchestra.run.smithi079.stdout:422 write 0xc7b9737 thru 0xc7bb7da (0x20a4 bytes) 2024-09-11T07:06:05.544 INFO:teuthology.orchestra.run.smithi079.stdout:423 write 0xe24de2b thru 0xe25954a (0xb720 bytes) 2024-09-11T07:06:05.551 INFO:teuthology.orchestra.run.smithi079.stdout:424 punch from 0x4bf84fb to 0x4c01d08, (0x980d bytes) 2024-09-11T07:06:05.560 INFO:teuthology.orchestra.run.smithi079.stdout:426 trunc from 0xe25954b to 0x7d5e197 2024-09-11T07:06:05.561 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:05.558+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:05.606 INFO:teuthology.orchestra.run.smithi079.stdout:427 writesame 0xb6278ef thru 0xb634528 data_size 0x1(0xcc3a bytes) 2024-09-11T07:06:05.619 INFO:teuthology.orchestra.run.smithi079.stdout:428 trunc from 0xb634529 to 0x48382a4 2024-09-11T07:06:05.651 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:05.651 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:05.652 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:05.661 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:05.660+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:05.669 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:05.674 INFO:teuthology.orchestra.run.smithi079.stdout:429 writesame 0x202ecd0 thru 0x203d82d data_size 0x2f(0xeb5e bytes) 2024-09-11T07:06:05.692 INFO:teuthology.orchestra.run.smithi079.stdout:430 write 0x7a5b4ce thru 0x7a609f8 (0x552b bytes) 2024-09-11T07:06:05.700 INFO:teuthology.orchestra.run.smithi079.stdout:431 punch from 0x20d6cd9 to 0x20e44d4, (0xd7fb bytes) 2024-09-11T07:06:05.700 INFO:teuthology.orchestra.run.smithi079.stdout:432 write 0x257f491 thru 0x258efd4 (0xfb44 bytes) 2024-09-11T07:06:05.702 INFO:teuthology.orchestra.run.smithi079.stdout:435 read 0x554f735 thru 0x555c64a (0xcf16 bytes) 2024-09-11T07:06:05.703 INFO:teuthology.orchestra.run.smithi079.stdout:436 read 0x2cb931e thru 0x2cc49b7 (0xb69a bytes) 2024-09-11T07:06:05.703 INFO:teuthology.orchestra.run.smithi079.stdout:437 read 0x4421eda thru 0x442661c (0x4743 bytes) 2024-09-11T07:06:05.703 INFO:teuthology.orchestra.run.smithi079.stdout:438 read 0x3269008 thru 0x327006a (0x7063 bytes) 2024-09-11T07:06:05.704 INFO:teuthology.orchestra.run.smithi079.stdout:443 read 0x52006f3 thru 0x520107a (0x988 bytes) 2024-09-11T07:06:05.705 INFO:teuthology.orchestra.run.smithi079.stdout:444 read 0x65a0da3 thru 0x65aa696 (0x98f4 bytes) 2024-09-11T07:06:05.705 INFO:teuthology.orchestra.run.smithi079.stdout:446 punch from 0x3d4f4df to 0x3d523d4, (0x2ef5 bytes) 2024-09-11T07:06:05.705 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:05.706 INFO:teuthology.orchestra.run.smithi079.stdout:451 punch from 0x16b53e to 0x16f9ee, (0x44b0 bytes) 2024-09-11T07:06:05.706 INFO:teuthology.orchestra.run.smithi079.stdout:452 read 0x5ee7a2d thru 0x5ef57d5 (0xdda9 bytes) 2024-09-11T07:06:05.706 INFO:teuthology.orchestra.run.smithi079.stdout:453 read 0x2bd75b6 thru 0x2be26a4 (0xb0ef bytes) 2024-09-11T07:06:05.706 INFO:teuthology.orchestra.run.smithi079.stdout:455 punch from 0xd628c to 0xda8b0, (0x4624 bytes) 2024-09-11T07:06:05.706 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:05.706 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:05.707 INFO:teuthology.orchestra.run.smithi079.stdout:458 read 0x7a5a345 thru 0x7a5de00 (0x3abc bytes) 2024-09-11T07:06:05.707 INFO:teuthology.orchestra.run.smithi079.stdout:459 read 0x2f7cb5b thru 0x2f7f4f2 (0x2998 bytes) 2024-09-11T07:06:05.707 INFO:teuthology.orchestra.run.smithi079.stdout:461 read 0x11abbcb thru 0x11b81a0 (0xc5d6 bytes) 2024-09-11T07:06:05.708 INFO:teuthology.orchestra.run.smithi079.stdout:463 writesame 0x28cebc5 thru 0x28dd749 data_size 0x1(0xeb85 bytes) 2024-09-11T07:06:05.742 INFO:teuthology.orchestra.run.smithi079.stdout:464 trunc from 0x7a609f9 to 0x2ecb349 2024-09-11T07:06:05.762 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:05.760+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:05.786 INFO:teuthology.orchestra.run.smithi079.stdout:465 writesame 0xbc9c1e4 thru 0xbc9e7ef data_size 0xa(0x260c bytes) 2024-09-11T07:06:05.787 INFO:teuthology.orchestra.run.smithi079.stdout:466 writesame 0x4ed2c97 thru 0x4edaa6e data_size 0x4(0x7dd8 bytes) 2024-09-11T07:06:05.794 INFO:teuthology.orchestra.run.smithi079.stdout:468 read 0x60ebf63 thru 0x60f4060 (0x80fe bytes) 2024-09-11T07:06:05.795 INFO:teuthology.orchestra.run.smithi079.stdout:469 punch from 0xa6311b2 to 0xa631bda, (0xa28 bytes) 2024-09-11T07:06:05.795 INFO:teuthology.orchestra.run.smithi079.stdout:470 write 0x34e4a3a thru 0x34e69a7 (0x1f6e bytes) 2024-09-11T07:06:05.797 INFO:teuthology.orchestra.run.smithi079.stdout:471 write 0x8d48870 thru 0x8d4f911 (0x70a2 bytes) 2024-09-11T07:06:05.802 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:74 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'48, mlcod=15'43)", 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.921230+0000", 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.879877872000002, 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046482040000000004, 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.803 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921230+0000", 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921230+0000", 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921231+0000", 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.277e-06 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921240+0000", 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2530000000000004e-06 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921261+0000", 2024-09-11T07:06:05.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1897000000000001e-05 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921273+0000", 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1576000000000001e-05 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921399+0000", 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012553600000000001 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921430+0000", 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1690000000000003e-05 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.925789+0000", 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004358603 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.925878+0000", 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9371999999999997e-05 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:82 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'52, mlcod=15'50)", 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.942014+0000", 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.859093646000002, 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046046150000000003, 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.809 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.809 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942014+0000", 2024-09-11T07:06:05.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942014+0000", 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942016+0000", 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-06 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942028+0000", 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1939999999999999e-05 2024-09-11T07:06:05.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942057+0000", 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8643e-05 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942070+0000", 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3093e-05 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942185+0000", 2024-09-11T07:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115049 2024-09-11T07:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942219+0000", 2024-09-11T07:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4100000000000002e-05 2024-09-11T07:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.946497+0000", 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042781499999999997 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.946619+0000", 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012181299999999999 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:83 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'53, mlcod=15'50)", 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.942993+0000", 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.858114553, 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039014829999999999, 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942993+0000", 2024-09-11T07:06:05.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942993+0000", 2024-09-11T07:06:05.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.942995+0000", 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0430000000000002e-06 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.943012+0000", 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6670000000000001e-05 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.943047+0000", 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4876999999999998e-05 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.943068+0000", 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0916000000000001e-05 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.943195+0000", 2024-09-11T07:06:05.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012704599999999999 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.943225+0000", 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0042000000000001e-05 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.946817+0000", 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035918970000000001 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.946895+0000", 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7991999999999995e-05 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:85 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'55, mlcod=15'50)", 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.945750+0000", 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.855357424000001, 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046609199999999998, 2024-09-11T07:06:05.819 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945750+0000", 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945750+0000", 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945753+0000", 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1730000000000002e-06 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945768+0000", 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4970000000000001e-05 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945801+0000", 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2982999999999999e-05 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945819+0000", 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8127000000000001e-05 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945956+0000", 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013683200000000001 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945995+0000", 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9382999999999999e-05 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.950324+0000", 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043285930000000004 2024-09-11T07:06:05.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.950411+0000", 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7859e-05 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:86 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'56, mlcod=15'50)", 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.947190+0000", 2024-09-11T07:06:05.824 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.853917468999999, 2024-09-11T07:06:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051138299999999998, 2024-09-11T07:06:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947190+0000", 2024-09-11T07:06:05.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947190+0000", 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947192+0000", 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.747e-06 2024-09-11T07:06:05.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947202+0000", 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0142999999999999e-05 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947226+0000", 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3997000000000001e-05 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947239+0000", 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2666e-05 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947322+0000", 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3316e-05 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947350+0000", 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.745e-05 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.952210+0000", 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048603789999999997 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.952304+0000", 2024-09-11T07:06:05.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4131999999999999e-05 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:87 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'57, mlcod=15'50)", 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.948738+0000", 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.852369890999999, 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043227960000000003, 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948738+0000", 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948738+0000", 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948739+0000", 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8999999999999995e-07 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948819+0000", 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0558999999999999e-05 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948839+0000", 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9199999999999999e-05 2024-09-11T07:06:05.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948850+0000", 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.147e-05 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.948974+0000", 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012396299999999999 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.949029+0000", 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5333e-05 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.952986+0000", 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039564689999999998 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.953061+0000", 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4912000000000004e-05 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:129 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'87, mlcod=15'85)", 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.605706+0000", 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.195401561000001, 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003678345, 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.835 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605706+0000", 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605706+0000", 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605708+0000", 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.99e-06 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605721+0000", 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2767e-05 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605757+0000", 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6349e-05 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605777+0000", 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9307e-05 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605937+0000", 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000160645 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.605994+0000", 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6746000000000002e-05 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.609257+0000", 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032630350000000001 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.609385+0000", 2024-09-11T07:06:05.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000127506 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:130 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'88, mlcod=15'85)", 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.606280+0000", 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.194828239, 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037782639999999999, 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.840 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606280+0000", 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606280+0000", 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606281+0000", 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606295+0000", 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4224e-05 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606327+0000", 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1606000000000002e-05 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606383+0000", 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6292999999999998e-05 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606725+0000", 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034160800000000003 2024-09-11T07:06:05.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606764+0000", 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9212000000000003e-05 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.609957+0000", 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003192706 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.610058+0000", 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000101032 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:131 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'89, mlcod=15'85)", 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.606954+0000", 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.194153886999999, 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003239385, 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.845 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606954+0000", 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606954+0000", 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.606956+0000", 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.686e-06 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.607067+0000", 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011171300000000001 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.607095+0000", 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7909999999999999e-05 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.607114+0000", 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9072999999999998e-05 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.607352+0000", 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00023767499999999999 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.607387+0000", 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5135999999999997e-05 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.610067+0000", 2024-09-11T07:06:05.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026796760000000002 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.610193+0000", 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012651599999999999 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:143 1.0 e16/14 1:30306672:devicehealth::main.db.0000000000000000:head v 16'101, mlcod=16'98)", 2024-09-11T07:06:05.850 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.620472+0000", 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.180635381999998, 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003729432, 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620472+0000", 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620472+0000", 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620473+0000", 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9699999999999994e-07 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620630+0000", 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015667200000000001 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620662+0000", 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1875999999999998e-05 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620677+0000", 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4600000000000001e-05 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620772+0000", 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5602999999999999e-05 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.620808+0000", 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5363e-05 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.624109+0000", 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003301614 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.624202+0000", 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2707000000000005e-05 2024-09-11T07:06:05.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:144 1.0 e16/14 1:30306672:devicehealth::main.db.0000000000000000:head v 16'102, mlcod=16'98)", 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.621438+0000", 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.179669665999999, 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055383699999999999, 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.856 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621438+0000", 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621438+0000", 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621440+0000", 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.967e-06 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621534+0000", 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3945999999999998e-05 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621555+0000", 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1308999999999999e-05 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621570+0000", 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5004000000000001e-05 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621720+0000", 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000149579 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621752+0000", 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2376000000000003e-05 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.626921+0000", 2024-09-11T07:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051684069999999999 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.626977+0000", 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5782000000000002e-05 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:145 1.0 e16/14 1:30306672:devicehealth::main.db.0000000000000000:head v 16'103, mlcod=16'98)", 2024-09-11T07:06:05.861 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.622301+0000", 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.178806463000001, 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047136870000000003, 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622301+0000", 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622301+0000", 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622302+0000", 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.04e-06 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622435+0000", 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132683 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622470+0000", 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5142999999999999e-05 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622485+0000", 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4236000000000001e-05 2024-09-11T07:06:05.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622567+0000", 2024-09-11T07:06:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2663000000000005e-05 2024-09-11T07:06:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622596+0000", 2024-09-11T07:06:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9295999999999999e-05 2024-09-11T07:06:05.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.626981+0000", 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043843859999999997 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.627015+0000", 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4239999999999997e-05 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:158 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'108)", 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:45.348000+0000", 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.453108246999999, 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056739099999999999, 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348000+0000", 2024-09-11T07:06:05.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348000+0000", 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348001+0000", 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.24e-06 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348108+0000", 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107339 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348127+0000", 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9040000000000001e-05 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348146+0000", 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8879999999999999e-05 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348234+0000", 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7756999999999993e-05 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348247+0000", 2024-09-11T07:06:05.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3057000000000001e-05 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.353637+0000", 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005390181 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.353674+0000", 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6415999999999998e-05 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.871 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:159 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'113, mlcod=16'110)", 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:45.350384+0000", 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.450723956000001, 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0062316070000000001, 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350384+0000", 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350384+0000", 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350385+0000", 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2330000000000001e-06 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350393+0000", 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2670000000000006e-06 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350413+0000", 2024-09-11T07:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.982e-05 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350428+0000", 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.504e-05 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350582+0000", 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015388199999999999 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350598+0000", 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6004000000000001e-05 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.356580+0000", 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059817500000000001 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.356616+0000", 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5611000000000002e-05 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:162 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'116, mlcod=16'114)", 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:45.363592+0000", 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.437516155000001, 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072654709999999999, 2024-09-11T07:06:05.877 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363592+0000", 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363592+0000", 2024-09-11T07:06:05.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363593+0000", 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-06 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363601+0000", 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0600000000000008e-06 2024-09-11T07:06:05.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363621+0000", 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9692999999999999e-05 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363639+0000", 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8179999999999999e-05 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363730+0000", 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0997999999999998e-05 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363743+0000", 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3016e-05 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.370822+0000", 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070786429999999999 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.370857+0000", 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5630999999999998e-05 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:11 3.1f 3:fa654f18:::rbd_id.image_client.0:head [create,call rbd.set_id in=9b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-09-11T07:06:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:00.829529+0000", 2024-09-11T07:06:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.9715784210000002, 2024-09-11T07:06:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003731528, 2024-09-11T07:06:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:05.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 11 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829529+0000", 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829529+0000", 2024-09-11T07:06:05.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829532+0000", 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4040000000000002e-06 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829543+0000", 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0808000000000001e-05 2024-09-11T07:06:05.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829564+0000", 2024-09-11T07:06:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1376e-05 2024-09-11T07:06:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829577+0000", 2024-09-11T07:06:05.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2696e-05 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829667+0000", 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9951999999999995e-05 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.829885+0000", 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000218743 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.830186+0000", 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030077899999999999 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.831758+0000", 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001571926 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.833163+0000", 2024-09-11T07:06:05.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001405089 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.833216+0000", 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2710999999999997e-05 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.833261+0000", 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5043999999999998e-05 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.889 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:15 3.1f 3:fa654f18:::rbd_id.image_client.0:head [call] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e24)", 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:00.846353+0000", 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.9547544170000002, 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033113959999999999, 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 15 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846353+0000", 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846353+0000", 2024-09-11T07:06:05.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846354+0000", 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6500000000000008e-07 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846361+0000", 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.127e-06 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846372+0000", 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1507e-05 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846378+0000", 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0909999999999998e-06 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846428+0000", 2024-09-11T07:06:05.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9437000000000001e-05 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.846495+0000", 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6934999999999995e-05 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:00.849665+0000", 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031703339999999999 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:716 3.12 3:4b8a6084:::rbd_data.11618ae21b77.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:04.432666+0000", 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.368442355, 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060466540000000003, 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:05.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 716 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432666+0000", 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432666+0000", 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432667+0000", 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.186e-06 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432675+0000", 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8790000000000003e-06 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432689+0000", 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3973e-05 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432697+0000", 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1019999999999997e-06 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432750+0000", 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3820000000000003e-05 2024-09-11T07:06:05.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432874+0000", 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012327700000000001 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.433906+0000", 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010323369999999999 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.438586+0000", 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046802939999999998 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.438606+0000", 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9405000000000001e-05 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.438658+0000", 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2156e-05 2024-09-11T07:06:05.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.438712+0000", 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4224999999999997e-05 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1189 3.6 3:62e9a709:::rbd_data.11611d63ad3f.000000000000000b:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:05.901 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.710834+0000", 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.090274244000000003, 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027433923999999998, 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1189 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710834+0000", 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710834+0000", 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710834+0000", 2024-09-11T07:06:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6099999999999999e-07 2024-09-11T07:06:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710839+0000", 2024-09-11T07:06:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-09-11T07:06:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710850+0000", 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0253e-05 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710855+0000", 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3460000000000001e-06 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710910+0000", 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5111000000000001e-05 2024-09-11T07:06:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710965+0000", 2024-09-11T07:06:05.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5071999999999997e-05 2024-09-11T07:06:05.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:06:05.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.715764+0000", 2024-09-11T07:06:05.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047986579999999999 2024-09-11T07:06:05.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738144+0000", 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022380172 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738158+0000", 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4311000000000001e-05 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:05.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738201+0000", 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3217999999999999e-05 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738268+0000", 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6093000000000006e-05 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4449.0:1189 3.6 e26/21 ondisk, result = 0)", 2024-09-11T07:06:05.908 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.730066+0000", 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.071041996999999996, 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080843140000000004, 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730066+0000", 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730066+0000", 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730067+0000", 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1100000000000004e-07 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730071+0000", 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4220000000000002e-06 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730086+0000", 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4459e-05 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:05.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730098+0000", 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2114e-05 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738127+0000", 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080296770000000007 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738138+0000", 2024-09-11T07:06:05.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0335e-05 2024-09-11T07:06:05.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:05.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:05.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:05.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738150+0000", 2024-09-11T07:06:05.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2396e-05 2024-09-11T07:06:05.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:05.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:05.914 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:05.915 INFO:teuthology.orchestra.run.smithi079.stdout:472 read 0x2437429 thru 0x24420a5 (0xac7d bytes) 2024-09-11T07:06:05.915 INFO:teuthology.orchestra.run.smithi079.stdout:474 punch from 0x4d30c89 to 0x4d34d80, (0x40f7 bytes) 2024-09-11T07:06:05.915 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:05.915 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:05.915 INFO:teuthology.orchestra.run.smithi079.stdout:479 read 0xaa3ce03 thru 0xaa3dd25 (0xf23 bytes) 2024-09-11T07:06:05.915 INFO:teuthology.orchestra.run.smithi079.stdout:481 read 0x47053a4 thru 0x470b81d (0x647a bytes) 2024-09-11T07:06:05.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:05.918 INFO:teuthology.orchestra.run.smithi079.stdout:482 write 0xe14ccd7 thru 0xe159377 (0xc6a1 bytes) 2024-09-11T07:06:05.918 INFO:teuthology.orchestra.run.smithi079.stdout:483 punch from 0x2ee0acb to 0x2eee80a, (0xdd3f bytes) 2024-09-11T07:06:05.918 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:05.918 INFO:teuthology.orchestra.run.smithi079.stdout:486 read 0xd5cd85b thru 0xd5d7bde (0xa384 bytes) 2024-09-11T07:06:05.918 INFO:teuthology.orchestra.run.smithi079.stdout:487 read 0xa25206b thru 0xa259a89 (0x7a1f bytes) 2024-09-11T07:06:05.918 INFO:teuthology.orchestra.run.smithi079.stdout:490 write 0xecf1080 thru 0xecf1165 (0xe6 bytes) 2024-09-11T07:06:05.918 INFO:teuthology.orchestra.run.smithi079.stdout:492 trunc from 0xecf1166 to 0x1df2899 2024-09-11T07:06:05.918 INFO:teuthology.orchestra.run.smithi079.stdout:493 read 0x43a476 thru 0x43b5e3 (0x116e bytes) 2024-09-11T07:06:05.918 INFO:teuthology.orchestra.run.smithi079.stdout:494 read 0x724549 thru 0x724fb2 (0xa6a bytes) 2024-09-11T07:06:05.919 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:05.919 INFO:teuthology.orchestra.run.smithi079.stdout:496 read 0x16ff835 thru 0x17067c4 (0x6f90 bytes) 2024-09-11T07:06:05.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:05.916+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:05.925 INFO:teuthology.orchestra.run.smithi079.stdout:499 write 0x52989f9 thru 0x529e7ee (0x5df6 bytes) 2024-09-11T07:06:05.952 INFO:teuthology.orchestra.run.smithi079.stdout:500 writesame 0xc3676fd thru 0xc36c68a data_size 0x11(0x4f8e bytes) 2024-09-11T07:06:05.964 INFO:teuthology.orchestra.run.smithi079.stdout:502 write 0xe11d8cb thru 0xe125ad7 (0x820d bytes) 2024-09-11T07:06:05.971 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:05.971 INFO:teuthology.orchestra.run.smithi079.stdout:504 write 0xc9bc51d thru 0xc9c1c07 (0x56eb bytes) 2024-09-11T07:06:05.978 INFO:teuthology.orchestra.run.smithi079.stdout:505 read 0xb68d018 thru 0xb697b23 (0xab0c bytes) 2024-09-11T07:06:05.978 INFO:teuthology.orchestra.run.smithi079.stdout:506 punch from 0x6d5adf4 to 0x6d5c5ae, (0x17ba bytes) 2024-09-11T07:06:05.978 INFO:teuthology.orchestra.run.smithi079.stdout:507 read 0x3d52b5b thru 0x3d5d0c5 (0xa56b bytes) 2024-09-11T07:06:05.998 INFO:teuthology.orchestra.run.smithi079.stdout:509 trunc from 0xe125ad8 to 0xf548b0 2024-09-11T07:06:06.015 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:06.016+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:06.043 INFO:teuthology.orchestra.run.smithi079.stdout:510 writesame 0x6cd567c thru 0x6ce3653 data_size 0x26(0xdfd8 bytes) 2024-09-11T07:06:06.045 INFO:teuthology.orchestra.run.smithi079.stdout:511 write 0x29116f6 thru 0x2913b24 (0x242f bytes) 2024-09-11T07:06:06.048 INFO:teuthology.orchestra.run.smithi079.stdout:512 punch from 0x4ccc6e to 0x4cf022, (0x23b4 bytes) 2024-09-11T07:06:06.048 INFO:teuthology.orchestra.run.smithi079.stdout:513 read 0x8f4179 thru 0x8f8d80 (0x4c08 bytes) 2024-09-11T07:06:06.061 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:06.061 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:06.062 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:06.071 INFO:teuthology.orchestra.run.smithi079.stdout:515 write 0xdc9e53a thru 0xdca20f1 (0x3bb8 bytes) 2024-09-11T07:06:06.077 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:06.078 INFO:teuthology.orchestra.run.smithi079.stdout:516 read 0x3daaa07 thru 0x3dacfa0 (0x259a bytes) 2024-09-11T07:06:06.078 INFO:teuthology.orchestra.run.smithi079.stdout:517 write 0x3cb03b thru 0x3d3380 (0x8346 bytes) 2024-09-11T07:06:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:518 punch from 0xc7da5a1 to 0xc7e5d92, (0xb7f1 bytes) 2024-09-11T07:06:06.081 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.082 INFO:teuthology.orchestra.run.smithi079.stdout:521 write 0x6a25218 thru 0x6a2bca8 (0x6a91 bytes) 2024-09-11T07:06:06.085 INFO:teuthology.orchestra.run.smithi079.stdout:522 read 0x824247 thru 0x833ce7 (0xfaa1 bytes) 2024-09-11T07:06:06.087 INFO:teuthology.orchestra.run.smithi079.stdout:523 write 0xd29fa85 thru 0xd2a72e0 (0x785c bytes) 2024-09-11T07:06:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:524 read 0xbb5d27b thru 0xbb61fb5 (0x4d3b bytes) 2024-09-11T07:06:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:526 read 0x7599062 thru 0x75a6ec7 (0xde66 bytes) 2024-09-11T07:06:06.093 INFO:teuthology.orchestra.run.smithi079.stdout:528 read 0x630d520 thru 0x6312a2e (0x550f bytes) 2024-09-11T07:06:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:529 read 0x906d214 thru 0x9074bfa (0x79e7 bytes) 2024-09-11T07:06:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:530 punch from 0x33fba06 to 0x33fd906, (0x1f00 bytes) 2024-09-11T07:06:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:532 read 0x9642afe thru 0x964f4ee (0xc9f1 bytes) 2024-09-11T07:06:06.094 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:535 read 0xd5afc69 thru 0xd5b21b1 (0x2549 bytes) 2024-09-11T07:06:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:536 punch from 0x7bd1149 to 0x7bdce05, (0xbcbc bytes) 2024-09-11T07:06:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:538 read 0x37e399d thru 0x37f2c89 (0xf2ed bytes) 2024-09-11T07:06:06.095 INFO:teuthology.orchestra.run.smithi079.stdout:539 write 0x88805aa thru 0x8887700 (0x7157 bytes) 2024-09-11T07:06:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.098 INFO:teuthology.orchestra.run.smithi079.stdout:541 read 0x31a659f thru 0x31b1d25 (0xb787 bytes) 2024-09-11T07:06:06.116 INFO:teuthology.orchestra.run.smithi079.stdout:542 trunc from 0xdca20f2 to 0x4583a61 2024-09-11T07:06:06.116 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:06.116+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:06.139 INFO:teuthology.orchestra.run.smithi079.stdout:543 read 0x1c9c2dc thru 0x1ca201d (0x5d42 bytes) 2024-09-11T07:06:06.143 INFO:teuthology.orchestra.run.smithi079.stdout:544 trunc from 0x4583a61 to 0x2a11b08 2024-09-11T07:06:06.158 INFO:teuthology.orchestra.run.smithi079.stdout:549 write 0xf13a45 thru 0xf1435f (0x91b bytes) 2024-09-11T07:06:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:550 punch from 0xf59fb0 to 0xf640be, (0xa10e bytes) 2024-09-11T07:06:06.161 INFO:teuthology.orchestra.run.smithi079.stdout:553 read 0x1034d23 thru 0x103c2e5 (0x75c3 bytes) 2024-09-11T07:06:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:554 read 0x2274969 thru 0x2282872 (0xdf0a bytes) 2024-09-11T07:06:06.162 INFO:teuthology.orchestra.run.smithi079.stdout:555 read 0xf0a55d thru 0xf0dc92 (0x3736 bytes) 2024-09-11T07:06:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:556 writesame 0xd6dcb21 thru 0xd6e6a5d data_size 0x1f(0x9f3d bytes) 2024-09-11T07:06:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:557 read 0x3fff28a thru 0x400de81 (0xebf8 bytes) 2024-09-11T07:06:06.191 INFO:teuthology.orchestra.run.smithi079.stdout:558 write 0x4665f2a thru 0x4667387 (0x145e bytes) 2024-09-11T07:06:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:559 read 0x7d5ec27 thru 0x7d6c654 (0xda2e bytes) 2024-09-11T07:06:06.194 INFO:teuthology.orchestra.run.smithi079.stdout:560 write 0xb94a7d3 thru 0xb951959 (0x7187 bytes) 2024-09-11T07:06:06.202 INFO:teuthology.orchestra.run.smithi079.stdout:561 read 0x870c5a5 thru 0x870db52 (0x15ae bytes) 2024-09-11T07:06:06.205 INFO:teuthology.orchestra.run.smithi079.stdout:562 trunc from 0xd6e6a5e to 0xbbafd51 2024-09-11T07:06:06.214 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:06.215 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:06.217 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:06.214+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:06.221 INFO:teuthology.orchestra.run.smithi079.stdout:563 write 0x1dc02e1 thru 0x1dc6a58 (0x6778 bytes) 2024-09-11T07:06:06.224 INFO:teuthology.orchestra.run.smithi079.stdout:564 write 0xa7c0ea9 thru 0xa7c821a (0x7372 bytes) 2024-09-11T07:06:06.230 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:06:06.233 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:06.244 INFO:teuthology.orchestra.run.smithi079.stdout:565 writesame 0xa2901dd thru 0xa29cfd7 data_size 0x5d(0xcdfb bytes) 2024-09-11T07:06:06.248 INFO:teuthology.orchestra.run.smithi079.stdout:566 read 0x89f6a3f thru 0x8a03b18 (0xd0da bytes) 2024-09-11T07:06:06.249 INFO:teuthology.orchestra.run.smithi079.stdout:567 writesame 0xb5d7467 thru 0xb5e55ed data_size 0xf(0xe187 bytes) 2024-09-11T07:06:06.254 INFO:teuthology.orchestra.run.smithi079.stdout:568 write 0x2a1cb91 thru 0x2a1e329 (0x1799 bytes) 2024-09-11T07:06:06.257 INFO:teuthology.orchestra.run.smithi079.stdout:569 writesame 0x34003c3 thru 0x340b469 data_size 0x1(0xb0a7 bytes) 2024-09-11T07:06:06.311 INFO:teuthology.orchestra.run.smithi079.stdout:570 punch from 0x9cd3723 to 0x9cdeae4, (0xb3c1 bytes) 2024-09-11T07:06:06.311 INFO:teuthology.orchestra.run.smithi079.stdout:571 punch from 0x2f1ff66 to 0x2f2d2ab, (0xd345 bytes) 2024-09-11T07:06:06.318 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:06.314+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:06.323 INFO:teuthology.orchestra.run.smithi079.stdout:572 write 0xdc6fdc8 thru 0xdc7da72 (0xdcab bytes) 2024-09-11T07:06:06.327 INFO:teuthology.orchestra.run.smithi079.stdout:573 write 0x69889b8 thru 0x6989966 (0xfaf bytes) 2024-09-11T07:06:06.329 INFO:teuthology.orchestra.run.smithi079.stdout:574 writesame 0x6b4150a thru 0x6b46625 data_size 0x3a(0x511c bytes) 2024-09-11T07:06:06.333 INFO:teuthology.orchestra.run.smithi079.stdout:575 write 0x6f30770 thru 0x6f3ff7f (0xf810 bytes) 2024-09-11T07:06:06.338 INFO:teuthology.orchestra.run.smithi079.stdout:576 punch from 0x8cc09eb to 0x8cc5549, (0x4b5e bytes) 2024-09-11T07:06:06.359 INFO:teuthology.orchestra.run.smithi079.stdout:577 trunc from 0xdc7da73 to 0x7a3091 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:862 3.19 3:9a302c71:::rbd_data.11618ae21b77.0000000000000009:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2010838~58507] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:04.729050+0000", 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.6436347740000001, 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035807719999999999, 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 862 2024-09-11T07:06:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.729050+0000", 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.729050+0000", 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.729052+0000", 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6900000000000001e-06 2024-09-11T07:06:06.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.729098+0000", 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5599000000000002e-05 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.729129+0000", 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1062999999999997e-05 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.729145+0000", 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5569999999999998e-05 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.729268+0000", 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012321599999999999 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.729426+0000", 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000158469 2024-09-11T07:06:06.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:06:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.729669+0000", 2024-09-11T07:06:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024276500000000001 2024-09-11T07:06:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.731533+0000", 2024-09-11T07:06:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0018636620000000001 2024-09-11T07:06:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.732457+0000", 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00092451299999999996 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.732558+0000", 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010094600000000001 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.732631+0000", 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2279000000000004e-05 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:887 3.0 3:071ed1d3:::rbd_data.11618ae21b77.000000000000001c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2524105~6619] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:04.790291+0000", 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.5823936669999998, 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0030621670000000002, 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.382 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 887 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.790291+0000", 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.790291+0000", 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.790295+0000", 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6339999999999999e-06 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.790321+0000", 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6449e-05 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.790364+0000", 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2817e-05 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.790387+0000", 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.349e-05 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.790567+0000", 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017990500000000001 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.790721+0000", 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015381499999999999 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.790962+0000", 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240542 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.792745+0000", 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001783663 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.793166+0000", 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042108599999999999 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.793258+0000", 2024-09-11T07:06:06.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1833e-05 2024-09-11T07:06:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.793353+0000", 2024-09-11T07:06:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4932999999999994e-05 2024-09-11T07:06:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1200 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head [stat,truncate 3670016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.753840+0000", 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.61884470499999999, 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026385499999999999, 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1200 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.389 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.753840+0000", 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.753840+0000", 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.753840+0000", 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8100000000000003e-07 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.753844+0000", 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.207e-06 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.753850+0000", 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7150000000000001e-06 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.753856+0000", 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3879999999999999e-06 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.755044+0000", 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011882010000000001 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.755125+0000", 2024-09-11T07:06:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1285000000000005e-05 2024-09-11T07:06:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.755254+0000", 2024-09-11T07:06:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012900300000000001 2024-09-11T07:06:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.756260+0000", 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010058039999999999 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.756386+0000", 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000125537 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.756440+0000", 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3984999999999999e-05 2024-09-11T07:06:06.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.756478+0000", 2024-09-11T07:06:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8844000000000003e-05 2024-09-11T07:06:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.395 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1225 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.789407+0000", 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.58327709500000002, 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073596800000000004, 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1225 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789407+0000", 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789407+0000", 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789410+0000", 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1550000000000001e-06 2024-09-11T07:06:06.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789419+0000", 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5310000000000007e-06 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789439+0000", 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0166999999999999e-05 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789448+0000", 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1200000000000008e-06 2024-09-11T07:06:06.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789522+0000", 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3337999999999995e-05 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789622+0000", 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010005699999999999 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.790389+0000", 2024-09-11T07:06:06.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076713699999999998 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796636+0000", 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0062471690000000003 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796684+0000", 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7513999999999999e-05 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796729+0000", 2024-09-11T07:06:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5561e-05 2024-09-11T07:06:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796767+0000", 2024-09-11T07:06:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7931e-05 2024-09-11T07:06:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4449.0:1225 3.0 e26/21 ondisk, result = 0)", 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.793414+0000", 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.57927038900000005, 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033600140000000001, 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.793414+0000", 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.793414+0000", 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.793416+0000", 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.73e-06 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.793427+0000", 2024-09-11T07:06:06.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1119e-05 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.793459+0000", 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2407000000000003e-05 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.793482+0000", 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.296e-05 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796672+0000", 2024-09-11T07:06:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031894940000000002 2024-09-11T07:06:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796679+0000", 2024-09-11T07:06:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0659999999999998e-06 2024-09-11T07:06:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796774+0000", 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5237999999999999e-05 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1260 3.0 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head [stat,truncate 2621440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.887346+0000", 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.48533821500000002, 2024-09-11T07:06:06.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033967369999999999, 2024-09-11T07:06:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1260 2024-09-11T07:06:06.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887346+0000", 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887346+0000", 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887349+0000", 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2869999999999999e-06 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887359+0000", 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0553e-05 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887386+0000", 2024-09-11T07:06:06.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6517e-05 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887408+0000", 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.19e-05 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887527+0000", 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119478 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887648+0000", 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000121329 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887843+0000", 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019499400000000001 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889763+0000", 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019200930000000001 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890549+0000", 2024-09-11T07:06:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00078550600000000005 2024-09-11T07:06:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890660+0000", 2024-09-11T07:06:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011106499999999999 2024-09-11T07:06:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890743+0000", 2024-09-11T07:06:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3015000000000004e-05 2024-09-11T07:06:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1263 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head [stat,truncate 2566297] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.413 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.887500+0000", 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.48518499300000001, 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0049505579999999999, 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1263 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887500+0000", 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887500+0000", 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887501+0000", 2024-09-11T07:06:06.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.677e-06 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887511+0000", 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2669999999999995e-06 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887534+0000", 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3600000000000001e-05 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887550+0000", 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6175999999999999e-05 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888200+0000", 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064978799999999999 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888305+0000", 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104775 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888481+0000", 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000176236 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.891879+0000", 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033975229999999999 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892304+0000", 2024-09-11T07:06:06.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042578800000000002 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892389+0000", 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4419999999999995e-05 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892450+0000", 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1308000000000003e-05 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1267 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head [stat,truncate 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.887576+0000", 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.485108176, 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007300211, 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1267 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887576+0000", 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887576+0000", 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887578+0000", 2024-09-11T07:06:06.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4559999999999999e-06 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887584+0000", 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4169999999999997e-06 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887603+0000", 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8906000000000002e-05 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887618+0000", 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5150000000000001e-05 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888853+0000", 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012350530000000001 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888956+0000", 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010271499999999999 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889135+0000", 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000179397 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894439+0000", 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053030910000000002 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894677+0000", 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238507 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894769+0000", 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1502000000000006e-05 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894877+0000", 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010801700000000001 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1271 3.6 e26/21 3:62e9a709:::rbd_data.11611d63ad3f.000000000000000b:head v 26'6, mlcod=26'4)", 2024-09-11T07:06:06.425 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.888550+0000", 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.48413430699999999, 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035077390000000002, 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888550+0000", 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888550+0000", 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888552+0000", 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4419999999999999e-06 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888562+0000", 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.039e-05 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888582+0000", 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0271999999999998e-05 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888594+0000", 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2116000000000001e-05 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888684+0000", 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9225e-05 2024-09-11T07:06:06.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888724+0000", 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.981e-05 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.891971+0000", 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032476850000000002 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892058+0000", 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6798999999999993e-05 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1324 3.0 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head [stat,truncate 1572864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.010080+0000", 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.36260483900000001, 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033772369999999999, 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.430 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1324 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010080+0000", 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010080+0000", 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010083+0000", 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.807e-06 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010098+0000", 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5956000000000001e-05 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010135+0000", 2024-09-11T07:06:06.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6100000000000003e-05 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010152+0000", 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.694e-05 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010244+0000", 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2147999999999999e-05 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010356+0000", 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000111841 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010536+0000", 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018093300000000001 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.012230+0000", 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0016934439999999999 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013333+0000", 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0011032240000000001 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013394+0000", 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0877e-05 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013457+0000", 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2966999999999995e-05 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1327 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.010233+0000", 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.36245160700000001, 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0034466169999999999, 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1327 2024-09-11T07:06:06.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010233+0000", 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010233+0000", 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010235+0000", 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-06 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010243+0000", 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6659999999999997e-06 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010259+0000", 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5773999999999998e-05 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010269+0000", 2024-09-11T07:06:06.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9830000000000008e-06 2024-09-11T07:06:06.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011824+0000", 2024-09-11T07:06:06.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001554927 2024-09-11T07:06:06.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011888+0000", 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3900999999999997e-05 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.012002+0000", 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000114274 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013470+0000", 2024-09-11T07:06:06.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001467999 2024-09-11T07:06:06.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013560+0000", 2024-09-11T07:06:06.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9792999999999999e-05 2024-09-11T07:06:06.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013629+0000", 2024-09-11T07:06:06.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9031999999999999e-05 2024-09-11T07:06:06.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013680+0000", 2024-09-11T07:06:06.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0441e-05 2024-09-11T07:06:06.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.443 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.443 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1331 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head [stat,truncate 1048576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.444 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.011586+0000", 2024-09-11T07:06:06.444 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.36109849700000002, 2024-09-11T07:06:06.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028256689999999998, 2024-09-11T07:06:06.444 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.444 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.444 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.445 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.445 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.445 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.445 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1331 2024-09-11T07:06:06.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.445 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011586+0000", 2024-09-11T07:06:06.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011586+0000", 2024-09-11T07:06:06.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011588+0000", 2024-09-11T07:06:06.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.703e-06 2024-09-11T07:06:06.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011598+0000", 2024-09-11T07:06:06.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.039e-05 2024-09-11T07:06:06.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011640+0000", 2024-09-11T07:06:06.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1810000000000001e-05 2024-09-11T07:06:06.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011668+0000", 2024-09-11T07:06:06.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8093e-05 2024-09-11T07:06:06.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.012396+0000", 2024-09-11T07:06:06.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00072844399999999997 2024-09-11T07:06:06.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.012477+0000", 2024-09-11T07:06:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0391999999999999e-05 2024-09-11T07:06:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.012599+0000", 2024-09-11T07:06:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012213099999999999 2024-09-11T07:06:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013963+0000", 2024-09-11T07:06:06.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001363639 2024-09-11T07:06:06.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.014280+0000", 2024-09-11T07:06:06.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031718300000000002 2024-09-11T07:06:06.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.014359+0000", 2024-09-11T07:06:06.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9482999999999998e-05 2024-09-11T07:06:06.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.014412+0000", 2024-09-11T07:06:06.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2401000000000002e-05 2024-09-11T07:06:06.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.454 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1371 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head [stat,write 307259~33606] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.081408+0000", 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.29127658000000001, 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026582340000000002, 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1371 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.081408+0000", 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.081408+0000", 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.081411+0000", 2024-09-11T07:06:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9869999999999999e-06 2024-09-11T07:06:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.081474+0000", 2024-09-11T07:06:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3353000000000001e-05 2024-09-11T07:06:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.081508+0000", 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3819999999999998e-05 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.081527+0000", 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9023000000000001e-05 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.081631+0000", 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104052 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.081735+0000", 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104257 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.081970+0000", 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000234582 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.083380+0000", 2024-09-11T07:06:06.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001409862 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.083964+0000", 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058376299999999995 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.084020+0000", 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6045000000000003e-05 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.084066+0000", 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6489999999999997e-05 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1385 3.0 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head [stat,truncate 5242880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.128549+0000", 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.24413538100000001, 2024-09-11T07:06:06.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002747457, 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1385 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128549+0000", 2024-09-11T07:06:06.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128549+0000", 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128552+0000", 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6570000000000001e-06 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128562+0000", 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0054999999999999e-05 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128586+0000", 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3938999999999999e-05 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128599+0000", 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2938999999999999e-05 2024-09-11T07:06:06.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128814+0000", 2024-09-11T07:06:06.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000215312 2024-09-11T07:06:06.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128946+0000", 2024-09-11T07:06:06.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013143200000000001 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.129147+0000", 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020180900000000001 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.131102+0000", 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001955161 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.131189+0000", 2024-09-11T07:06:06.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6440999999999995e-05 2024-09-11T07:06:06.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.131246+0000", 2024-09-11T07:06:06.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7232999999999999e-05 2024-09-11T07:06:06.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.131297+0000", 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0479000000000002e-05 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1388 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head [stat,truncate 5242880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.128652+0000", 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.24403242999999999, 2024-09-11T07:06:06.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003113293, 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1388 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128652+0000", 2024-09-11T07:06:06.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128652+0000", 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128653+0000", 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5499999999999996e-07 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128658+0000", 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6290000000000001e-06 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128671+0000", 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3321e-05 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128679+0000", 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8560000000000007e-06 2024-09-11T07:06:06.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.129526+0000", 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00084672199999999995 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.129682+0000", 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000156689 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.129873+0000", 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019020300000000001 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.131114+0000", 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001241266 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.131682+0000", 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056811800000000005 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.131729+0000", 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7240999999999997e-05 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.131765+0000", 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6293e-05 2024-09-11T07:06:06.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1392 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head [stat,truncate 5242880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.128695+0000", 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.24398974900000001, 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003558575, 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1392 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128695+0000", 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128695+0000", 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128695+0000", 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128699+0000", 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5820000000000002e-06 2024-09-11T07:06:06.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128709+0000", 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9320000000000008e-06 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.128715+0000", 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.579e-06 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.130495+0000", 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017797220000000001 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.130611+0000", 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011604600000000001 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.130799+0000", 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000188195 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.132072+0000", 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00127238 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.132156+0000", 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3986000000000005e-05 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.132215+0000", 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9413000000000002e-05 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.132253+0000", 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8177999999999999e-05 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1409 3.0 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head [stat,truncate 3218184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.146242+0000", 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.22644250699999999, 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028543890000000001, 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1409 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.482 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146242+0000", 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146242+0000", 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146245+0000", 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9859999999999999e-06 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146262+0000", 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6657e-05 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146304+0000", 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2695999999999999e-05 2024-09-11T07:06:06.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146318+0000", 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3575e-05 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146404+0000", 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5975000000000003e-05 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146514+0000", 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109739 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146694+0000", 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018024 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.148062+0000", 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001368495 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.149010+0000", 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00094791500000000002 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.149053+0000", 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2191000000000003e-05 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.149096+0000", 2024-09-11T07:06:06.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.392e-05 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1412 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head [stat,truncate 3145728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.146353+0000", 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.226331068, 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031799939999999998, 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1412 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146353+0000", 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146353+0000", 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146354+0000", 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4399999999999999e-07 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146362+0000", 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9100000000000005e-06 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146372+0000", 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0125999999999999e-05 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146380+0000", 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7160000000000003e-06 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147035+0000", 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00065536000000000001 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147128+0000", 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2554999999999997e-05 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147294+0000", 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000165725 2024-09-11T07:06:06.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.148067+0000", 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00077372400000000005 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.149444+0000", 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0013763270000000001 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.149492+0000", 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8613999999999999e-05 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.149533+0000", 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1192999999999997e-05 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1416 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head [stat,truncate 3145728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.146395+0000", 2024-09-11T07:06:06.494 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.22628944500000001, 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032743590000000001, 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1416 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146395+0000", 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146395+0000", 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146396+0000", 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5199999999999996e-07 2024-09-11T07:06:06.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146400+0000", 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7950000000000001e-06 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146408+0000", 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0609999999999996e-06 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146414+0000", 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8310000000000003e-06 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147627+0000", 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001212566 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147704+0000", 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7443999999999999e-05 2024-09-11T07:06:06.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147844+0000", 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013905499999999999 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.149178+0000", 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001334078 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.149581+0000", 2024-09-11T07:06:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040345499999999999 2024-09-11T07:06:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.149631+0000", 2024-09-11T07:06:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0303999999999998e-05 2024-09-11T07:06:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.149669+0000", 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8118000000000003e-05 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1461 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head [stat,write 2360033~26488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.223546+0000", 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.149138829, 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0034007429999999999, 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:06.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1461 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.223546+0000", 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.223546+0000", 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.223549+0000", 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0170000000000001e-06 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.223579+0000", 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0266000000000001e-05 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.223613+0000", 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3565999999999997e-05 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.223629+0000", 2024-09-11T07:06:06.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6509999999999999e-05 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.223752+0000", 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012294199999999999 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.223941+0000", 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018850599999999999 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224192+0000", 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025147800000000002 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.226373+0000", 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021810829999999999 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.226742+0000", 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036844699999999999 2024-09-11T07:06:06.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.226839+0000", 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7231999999999993e-05 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.226946+0000", 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010769599999999999 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.508 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:06.508 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:06.508 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:06.510 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:06.511 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.511 INFO:teuthology.orchestra.run.smithi079.stdout:579 read 0x3fe414 thru 0x40cb12 (0xe6ff bytes) 2024-09-11T07:06:06.511 INFO:teuthology.orchestra.run.smithi079.stdout:580 writesame 0x9ded1b8 thru 0x9dfa7bf data_size 0x24(0xd608 bytes) 2024-09-11T07:06:06.511 INFO:teuthology.orchestra.run.smithi079.stdout:582 trunc from 0x9dfa7c0 to 0xb5afe73 2024-09-11T07:06:06.511 INFO:teuthology.orchestra.run.smithi079.stdout:583 punch from 0x613709d to 0x61424c1, (0xb424 bytes) 2024-09-11T07:06:06.511 INFO:teuthology.orchestra.run.smithi079.stdout:584 trunc from 0xb5afe73 to 0x473b44 2024-09-11T07:06:06.512 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:06.508+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:06.525 INFO:teuthology.orchestra.run.smithi079.stdout:586 write 0x8466f49 thru 0x8476d7a (0xfe32 bytes) 2024-09-11T07:06:06.532 INFO:teuthology.orchestra.run.smithi079.stdout:587 writesame 0x5b43833 thru 0x5b528c4 data_size 0x6a(0xf092 bytes) 2024-09-11T07:06:06.535 INFO:teuthology.orchestra.run.smithi079.stdout:590 punch from 0x4698b3a to 0x469f92c, (0x6df2 bytes) 2024-09-11T07:06:06.535 INFO:teuthology.orchestra.run.smithi079.stdout:593 read 0x11aa372 thru 0x11b1b2b (0x77ba bytes) 2024-09-11T07:06:06.536 INFO:teuthology.orchestra.run.smithi079.stdout:594 read 0x265b6ae thru 0x266af5d (0xf8b0 bytes) 2024-09-11T07:06:06.537 INFO:teuthology.orchestra.run.smithi079.stdout:595 write 0x663655b thru 0x6646214 (0xfcba bytes) 2024-09-11T07:06:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.541 INFO:teuthology.orchestra.run.smithi079.stdout:597 punch from 0x4380b0 to 0x4409f1, (0x8941 bytes) 2024-09-11T07:06:06.543 INFO:teuthology.orchestra.run.smithi079.stdout:598 trunc from 0x8476d7b to 0x7bf535f 2024-09-11T07:06:06.557 INFO:teuthology.orchestra.run.smithi079.stdout:599 write 0x1f33529 thru 0x1f338c4 (0x39c bytes) 2024-09-11T07:06:06.580 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:06.581 INFO:teuthology.orchestra.run.smithi079.stdout:600 writesame 0xc76bf71 thru 0xc77aa38 data_size 0xb(0xeac8 bytes) 2024-09-11T07:06:06.581 INFO:teuthology.orchestra.run.smithi079.stdout:601 write 0x68b0447 thru 0x68b1041 (0xbfb bytes) 2024-09-11T07:06:06.586 INFO:teuthology.orchestra.run.smithi079.stdout:604 write 0xc3eaef thru 0xc4654e (0x7a60 bytes) 2024-09-11T07:06:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:605 punch from 0x4d60642 to 0x4d68f6c, (0x892a bytes) 2024-09-11T07:06:06.592 INFO:teuthology.orchestra.run.smithi079.stdout:606 read 0x25172ee thru 0x2525e46 (0xeb59 bytes) 2024-09-11T07:06:06.605 INFO:teuthology.orchestra.run.smithi079.stdout:607 write 0xe0346b5 thru 0xe03b987 (0x72d3 bytes) 2024-09-11T07:06:06.610 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:06.608+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:06.610 INFO:teuthology.orchestra.run.smithi079.stdout:608 writesame 0x5319019 thru 0x53287ca data_size 0x55(0xf7b2 bytes) 2024-09-11T07:06:06.617 INFO:teuthology.orchestra.run.smithi079.stdout:609 write 0x9ec0543 thru 0x9ecc27a (0xbd38 bytes) 2024-09-11T07:06:06.621 INFO:teuthology.orchestra.run.smithi079.stdout:610 read 0x82af3af thru 0x82bb53a (0xc18c bytes) 2024-09-11T07:06:06.629 INFO:teuthology.orchestra.run.smithi079.stdout:611 trunc from 0xe03b988 to 0xa584a1f 2024-09-11T07:06:06.651 INFO:teuthology.orchestra.run.smithi079.stdout:612 write 0x520b46b thru 0x521b38a (0xff20 bytes) 2024-09-11T07:06:06.653 INFO:teuthology.orchestra.run.smithi079.stdout:613 read 0xf2fff6 thru 0xf310dd (0x10e8 bytes) 2024-09-11T07:06:06.653 INFO:teuthology.orchestra.run.smithi079.stdout:617 read 0x26dc7b7 thru 0x26ea6aa (0xdef4 bytes) 2024-09-11T07:06:06.654 INFO:teuthology.orchestra.run.smithi079.stdout:618 write 0x620d061 thru 0x620e148 (0x10e8 bytes) 2024-09-11T07:06:06.656 INFO:teuthology.orchestra.run.smithi079.stdout:619 read 0x67da3fd thru 0x67db4d5 (0x10d9 bytes) 2024-09-11T07:06:06.656 INFO:teuthology.orchestra.run.smithi079.stdout:620 writesame 0x8dac1e0 thru 0x8db279c data_size 0x1(0x65bd bytes) 2024-09-11T07:06:06.663 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:06.664 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:06.664 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:06.675 INFO:teuthology.orchestra.run.smithi079.stdout:624 trunc from 0xa584a1f to 0x8ed6dc9 2024-09-11T07:06:06.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:06.708 INFO:teuthology.orchestra.run.smithi079.stdout:625 writesame 0xe667fa5 thru 0xe676842 data_size 0xf(0xe89e bytes) 2024-09-11T07:06:06.708 INFO:teuthology.orchestra.run.smithi079.stdout:626 punch from 0xbe11669 to 0xbe1a956, (0x92ed bytes) 2024-09-11T07:06:06.708 INFO:teuthology.orchestra.run.smithi079.stdout:627 write 0x7941f13 thru 0x795053f (0xe62d bytes) 2024-09-11T07:06:06.711 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:06.712+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:06.715 INFO:teuthology.orchestra.run.smithi079.stdout:629 write 0x8c0f509 thru 0x8c133fc (0x3ef4 bytes) 2024-09-11T07:06:06.722 INFO:teuthology.orchestra.run.smithi079.stdout:630 write 0x26ee121 thru 0x26f65dd (0x84bd bytes) 2024-09-11T07:06:06.724 INFO:teuthology.orchestra.run.smithi079.stdout:631 punch from 0xb4dc465 to 0xb4e96bd, (0xd258 bytes) 2024-09-11T07:06:06.724 INFO:teuthology.orchestra.run.smithi079.stdout:633 punch from 0x3cfe6d5 to 0x3d01455, (0x2d80 bytes) 2024-09-11T07:06:06.725 INFO:teuthology.orchestra.run.smithi079.stdout:634 writesame 0xb8e2388 thru 0xb8f09bf data_size 0x35(0xe638 bytes) 2024-09-11T07:06:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:635 read 0x85ac6cf thru 0x85b3b4d (0x747f bytes) 2024-09-11T07:06:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:636 punch from 0x964da15 to 0x9655e3d, (0x8428 bytes) 2024-09-11T07:06:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.731 INFO:teuthology.orchestra.run.smithi079.stdout:639 writesame 0x79dee71 thru 0x79ed9c0 data_size 0x1e(0xeb50 bytes) 2024-09-11T07:06:06.738 INFO:teuthology.orchestra.run.smithi079.stdout:641 trunc from 0xe676843 to 0xc8f8f4c 2024-09-11T07:06:06.742 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:06.742 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:06.750 INFO:teuthology.orchestra.run.smithi079.stdout:644 read 0x6f65478 thru 0x6f6b602 (0x618b bytes) 2024-09-11T07:06:06.751 INFO:teuthology.orchestra.run.smithi079.stdout:645 writesame 0x11dfc6a thru 0x11ebdef data_size 0x45(0xc186 bytes) 2024-09-11T07:06:06.752 INFO:teuthology.orchestra.run.smithi079.stdout:648 punch from 0xc8f863b to 0xc8f8f4c, (0x911 bytes) 2024-09-11T07:06:06.760 INFO:teuthology.orchestra.run.smithi079.stdout:649 write 0xce5fc0e thru 0xce60aeb (0xede bytes) 2024-09-11T07:06:06.761 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:06.761 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:06.766 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.766 INFO:teuthology.orchestra.run.smithi079.stdout:652 read 0xbb9379 thru 0xbc66a2 (0xd32a bytes) 2024-09-11T07:06:06.766 INFO:teuthology.orchestra.run.smithi079.stdout:653 punch from 0x27a5fab to 0x27a9738, (0x378d bytes) 2024-09-11T07:06:06.766 INFO:teuthology.orchestra.run.smithi079.stdout:654 write 0xb3181ad thru 0xb318e8d (0xce1 bytes) 2024-09-11T07:06:06.772 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:657 read 0x2bb257 thru 0x2c2547 (0x72f1 bytes) 2024-09-11T07:06:06.773 INFO:teuthology.orchestra.run.smithi079.stdout:658 write 0x6c64d9 thru 0x6d4dfe (0xe926 bytes) 2024-09-11T07:06:06.778 INFO:teuthology.orchestra.run.smithi079.stdout:659 write 0x6638f40 thru 0x663cc07 (0x3cc8 bytes) 2024-09-11T07:06:06.779 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:06.779 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:661 read 0xb70e80c thru 0xb71336b (0x4b60 bytes) 2024-09-11T07:06:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.783 INFO:teuthology.orchestra.run.smithi079.stdout:663 write 0x17677ce thru 0x17766f2 (0xef25 bytes) 2024-09-11T07:06:06.787 INFO:teuthology.orchestra.run.smithi079.stdout:664 write 0xc205ef thru 0xc2ab46 (0xa558 bytes) 2024-09-11T07:06:06.789 INFO:teuthology.orchestra.run.smithi079.stdout:665 write 0x7b4dfff thru 0x7b4f2fb (0x12fd bytes) 2024-09-11T07:06:06.791 INFO:teuthology.orchestra.run.smithi079.stdout:667 read 0x8c7f63d thru 0x8c807aa (0x116e bytes) 2024-09-11T07:06:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:669 read 0x7cdedf2 thru 0x7ce7ad5 (0x8ce4 bytes) 2024-09-11T07:06:06.793 INFO:teuthology.orchestra.run.smithi079.stdout:671 write 0x142ba75 thru 0x142e433 (0x29bf bytes) 2024-09-11T07:06:06.795 INFO:teuthology.orchestra.run.smithi079.stdout:673 writesame 0xbfc5141 thru 0xbfcaa0c data_size 0x2(0x58cc bytes) 2024-09-11T07:06:06.797 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:06.797 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.810 INFO:teuthology.orchestra.run.smithi079.stdout:675 punch from 0x747fdae to 0x748192d, (0x1b7f bytes) 2024-09-11T07:06:06.811 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:06.810+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:06.819 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:06.819 INFO:teuthology.orchestra.run.smithi079.stdout:676 write 0xd42bb2e thru 0xd43893b (0xce0e bytes) 2024-09-11T07:06:06.823 INFO:teuthology.orchestra.run.smithi079.stdout:677 writesame 0x7135021 thru 0x714241e data_size 0x5a(0xd3fe bytes) 2024-09-11T07:06:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:678 read 0xc5e4919 thru 0xc5e53d1 (0xab9 bytes) 2024-09-11T07:06:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:679 punch from 0x41c9c2d to 0x41d212e, (0x8501 bytes) 2024-09-11T07:06:06.830 INFO:teuthology.orchestra.run.smithi079.stdout:680 read 0xd03804c thru 0xd0410dc (0x9091 bytes) 2024-09-11T07:06:06.831 INFO:teuthology.orchestra.run.smithi079.stdout:681 read 0x8e3a503 thru 0x8e3b377 (0xe75 bytes) 2024-09-11T07:06:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:06.832 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:06.841 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:06.841 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:06.843 INFO:teuthology.orchestra.run.smithi079.stdout:682 trunc from 0xd43893c to 0x4ccd7d0 2024-09-11T07:06:06.856 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:06.867 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.867 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.867 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:06.867 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:06.870 INFO:teuthology.orchestra.run.smithi079.stdout:686 trunc from 0x4ccd7d0 to 0x22d6d1b 2024-09-11T07:06:06.888 INFO:teuthology.orchestra.run.smithi079.stdout:688 trunc from 0x22d6d1b to 0x426c66 2024-09-11T07:06:06.894 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:06.895 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:06.912 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:06.912+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:06.913 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.913 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.913 INFO:teuthology.orchestra.run.smithi079.stdout:691 read 0x13456f thru 0x13ca24 (0x84b6 bytes) 2024-09-11T07:06:06.935 INFO:teuthology.orchestra.run.smithi079.stdout:692 write 0x8623fef thru 0x862a0d2 (0x60e4 bytes) 2024-09-11T07:06:06.941 INFO:teuthology.orchestra.run.smithi079.stdout:693 read 0x43ddabf thru 0x43e7f98 (0xa4da bytes) 2024-09-11T07:06:06.941 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:06.941 INFO:teuthology.orchestra.run.smithi079.stdout:695 read 0x7a34fff thru 0x7a442c0 (0xf2c2 bytes) 2024-09-11T07:06:06.941 INFO:teuthology.orchestra.run.smithi079.stdout:696 trunc from 0x862a0d3 to 0x846dacf 2024-09-11T07:06:06.958 INFO:teuthology.orchestra.run.smithi079.stdout:697 writesame 0x8a319fc thru 0x8a3e687 data_size 0x35(0xcc8c bytes) 2024-09-11T07:06:06.971 INFO:teuthology.orchestra.run.smithi079.stdout:698 write 0xb6537d6 thru 0xb6560da (0x2905 bytes) 2024-09-11T07:06:06.977 INFO:teuthology.orchestra.run.smithi079.stdout:699 write 0xa5c6fec thru 0xa5cf90c (0x8921 bytes) 2024-09-11T07:06:06.982 INFO:teuthology.orchestra.run.smithi079.stdout:700 punch from 0x12715cc to 0x12724fc, (0xf30 bytes) 2024-09-11T07:06:06.987 INFO:teuthology.orchestra.run.smithi079.stdout:701 trunc from 0xb6560db to 0x7469aa1 2024-09-11T07:06:06.997 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:06.997 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:07.003 INFO:teuthology.orchestra.run.smithi079.stdout:702 writesame 0x25c368a thru 0x25c6bef data_size 0x5(0x3566 bytes) 2024-09-11T07:06:07.006 INFO:teuthology.orchestra.run.smithi079.stdout:703 write 0x37b1263 thru 0x37bf519 (0xe2b7 bytes) 2024-09-11T07:06:07.013 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:07.013 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:07.010+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:07.022 INFO:teuthology.orchestra.run.smithi079.stdout:704 writesame 0x76dd7c7 thru 0x76e7628 data_size 0x26(0x9e62 bytes) 2024-09-11T07:06:07.022 INFO:teuthology.orchestra.run.smithi079.stdout:706 punch from 0x1473f04 to 0x1483d0b, (0xfe07 bytes) 2024-09-11T07:06:07.022 INFO:teuthology.orchestra.run.smithi079.stdout:707 write 0x138e551 thru 0x139b1ce (0xcc7e bytes) 2024-09-11T07:06:07.042 INFO:teuthology.orchestra.run.smithi079.stdout:708 writesame 0xb870ada thru 0xb879fa3 data_size 0x41(0x94ca bytes) 2024-09-11T07:06:07.043 INFO:teuthology.orchestra.run.smithi079.stdout:711 writesame 0x7f2903d thru 0x7f31abd data_size 0x35(0x8a81 bytes) 2024-09-11T07:06:07.045 INFO:teuthology.orchestra.run.smithi079.stdout:712 write 0x9343c6f thru 0x9344cf8 (0x108a bytes) 2024-09-11T07:06:07.048 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:07.048 INFO:teuthology.orchestra.run.smithi079.stdout:714 read 0x29a8a0b thru 0x29ac18a (0x3780 bytes) 2024-09-11T07:06:07.049 INFO:teuthology.orchestra.run.smithi079.stdout:715 read 0xb2086ea thru 0xb213ca8 (0xb5bf bytes) 2024-09-11T07:06:07.049 INFO:teuthology.orchestra.run.smithi079.stdout:716 read 0x1d1eba5 thru 0x1d2a3e0 (0xb83c bytes) 2024-09-11T07:06:07.050 INFO:teuthology.orchestra.run.smithi079.stdout:720 write 0xb57eef4 thru 0xb58ee4c (0xff59 bytes) 2024-09-11T07:06:07.058 INFO:teuthology.orchestra.run.smithi079.stdout:721 punch from 0x473a8f0 to 0x4748735, (0xde45 bytes) 2024-09-11T07:06:07.061 INFO:teuthology.orchestra.run.smithi079.stdout:722 trunc from 0xb879fa4 to 0xdd4b255 2024-09-11T07:06:07.071 INFO:teuthology.orchestra.run.smithi079.stdout:723 write 0x290f173 thru 0x2918a19 (0x98a7 bytes) 2024-09-11T07:06:07.079 INFO:teuthology.orchestra.run.smithi079.stdout:725 read 0x950c670 thru 0x950d4a1 (0xe32 bytes) 2024-09-11T07:06:07.079 INFO:teuthology.orchestra.run.smithi079.stdout:727 punch from 0xa0656e7 to 0xa06fe9c, (0xa7b5 bytes) 2024-09-11T07:06:07.099 INFO:teuthology.orchestra.run.smithi079.stdout:728 trunc from 0xdd4b255 to 0x7b2e05 2024-09-11T07:06:07.114 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:07.110+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:07.147 INFO:teuthology.orchestra.run.smithi079.stdout:729 write 0x61d4163 thru 0x61e1333 (0xd1d1 bytes) 2024-09-11T07:06:07.148 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:07.148 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:07.166 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:07.166 INFO:teuthology.orchestra.run.smithi079.stdout:730 write 0x7b268b5 thru 0x7b27a12 (0x115e bytes) 2024-09-11T07:06:07.172 INFO:teuthology.orchestra.run.smithi079.stdout:731 read 0x3915a99 thru 0x391b50e (0x5a76 bytes) 2024-09-11T07:06:07.172 INFO:teuthology.orchestra.run.smithi079.stdout:732 write 0x7321097 thru 0x7322dc2 (0x1d2c bytes) 2024-09-11T07:06:07.178 INFO:teuthology.orchestra.run.smithi079.stdout:733 read 0x78d1cd4 thru 0x78e0122 (0xe44f bytes) 2024-09-11T07:06:07.192 INFO:teuthology.orchestra.run.smithi079.stdout:734 writesame 0x9fbc358 thru 0x9fc1744 data_size 0x1(0x53ed bytes) 2024-09-11T07:06:07.192 INFO:teuthology.orchestra.run.smithi079.stdout:738 writesame 0x282fbc4 thru 0x283d81e data_size 0x1(0xdc5b bytes) 2024-09-11T07:06:07.215 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:07.216+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:07.233 INFO:teuthology.orchestra.run.smithi079.stdout:742 read 0x9672f8 thru 0x975347 (0xe050 bytes) 2024-09-11T07:06:07.234 INFO:teuthology.orchestra.run.smithi079.stdout:743 punch from 0x856d087 to 0x85709cc, (0x3945 bytes) 2024-09-11T07:06:07.234 INFO:teuthology.orchestra.run.smithi079.stdout:744 writesame 0x167dcf8 thru 0x1686219 data_size 0x1(0x8522 bytes) 2024-09-11T07:06:07.249 INFO:teuthology.orchestra.run.smithi079.stdout:746 punch from 0x80e91f7 to 0x80f3574, (0xa37d bytes) 2024-09-11T07:06:07.249 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:07.249 INFO:teuthology.orchestra.run.smithi079.stdout:749 read 0x588e4fc thru 0x588f926 (0x142b bytes) 2024-09-11T07:06:07.249 INFO:teuthology.orchestra.run.smithi079.stdout:750 read 0x35441e4 thru 0x354b6ae (0x74cb bytes) 2024-09-11T07:06:07.250 INFO:teuthology.orchestra.run.smithi079.stdout:752 read 0x35e6e73 thru 0x35f30c4 (0xc252 bytes) 2024-09-11T07:06:07.250 INFO:teuthology.orchestra.run.smithi079.stdout:753 read 0xd73d4 thru 0xe1290 (0x9ebd bytes) 2024-09-11T07:06:07.251 INFO:teuthology.orchestra.run.smithi079.stdout:755 write 0x62e4de4 thru 0x62eb02f (0x624c bytes) 2024-09-11T07:06:07.263 INFO:teuthology.orchestra.run.smithi079.stdout:756 trunc from 0x9fc1745 to 0x42a65f8 2024-09-11T07:06:07.290 INFO:teuthology.orchestra.run.smithi079.stdout:757 punch from 0x1587cf0 to 0x159161e, (0x992e bytes) 2024-09-11T07:06:07.290 INFO:teuthology.orchestra.run.smithi079.stdout:760 read 0x2877e18 thru 0x287e800 (0x69e9 bytes) 2024-09-11T07:06:07.290 INFO:teuthology.orchestra.run.smithi079.stdout:761 read 0x817647 thru 0x81c999 (0x5353 bytes) 2024-09-11T07:06:07.291 INFO:teuthology.orchestra.run.smithi079.stdout:762 read 0xfae8e9 thru 0xfb7220 (0x8938 bytes) 2024-09-11T07:06:07.291 INFO:teuthology.orchestra.run.smithi079.stdout:763 read 0x1481c20 thru 0x1489e03 (0x81e4 bytes) 2024-09-11T07:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:07.302 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:07.305 INFO:teuthology.orchestra.run.smithi079.stdout:764 write 0x684c2f8 thru 0x6854149 (0x7e52 bytes) 2024-09-11T07:06:07.308 INFO:teuthology.orchestra.run.smithi079.stdout:766 clone 2 order 23 su 65536 sc 2 2024-09-11T07:06:07.315 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:07.316+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:07.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:07.417 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:07.414+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:07.485 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:07.486 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:07.500 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:07.548 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:07.546+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:07.618 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:07.614+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:07.630 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:07.630 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:07.645 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:07.731 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:07.730+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:07.789 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:06:07.789 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:06:07.789 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T07:06:07.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T07:06:07.809 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:07.809 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:07.819 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:07.818+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:07.822 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:07.920 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:07.918+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:07.986 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:07.987 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:08.000 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:08.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:08.020+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:08.104 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:06:08.104 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:08.104 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 27, 2024-09-11T07:06:08.104 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "e1313abd-54a9-4e53-ab67-469f744048b1", 2024-09-11T07:06:08.104 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-11T07:05:29.098467+0000", 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-11T07:06:06.223634+0000", 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-11T07:05:41.051856+0000", 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-11T07:05:31.688503+0000", 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5799936, 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T07:06:08.105 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "squid", 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:41.897005+0000", 2024-09-11T07:06:08.106 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-11T07:06:08.107 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:06:08.108 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:06:08.109 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:06:08.110 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.111 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 8, 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 8, 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.25, 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:47.687214+0000", 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:06:08.113 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:06:08.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "20", 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 2, 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 20, 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:06:08.115 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:06:08.116 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:06:08.117 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.9900000095367432, 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.9900000095367432, 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.75, 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.75, 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-11T07:06:08.118 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:57.298060+0000", 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:06:08.119 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-11T07:06:08.120 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-11T07:06:08.120 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-11T07:06:08.120 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-11T07:06:08.120 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-11T07:06:08.120 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:06:08.120 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:06:08.120 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:06:08.120 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:06:08.120 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:06:08.120 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "26", 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 3, 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 26, 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:06:08.121 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:06:08.122 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:06:08.123 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.5, 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.5, 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 1, 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.5, 2024-09-11T07:06:08.124 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.5, 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "24d57cdb-2f3a-4a96-903d-11be7dc26a20", 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:08.125 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/1708235775", 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/1708235775", 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/1708235775", 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/1708235775", 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:08.130 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "aa51dc1b-b783-4212-8736-1f666239613b", 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:08.131 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.132 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.133 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:08.135 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/2076268206", 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/2076268206", 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/2076268206", 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/2076268206", 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:06:08.136 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "141a913f-7353-44a9-9dbd-70219bcee638", 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:08.140 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/1904492349", 2024-09-11T07:06:08.141 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/1904492349", 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/1904492349", 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/1904492349", 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "32550aeb-0c8d-4ca9-afd5-3e5258e7255b", 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:08.142 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-11T07:06:08.145 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:08.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/1327328912", 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/1327328912", 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/1327328912", 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/1327328912", 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:08.147 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc", 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:08.148 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6808", 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6809", 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.149 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6810", 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6811", 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6814", 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6815", 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6812", 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6813", 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.152 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6809/4087452871", 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6811/4087452871", 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6815/4087452871", 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6813/4087452871", 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "42c83053-328e-4c9b-bdaf-09e1a4cc8b7d", 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:08.153 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6824", 2024-09-11T07:06:08.154 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6825", 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6826", 2024-09-11T07:06:08.155 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6827", 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6830", 2024-09-11T07:06:08.156 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6831", 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.157 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6828", 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6829", 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6825/2133006853", 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6827/2133006853", 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6831/2133006853", 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6829/2133006853", 2024-09-11T07:06:08.158 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "0ab29b1f-3012-4528-8f47-2cac908122c9", 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:08.159 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6816", 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.160 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6817", 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6818", 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.161 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6819", 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6822", 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.162 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6823", 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6820", 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.163 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6821", 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6817/2083734892", 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6819/2083734892", 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6823/2083734892", 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6821/2083734892", 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d9c7d12b-be93-41c9-a246-773faa65ecaf", 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:08.165 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:08.166 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.166 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6800", 2024-09-11T07:06:08.166 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:08.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.166 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.166 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6801", 2024-09-11T07:06:08.166 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6802", 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6803", 2024-09-11T07:06:08.167 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6806", 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6807", 2024-09-11T07:06:08.168 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6804", 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6805", 2024-09-11T07:06:08.169 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6801/2322042784", 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6803/2322042784", 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2322042784", 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2322042784", 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:08.170 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.653648+0000", 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:08.171 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.846269+0000", 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:08.172 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.970884+0000", 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.985630+0000", 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.236412+0000", 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:08.174 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.336953+0000", 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:08.175 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.306806+0000", 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.104744+0000", 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.176 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-11T07:06:08.177 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [ 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 2, 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 1 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:08.178 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:08.179 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:08.180 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:08.180 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:08.182 INFO:tasks.thrashosds.thrasher:j is {'epoch': 27, 'fsid': 'e1313abd-54a9-4e53-ab67-469f744048b1', 'created': '2024-09-11T07:05:29.098467+0000', 'modified': '2024-09-11T07:06:06.223634+0000', 'last_up_change': '2024-09-11T07:05:41.051856+0000', 'last_in_change': '2024-09-11T07:05:31.688503+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T07:05:41.897005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T07:05:47.687214+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T07:05:57.298060+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 3, 'snap_epoch': 26, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '24d57cdb-2f3a-4a96-903d-11be7dc26a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6825', 'nonce': 1708235775}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6826', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 1708235775}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6830', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 1708235775}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6829', 'nonce': 1708235775}]}, 'public_addr': '172.21.15.79:6825/1708235775', 'cluster_addr': '172.21.15.79:6827/1708235775', 'heartbeat_back_addr': '172.21.15.79:6831/1708235775', 'heartbeat_front_addr': '172.21.15.79:6829/1708235775', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa51dc1b-b783-4212-8736-1f666239613b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 2076268206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 2076268206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 2076268206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 2076268206}]}, 'public_addr': '172.21.15.79:6801/2076268206', 'cluster_addr': '172.21.15.79:6803/2076268206', 'heartbeat_back_addr': '172.21.15.79:6807/2076268206', 'heartbeat_front_addr': '172.21.15.79:6805/2076268206', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '141a913f-7353-44a9-9dbd-70219bcee638', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6817', 'nonce': 1904492349}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6818', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1904492349}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6822', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 1904492349}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6821', 'nonce': 1904492349}]}, 'public_addr': '172.21.15.79:6817/1904492349', 'cluster_addr': '172.21.15.79:6819/1904492349', 'heartbeat_back_addr': '172.21.15.79:6823/1904492349', 'heartbeat_front_addr': '172.21.15.79:6821/1904492349', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '32550aeb-0c8d-4ca9-afd5-3e5258e7255b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 1327328912}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 1327328912}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 1327328912}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 1327328912}]}, 'public_addr': '172.21.15.79:6809/1327328912', 'cluster_addr': '172.21.15.79:6811/1327328912', 'heartbeat_back_addr': '172.21.15.79:6815/1327328912', 'heartbeat_front_addr': '172.21.15.79:6813/1327328912', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 4087452871}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 4087452871}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 4087452871}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 4087452871}]}, 'public_addr': '172.21.15.110:6809/4087452871', 'cluster_addr': '172.21.15.110:6811/4087452871', 'heartbeat_back_addr': '172.21.15.110:6815/4087452871', 'heartbeat_front_addr': '172.21.15.110:6813/4087452871', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '42c83053-328e-4c9b-bdaf-09e1a4cc8b7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 2133006853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 2133006853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 2133006853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 2133006853}]}, 'public_addr': '172.21.15.110:6825/2133006853', 'cluster_addr': '172.21.15.110:6827/2133006853', 'heartbeat_back_addr': '172.21.15.110:6831/2133006853', 'heartbeat_front_addr': '172.21.15.110:6829/2133006853', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0ab29b1f-3012-4528-8f47-2cac908122c9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 2083734892}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 2083734892}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 2083734892}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 2083734892}]}, 'public_addr': '172.21.15.110:6817/2083734892', 'cluster_addr': '172.21.15.110:6819/2083734892', 'heartbeat_back_addr': '172.21.15.110:6823/2083734892', 'heartbeat_front_addr': '172.21.15.110:6821/2083734892', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'd9c7d12b-be93-41c9-a246-773faa65ecaf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2322042784}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2322042784}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2322042784}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2322042784}]}, 'public_addr': '172.21.15.110:6801/2322042784', 'cluster_addr': '172.21.15.110:6803/2322042784', 'heartbeat_back_addr': '172.21.15.110:6807/2322042784', 'heartbeat_front_addr': '172.21.15.110:6805/2322042784', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.653648+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.846269+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.970884+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.985630+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.236412+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.336953+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.306806+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.104744+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 2, 'length': 1}]}], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T07:06:08.182 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:06:08.182 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:08.180+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:08.186 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:08.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:06:08.281 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:08.278+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:08.310 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:08.310 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:08.324 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:08.343 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone1 from 0x685414a (overlap 0x426c66) to 0x1a91c2 2024-09-11T07:06:08.411 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:08.410+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:08.418 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #0, image image_client.0 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent1 2024-09-11T07:06:08.483 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:08.478+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:08.489 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:08.489 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:08.504 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:08.573 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:06:08.574 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:06:08.591 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-11T07:06:08.238367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":88028291,"num_objects":38,"num_object_clones":0,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":3856,"num_read_kb":4414,"num_write":1135,"num_write_kb":8393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":911,"ondisk_log_size":911,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":240088,"kb_used_data":3072,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754734632,"statfs":{"total":773094113280,"available":772848263168,"internally_reserved":0,"allocated":3145728,"data_stored":3171458,"data_compressed":375203,"data_compressed_allocated":512000,"data_compressed_original":2142208,"omap_allocated":12760,"internal_metadata":242535976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":87437839,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":3706,"num_read_kb":4288,"num_write":968,"num_write_kb":5969,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.027567"},"pg_stats":[{"pgid":"3.1f","version":"25'15","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.230514+0000","last_change":"2024-09-11T07:06:00.826807+0000","last_active":"2024-09-11T07:06:06.230514+0000","last_peered":"2024-09-11T07:06:06.230514+0000","last_clean":"2024-09-11T07:06:06.230514+0000","last_became_active":"2024-09-11T07:05:58.836990+0000","last_became_peered":"2024-09-11T07:05:58.836990+0000","last_unstale":"2024-09-11T07:06:06.230514+0000","last_undegraded":"2024-09-11T07:06:06.230514+0000","last_fullsized":"2024-09-11T07:06:06.230514+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:34:05.267038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097647200000000004,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":1,"num_write":15,"num_write_kb":187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1e","version":"25'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.238602+0000","last_change":"2024-09-11T07:06:00.970173+0000","last_active":"2024-09-11T07:06:06.238602+0000","last_peered":"2024-09-11T07:06:06.238602+0000","last_clean":"2024-09-11T07:06:06.238602+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:06:06.238602+0000","last_undegraded":"2024-09-11T07:06:06.238602+0000","last_fullsized":"2024-09-11T07:06:06.238602+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:29:17.635167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084787600000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1d","version":"25'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.233430+0000","last_change":"2024-09-11T07:06:00.825433+0000","last_active":"2024-09-11T07:06:06.233430+0000","last_peered":"2024-09-11T07:06:06.233430+0000","last_clean":"2024-09-11T07:06:06.233430+0000","last_became_active":"2024-09-11T07:05:58.827234+0000","last_became_peered":"2024-09-11T07:05:58.827234+0000","last_unstale":"2024-09-11T07:06:06.233430+0000","last_undegraded":"2024-09-11T07:06:06.233430+0000","last_fullsized":"2024-09-11T07:06:06.233430+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:29:13.321030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550473,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1c","version":"27'13","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.594677+0000","last_change":"2024-09-11T07:06:00.827149+0000","last_active":"2024-09-11T07:06:06.594677+0000","last_peered":"2024-09-11T07:06:06.594677+0000","last_clean":"2024-09-11T07:06:06.594677+0000","last_became_active":"2024-09-11T07:05:58.826843+0000","last_became_peered":"2024-09-11T07:05:58.826843+0000","last_unstale":"2024-09-11T07:06:06.594677+0000","last_undegraded":"2024-09-11T07:06:06.594677+0000","last_fullsized":"2024-09-11T07:06:06.594677+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:06:44.418914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022332319999999999,"stat_sum":{"num_bytes":2057971,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":21,"num_read_kb":63,"num_write":13,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1b","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.230696+0000","last_change":"2024-09-11T07:06:00.826913+0000","last_active":"2024-09-11T07:06:06.230696+0000","last_peered":"2024-09-11T07:06:06.230696+0000","last_clean":"2024-09-11T07:06:06.230696+0000","last_became_active":"2024-09-11T07:05:58.809515+0000","last_became_peered":"2024-09-11T07:05:58.809515+0000","last_unstale":"2024-09-11T07:06:06.230696+0000","last_undegraded":"2024-09-11T07:06:06.230696+0000","last_fullsized":"2024-09-11T07:06:06.230696+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:03:20.295444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001182787,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.1a","version":"27'4","reported_seq":140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.793389+0000","last_change":"2024-09-11T07:06:00.813235+0000","last_active":"2024-09-11T07:06:06.793389+0000","last_peered":"2024-09-11T07:06:06.793389+0000","last_clean":"2024-09-11T07:06:06.793389+0000","last_became_active":"2024-09-11T07:05:58.808656+0000","last_became_peered":"2024-09-11T07:05:58.808656+0000","last_unstale":"2024-09-11T07:06:06.793389+0000","last_undegraded":"2024-09-11T07:06:06.793389+0000","last_fullsized":"2024-09-11T07:06:06.793389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:03:20.295444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059322499999999996,"stat_sum":{"num_bytes":4820641,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":110,"num_write":4,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.19","version":"25'13","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.229560+0000","last_change":"2024-09-11T07:06:00.820857+0000","last_active":"2024-09-11T07:06:06.229560+0000","last_peered":"2024-09-11T07:06:06.229560+0000","last_clean":"2024-09-11T07:06:06.229560+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:06:06.229560+0000","last_undegraded":"2024-09-11T07:06:06.229560+0000","last_fullsized":"2024-09-11T07:06:06.229560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:06:00.378576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076385799999999996,"stat_sum":{"num_bytes":2069345,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":75,"num_write":13,"num_write_kb":260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.18","version":"27'15","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.463709+0000","last_change":"2024-09-11T07:06:00.970030+0000","last_active":"2024-09-11T07:06:06.463709+0000","last_peered":"2024-09-11T07:06:06.463709+0000","last_clean":"2024-09-11T07:06:06.463709+0000","last_became_active":"2024-09-11T07:05:58.809573+0000","last_became_peered":"2024-09-11T07:05:58.809573+0000","last_unstale":"2024-09-11T07:06:06.463709+0000","last_undegraded":"2024-09-11T07:06:06.463709+0000","last_fullsized":"2024-09-11T07:06:06.463709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:12.894550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001212451,"stat_sum":{"num_bytes":524288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":75,"num_write":16,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.17","version":"26'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.230699+0000","last_change":"2024-09-11T07:06:00.826609+0000","last_active":"2024-09-11T07:06:06.230699+0000","last_peered":"2024-09-11T07:06:06.230699+0000","last_clean":"2024-09-11T07:06:06.230699+0000","last_became_active":"2024-09-11T07:05:58.836977+0000","last_became_peered":"2024-09-11T07:05:58.836977+0000","last_unstale":"2024-09-11T07:06:06.230699+0000","last_undegraded":"2024-09-11T07:06:06.230699+0000","last_fullsized":"2024-09-11T07:06:06.230699+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:28:28.187274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093584899999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.16","version":"27'201","reported_seq":240,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.655215+0000","last_change":"2024-09-11T07:06:00.825499+0000","last_active":"2024-09-11T07:06:06.655215+0000","last_peered":"2024-09-11T07:06:06.655215+0000","last_clean":"2024-09-11T07:06:06.655215+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:06:06.655215+0000","last_undegraded":"2024-09-11T07:06:06.655215+0000","last_fullsized":"2024-09-11T07:06:06.655215+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:52:24.764600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056977600000000003,"stat_sum":{"num_bytes":8065132,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":883,"num_read_kb":862,"num_write":311,"num_write_kb":450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.15","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.241136+0000","last_change":"2024-09-11T07:06:00.837150+0000","last_active":"2024-09-11T07:06:06.241136+0000","last_peered":"2024-09-11T07:06:06.241136+0000","last_clean":"2024-09-11T07:06:06.241136+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:06:06.241136+0000","last_undegraded":"2024-09-11T07:06:06.241136+0000","last_fullsized":"2024-09-11T07:06:06.241136+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:31:36.865335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184086,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.14","version":"25'8","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.229254+0000","last_change":"2024-09-11T07:06:00.812896+0000","last_active":"2024-09-11T07:06:06.229254+0000","last_peered":"2024-09-11T07:06:06.229254+0000","last_clean":"2024-09-11T07:06:06.229254+0000","last_became_active":"2024-09-11T07:05:58.814550+0000","last_became_peered":"2024-09-11T07:05:58.814550+0000","last_unstale":"2024-09-11T07:06:06.229254+0000","last_undegraded":"2024-09-11T07:06:06.229254+0000","last_fullsized":"2024-09-11T07:06:06.229254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:34:05.267038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046265999999999999,"stat_sum":{"num_bytes":2700895,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":176,"num_write":8,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.7","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.382841+0000","last_change":"2024-09-11T07:05:51.290755+0000","last_active":"2024-09-11T07:06:06.382841+0000","last_peered":"2024-09-11T07:06:06.382841+0000","last_clean":"2024-09-11T07:06:06.382841+0000","last_became_active":"2024-09-11T07:05:49.149584+0000","last_became_peered":"2024-09-11T07:05:49.149584+0000","last_unstale":"2024-09-11T07:06:06.382841+0000","last_undegraded":"2024-09-11T07:06:06.382841+0000","last_fullsized":"2024-09-11T07:06:06.382841+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:37:52.879340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00074652400000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"27'23","reported_seq":53,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.851039+0000","last_change":"2024-09-11T07:06:00.826127+0000","last_active":"2024-09-11T07:06:06.851039+0000","last_peered":"2024-09-11T07:06:06.851039+0000","last_clean":"2024-09-11T07:06:06.851039+0000","last_became_active":"2024-09-11T07:05:58.811377+0000","last_became_peered":"2024-09-11T07:05:58.811377+0000","last_unstale":"2024-09-11T07:06:06.851039+0000","last_undegraded":"2024-09-11T07:06:06.851039+0000","last_fullsized":"2024-09-11T07:06:06.851039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:01:23.196049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056190700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":52,"num_write":22,"num_write_kb":209,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.230141+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:06:06.230141+0000","last_peered":"2024-09-11T07:06:06.230141+0000","last_clean":"2024-09-11T07:06:06.230141+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:06:06.230141+0000","last_undegraded":"2024-09-11T07:06:06.230141+0000","last_fullsized":"2024-09-11T07:06:06.230141+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.237870+0000","last_change":"2024-09-11T07:06:00.969789+0000","last_active":"2024-09-11T07:06:06.237870+0000","last_peered":"2024-09-11T07:06:06.237870+0000","last_clean":"2024-09-11T07:06:06.237870+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:06:06.237870+0000","last_undegraded":"2024-09-11T07:06:06.237870+0000","last_fullsized":"2024-09-11T07:06:06.237870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:10:03.459510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068823799999999998,"stat_sum":{"num_bytes":271391,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":5,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.241463+0000","last_change":"2024-09-11T07:05:51.786713+0000","last_active":"2024-09-11T07:06:06.241463+0000","last_peered":"2024-09-11T07:06:06.241463+0000","last_clean":"2024-09-11T07:06:06.241463+0000","last_became_active":"2024-09-11T07:05:49.724679+0000","last_became_peered":"2024-09-11T07:05:49.724679+0000","last_unstale":"2024-09-11T07:06:06.241463+0000","last_undegraded":"2024-09-11T07:06:06.241463+0000","last_fullsized":"2024-09-11T07:06:06.241463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:36:43.830759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.229914+0000","last_change":"2024-09-11T07:06:00.821584+0000","last_active":"2024-09-11T07:06:06.229914+0000","last_peered":"2024-09-11T07:06:06.229914+0000","last_clean":"2024-09-11T07:06:06.229914+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:06:06.229914+0000","last_undegraded":"2024-09-11T07:06:06.229914+0000","last_fullsized":"2024-09-11T07:06:06.229914+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:54:19.624122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001413975,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.229993+0000","last_change":"2024-09-11T07:05:51.151362+0000","last_active":"2024-09-11T07:06:06.229993+0000","last_peered":"2024-09-11T07:06:06.229993+0000","last_clean":"2024-09-11T07:06:06.229993+0000","last_became_active":"2024-09-11T07:05:49.725356+0000","last_became_peered":"2024-09-11T07:05:49.725356+0000","last_unstale":"2024-09-11T07:06:06.229993+0000","last_undegraded":"2024-09-11T07:06:06.229993+0000","last_fullsized":"2024-09-11T07:06:06.229993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:53.822013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"27'134","reported_seq":172,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.815452+0000","last_change":"2024-09-11T07:06:00.827482+0000","last_active":"2024-09-11T07:06:06.815452+0000","last_peered":"2024-09-11T07:06:06.815452+0000","last_clean":"2024-09-11T07:06:06.815452+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:06:06.815452+0000","last_undegraded":"2024-09-11T07:06:06.815452+0000","last_fullsized":"2024-09-11T07:06:06.815452+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:58.929326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002494839,"stat_sum":{"num_bytes":7481635,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":567,"num_read_kb":596,"num_write":206,"num_write_kb":591,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.3","version":"27'23","reported_seq":54,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.612121+0000","last_change":"2024-09-11T07:06:00.812921+0000","last_active":"2024-09-11T07:06:06.612121+0000","last_peered":"2024-09-11T07:06:06.612121+0000","last_clean":"2024-09-11T07:06:06.612121+0000","last_became_active":"2024-09-11T07:05:58.808560+0000","last_became_peered":"2024-09-11T07:05:58.808560+0000","last_unstale":"2024-09-11T07:06:06.612121+0000","last_undegraded":"2024-09-11T07:06:06.612121+0000","last_fullsized":"2024-09-11T07:06:06.612121+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:46.451374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040103300000000002,"stat_sum":{"num_bytes":2308293,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":64,"num_write":23,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.233241+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:06:06.233241+0000","last_peered":"2024-09-11T07:06:06.233241+0000","last_clean":"2024-09-11T07:06:06.233241+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:06:06.233241+0000","last_undegraded":"2024-09-11T07:06:06.233241+0000","last_fullsized":"2024-09-11T07:06:06.233241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"27'50","reported_seq":103,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.726958+0000","last_change":"2024-09-11T07:06:00.820656+0000","last_active":"2024-09-11T07:06:06.726958+0000","last_peered":"2024-09-11T07:06:06.726958+0000","last_clean":"2024-09-11T07:06:06.726958+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:06:06.726958+0000","last_undegraded":"2024-09-11T07:06:06.726958+0000","last_fullsized":"2024-09-11T07:06:06.726958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:31:56.561199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058463999999999999,"stat_sum":{"num_bytes":17611914,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":62,"num_read_kb":317,"num_write":53,"num_write_kb":617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.259923+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:06:06.259923+0000","last_peered":"2024-09-11T07:06:06.259923+0000","last_clean":"2024-09-11T07:06:06.259923+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:06:06.259923+0000","last_undegraded":"2024-09-11T07:06:06.259923+0000","last_fullsized":"2024-09-11T07:06:06.259923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"27'64","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.852030+0000","last_change":"2024-09-11T07:06:00.826070+0000","last_active":"2024-09-11T07:06:06.852030+0000","last_peered":"2024-09-11T07:06:06.852030+0000","last_clean":"2024-09-11T07:06:06.852030+0000","last_became_active":"2024-09-11T07:05:58.817151+0000","last_became_peered":"2024-09-11T07:05:58.817151+0000","last_unstale":"2024-09-11T07:06:06.852030+0000","last_undegraded":"2024-09-11T07:06:06.852030+0000","last_fullsized":"2024-09-11T07:06:06.852030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":0,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:02:19.267721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070404599999999995,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":680,"num_read_kb":605,"num_write":65,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.241012+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:06:06.241012+0000","last_peered":"2024-09-11T07:06:06.241012+0000","last_clean":"2024-09-11T07:06:06.241012+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:06:06.241012+0000","last_undegraded":"2024-09-11T07:06:06.241012+0000","last_fullsized":"2024-09-11T07:06:06.241012+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"27'11","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.384368+0000","last_change":"2024-09-11T07:06:00.970754+0000","last_active":"2024-09-11T07:06:06.384368+0000","last_peered":"2024-09-11T07:06:06.384368+0000","last_clean":"2024-09-11T07:06:06.384368+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:06:06.384368+0000","last_undegraded":"2024-09-11T07:06:06.384368+0000","last_fullsized":"2024-09-11T07:06:06.384368+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:44:50.367748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013822890000000001,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":11,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.233197+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:06:06.233197+0000","last_peered":"2024-09-11T07:06:06.233197+0000","last_clean":"2024-09-11T07:06:06.233197+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:06:06.233197+0000","last_undegraded":"2024-09-11T07:06:06.233197+0000","last_fullsized":"2024-09-11T07:06:06.233197+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.241041+0000","last_change":"2024-09-11T07:05:43.785344+0000","last_active":"2024-09-11T07:06:06.241041+0000","last_peered":"2024-09-11T07:06:06.241041+0000","last_clean":"2024-09-11T07:06:06.241041+0000","last_became_active":"2024-09-11T07:05:43.783090+0000","last_became_peered":"2024-09-11T07:05:43.783090+0000","last_unstale":"2024-09-11T07:06:06.241041+0000","last_undegraded":"2024-09-11T07:06:06.241041+0000","last_fullsized":"2024-09-11T07:06:06.241041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:32.027951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"25'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.237672+0000","last_change":"2024-09-11T07:06:00.970646+0000","last_active":"2024-09-11T07:06:06.237672+0000","last_peered":"2024-09-11T07:06:06.237672+0000","last_clean":"2024-09-11T07:06:06.237672+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:06:06.237672+0000","last_undegraded":"2024-09-11T07:06:06.237672+0000","last_fullsized":"2024-09-11T07:06:06.237672+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:16:32.045574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012611810000000001,"stat_sum":{"num_bytes":4029626,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":34,"num_write":5,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.9","version":"25'6","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.228891+0000","last_change":"2024-09-11T07:06:00.813164+0000","last_active":"2024-09-11T07:06:06.228891+0000","last_peered":"2024-09-11T07:06:06.228891+0000","last_clean":"2024-09-11T07:06:06.228891+0000","last_became_active":"2024-09-11T07:05:59.016079+0000","last_became_peered":"2024-09-11T07:05:59.016079+0000","last_unstale":"2024-09-11T07:06:06.228891+0000","last_undegraded":"2024-09-11T07:06:06.228891+0000","last_fullsized":"2024-09-11T07:06:06.228891+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:01:23.196049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062012700000000005,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":6,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.a","version":"27'23","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.542913+0000","last_change":"2024-09-11T07:06:00.994321+0000","last_active":"2024-09-11T07:06:06.542913+0000","last_peered":"2024-09-11T07:06:06.542913+0000","last_clean":"2024-09-11T07:06:06.542913+0000","last_became_active":"2024-09-11T07:05:58.828129+0000","last_became_peered":"2024-09-11T07:05:58.828129+0000","last_unstale":"2024-09-11T07:06:06.542913+0000","last_undegraded":"2024-09-11T07:06:06.542913+0000","last_fullsized":"2024-09-11T07:06:06.542913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:25:13.921768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046764000000000002,"stat_sum":{"num_bytes":7627285,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":57,"num_write":23,"num_write_kb":433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.b","version":"27'15","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.655591+0000","last_change":"2024-09-11T07:06:00.971293+0000","last_active":"2024-09-11T07:06:06.655591+0000","last_peered":"2024-09-11T07:06:06.655591+0000","last_clean":"2024-09-11T07:06:06.655591+0000","last_became_active":"2024-09-11T07:05:58.809044+0000","last_became_peered":"2024-09-11T07:05:58.809044+0000","last_unstale":"2024-09-11T07:06:06.655591+0000","last_undegraded":"2024-09-11T07:06:06.655591+0000","last_fullsized":"2024-09-11T07:06:06.655591+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:49.991408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021149200000000002,"stat_sum":{"num_bytes":5878667,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":29,"num_write":16,"num_write_kb":229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.c","version":"27'17","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.383647+0000","last_change":"2024-09-11T07:06:00.827407+0000","last_active":"2024-09-11T07:06:06.383647+0000","last_peered":"2024-09-11T07:06:06.383647+0000","last_clean":"2024-09-11T07:06:06.383647+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:06:06.383647+0000","last_undegraded":"2024-09-11T07:06:06.383647+0000","last_fullsized":"2024-09-11T07:06:06.383647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:00:45.918153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024738579999999998,"stat_sum":{"num_bytes":524288,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":34,"num_write":17,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.d","version":"25'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.241401+0000","last_change":"2024-09-11T07:06:00.838531+0000","last_active":"2024-09-11T07:06:06.241401+0000","last_peered":"2024-09-11T07:06:06.241401+0000","last_clean":"2024-09-11T07:06:06.241401+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:06:06.241401+0000","last_undegraded":"2024-09-11T07:06:06.241401+0000","last_fullsized":"2024-09-11T07:06:06.241401+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:38:40.906735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022638789999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.e","version":"26'73","reported_seq":536,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.241529+0000","last_change":"2024-09-11T07:06:00.837799+0000","last_active":"2024-09-11T07:06:06.241529+0000","last_peered":"2024-09-11T07:06:06.241529+0000","last_clean":"2024-09-11T07:06:06.241529+0000","last_became_active":"2024-09-11T07:05:58.825160+0000","last_became_peered":"2024-09-11T07:05:58.825160+0000","last_unstale":"2024-09-11T07:06:06.241529+0000","last_undegraded":"2024-09-11T07:06:06.241529+0000","last_fullsized":"2024-09-11T07:06:06.241529+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:00:49.667875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017910619999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1268,"num_read_kb":1116,"num_write":70,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.f","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.743587+0000","last_change":"2024-09-11T07:06:00.838063+0000","last_active":"2024-09-11T07:06:06.743587+0000","last_peered":"2024-09-11T07:06:06.743587+0000","last_clean":"2024-09-11T07:06:06.743587+0000","last_became_active":"2024-09-11T07:05:58.822422+0000","last_became_peered":"2024-09-11T07:05:58.822422+0000","last_unstale":"2024-09-11T07:06:06.743587+0000","last_undegraded":"2024-09-11T07:06:06.743587+0000","last_fullsized":"2024-09-11T07:06:06.743587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:48:18.922565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020506280000000001,"stat_sum":{"num_bytes":6815744,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.10","version":"26'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.382845+0000","last_change":"2024-09-11T07:06:00.994312+0000","last_active":"2024-09-11T07:06:06.382845+0000","last_peered":"2024-09-11T07:06:06.382845+0000","last_clean":"2024-09-11T07:06:06.382845+0000","last_became_active":"2024-09-11T07:05:58.828930+0000","last_became_peered":"2024-09-11T07:05:58.828930+0000","last_unstale":"2024-09-11T07:06:06.382845+0000","last_undegraded":"2024-09-11T07:06:06.382845+0000","last_fullsized":"2024-09-11T07:06:06.382845+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:39:40.596390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049279100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":12,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.11","version":"25'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.241048+0000","last_change":"2024-09-11T07:06:00.836320+0000","last_active":"2024-09-11T07:06:06.241048+0000","last_peered":"2024-09-11T07:06:06.241048+0000","last_clean":"2024-09-11T07:06:06.241048+0000","last_became_active":"2024-09-11T07:05:58.822373+0000","last_became_peered":"2024-09-11T07:05:58.822373+0000","last_unstale":"2024-09-11T07:06:06.241048+0000","last_undegraded":"2024-09-11T07:06:06.241048+0000","last_fullsized":"2024-09-11T07:06:06.241048+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:29:39.672808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089665299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.12","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.744209+0000","last_change":"2024-09-11T07:06:00.826460+0000","last_active":"2024-09-11T07:06:06.744209+0000","last_peered":"2024-09-11T07:06:06.744209+0000","last_clean":"2024-09-11T07:06:06.744209+0000","last_became_active":"2024-09-11T07:05:58.833983+0000","last_became_peered":"2024-09-11T07:05:58.833983+0000","last_unstale":"2024-09-11T07:06:06.744209+0000","last_undegraded":"2024-09-11T07:06:06.744209+0000","last_fullsized":"2024-09-11T07:06:06.744209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:37:46.451374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086507200000000004,"stat_sum":{"num_bytes":263199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":39,"num_write":11,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"3.13","version":"27'12","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-09-11T07:06:06.824874+0000","last_change":"2024-09-11T07:06:00.836900+0000","last_active":"2024-09-11T07:06:06.824874+0000","last_peered":"2024-09-11T07:06:06.824874+0000","last_clean":"2024-09-11T07:06:06.824874+0000","last_became_active":"2024-09-11T07:05:58.823540+0000","last_became_peered":"2024-09-11T07:05:58.823540+0000","last_unstale":"2024-09-11T07:06:06.824874+0000","last_undegraded":"2024-09-11T07:06:06.824874+0000","last_fullsized":"2024-09-11T07:06:06.824874+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:13:19.487946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012764899999999999,"stat_sum":{"num_bytes":14387516,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":12,"num_write_kb":336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":87437904,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":3740,"num_read_kb":4314,"num_write":974,"num_write_kb":5975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1433600,"data_stored":2402517,"data_compressed":684262,"data_compressed_allocated":827392,"data_compressed_original":2105344,"omap_allocated":0,"internal_metadata":0},"log_size":791,"ondisk_log_size":791,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31576,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340264,"statfs":{"total":96636764160,"available":96604430336,"internally_reserved":0,"allocated":397312,"data_stored":792646,"data_compressed":39065,"data_compressed_allocated":77824,"data_compressed_original":663552,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":278528,"data_stored":105527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":323584,"data_stored":173400,"data_compressed":124,"data_compressed_allocated":4096,"data_compressed_original":61440,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31520,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340320,"statfs":{"total":96636764160,"available":96604487680,"internally_reserved":0,"allocated":344064,"data_stored":169152,"data_compressed":33209,"data_compressed_allocated":36864,"data_compressed_original":53248,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":291428,"data_compressed":69123,"data_compressed_allocated":77824,"data_compressed_original":172032,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":397312,"data_stored":273108,"data_compressed":66499,"data_compressed_allocated":77824,"data_compressed_original":143360,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":536576,"data_stored":498082,"data_compressed":105086,"data_compressed_allocated":131072,"data_compressed_original":327680,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31652,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340188,"statfs":{"total":96636764160,"available":96604352512,"internally_reserved":0,"allocated":471040,"data_stored":868115,"data_compressed":62097,"data_compressed_allocated":106496,"data_compressed_original":720896,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":113584,"data_compressed":40940,"data_compressed_allocated":49152,"data_compressed_original":102400,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":386735,"data_compressed":105086,"data_compressed_allocated":131072,"data_compressed_original":327680,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":259255,"data_compressed":51398,"data_compressed_allocated":69632,"data_compressed_original":221184,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":233472,"data_stored":368318,"data_compressed":133093,"data_compressed_allocated":151552,"data_compressed_original":331776,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":466330,"data_compressed":143473,"data_compressed_allocated":167936,"data_compressed_original":405504,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":260124,"data_compressed":69215,"data_compressed_allocated":81920,"data_compressed_original":229376,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":64698,"data_compressed":30758,"data_compressed_allocated":32768,"data_compressed_original":49152,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":483473,"data_compressed":110299,"data_compressed_allocated":143360,"data_compressed_original":438272,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:06:08.594 INFO:tasks.thrashosds.thrasher:Setting 3.9 to [3, 0, 5, 6] 2024-09-11T07:06:08.594 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.9', '3', '0', '5', '6'] 2024-09-11T07:06:08.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.9 3 0 5 6 2024-09-11T07:06:08.594 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:08.590+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:08.663 INFO:teuthology.orchestra.run.smithi079.stdout:767 writesame 0xb7828ec thru 0xb789594 data_size 0x1(0x6ca9 bytes) 2024-09-11T07:06:08.664 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:08.664 INFO:teuthology.orchestra.run.smithi079.stdout:769 trunc from 0xb789595 to 0xab94e55 2024-09-11T07:06:08.668 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:08.668 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:08.676 INFO:teuthology.orchestra.run.smithi079.stdout:770 write 0x58907c2 thru 0x589e7c9 (0xe008 bytes) 2024-09-11T07:06:08.685 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:08.685 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:08.682+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:08.692 INFO:teuthology.orchestra.run.smithi079.stdout:771 writesame 0x4558ce1 thru 0x4566b73 data_size 0x27(0xde93 bytes) 2024-09-11T07:06:08.713 INFO:teuthology.orchestra.run.smithi079.stdout:772 writesame 0x9cf2607 thru 0x9cfa73f data_size 0x1(0x8139 bytes) 2024-09-11T07:06:08.733 INFO:teuthology.orchestra.run.smithi079.stdout:773 read 0xd6d30b thru 0xd7c06f (0xed65 bytes) 2024-09-11T07:06:08.734 INFO:teuthology.orchestra.run.smithi079.stdout:774 read 0xc0fbc6 thru 0xc1cfc2 (0xd3fd bytes) 2024-09-11T07:06:08.735 INFO:teuthology.orchestra.run.smithi079.stdout:775 punch from 0x708416e to 0x7086bb1, (0x2a43 bytes) 2024-09-11T07:06:08.735 INFO:teuthology.orchestra.run.smithi079.stdout:776 read 0x5c52bd7 thru 0x5c62882 (0xfcac bytes) 2024-09-11T07:06:08.735 INFO:teuthology.orchestra.run.smithi079.stdout:777 write 0x9d480d2 thru 0x9d56cb1 (0xebe0 bytes) 2024-09-11T07:06:08.739 INFO:teuthology.orchestra.run.smithi079.stdout:778 read 0x1921262 thru 0x19222dc (0x107b bytes) 2024-09-11T07:06:08.742 INFO:teuthology.orchestra.run.smithi079.stdout:779 trunc from 0xab94e55 to 0x8725fe3 2024-09-11T07:06:08.767 INFO:teuthology.orchestra.run.smithi079.stdout:780 write 0xd697dfd thru 0xd6a4877 (0xca7b bytes) 2024-09-11T07:06:08.772 INFO:teuthology.orchestra.run.smithi079.stdout:781 write 0x14d6956 thru 0x14de608 (0x7cb3 bytes) 2024-09-11T07:06:08.781 INFO:teuthology.orchestra.run.smithi079.stdout:782 read 0x302b065 thru 0x303967c (0xe618 bytes) 2024-09-11T07:06:08.781 INFO:teuthology.orchestra.run.smithi079.stdout:783 write 0x4d08c32 thru 0x4d09a32 (0xe01 bytes) 2024-09-11T07:06:08.783 INFO:teuthology.orchestra.run.smithi079.stdout:784 writesame 0x1a16c15 thru 0x1a16d55 data_size 0x1(0x141 bytes) 2024-09-11T07:06:08.785 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:08.782+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:08.797 INFO:teuthology.orchestra.run.smithi079.stdout:785 trunc from 0xd6a4878 to 0x3058e29 2024-09-11T07:06:08.802 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:06:08.841 INFO:teuthology.orchestra.run.smithi079.stdout:786 trunc from 0x3058e29 to 0x867e57a 2024-09-11T07:06:08.847 INFO:teuthology.orchestra.run.smithi079.stdout:787 punch from 0x625c694 to 0x6269725, (0xd091 bytes) 2024-09-11T07:06:08.847 INFO:teuthology.orchestra.run.smithi079.stdout:788 read 0x354f856 thru 0x35531ae (0x3959 bytes) 2024-09-11T07:06:08.848 INFO:teuthology.orchestra.run.smithi079.stdout:790 punch from 0x83963e3 to 0x8398747, (0x2364 bytes) 2024-09-11T07:06:08.848 INFO:teuthology.orchestra.run.smithi079.stdout:791 read 0x4ad69e4 thru 0x4adcfe7 (0x6604 bytes) 2024-09-11T07:06:08.848 INFO:teuthology.orchestra.run.smithi079.stdout:792 writesame 0x6ce5d6 thru 0x6dcdff data_size 0x1(0xe82a bytes) 2024-09-11T07:06:08.870 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:08.870 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:08.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:08.884+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:08.886 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:08.892 INFO:teuthology.orchestra.run.smithi079.stdout:793 clone 3 order 21 su 16384 sc 15 2024-09-11T07:06:08.917 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:08.986 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:08.982+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:09.047 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:09.057 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:09.058 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:09.062 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:09.074 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:09.074 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:09.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:09.088+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:09.090 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:09.091 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:09.107 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:09.107 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:09.127 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:09.128 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:09.145 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:09.145 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:09.165 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:09.166 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:09.183 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:09.183 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:09.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:09.188+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:09.228 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:09.228 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:09.228 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:09.228 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:09.242 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:09.289 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:09.286+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:09.363 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:09.364 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:09.364 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:09.364 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:09.364 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:09.377 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:09.420 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:09.418+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:09.491 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:09.492+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:09.546 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.475921153000002, 2024-09-11T07:06:09.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:09.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:06:09.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:06:09.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:85 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940473+0000", 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.603757406, 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010826193, 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.553 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 85 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940473+0000", 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940473+0000", 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940475+0000", 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7600000000000001e-06 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940486+0000", 2024-09-11T07:06:09.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1156e-05 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940506+0000", 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9925999999999999e-05 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940522+0000", 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5457000000000001e-05 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.943943+0000", 2024-09-11T07:06:09.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034213609999999999 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.944183+0000", 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240385 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.944540+0000", 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035704399999999999 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950870+0000", 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0063301140000000004 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950981+0000", 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011061300000000001 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951136+0000", 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015498500000000001 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951299+0000", 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000163392 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:86 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940545+0000", 2024-09-11T07:06:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.603685370000001, 2024-09-11T07:06:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011233303, 2024-09-11T07:06:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 86 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940545+0000", 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940545+0000", 2024-09-11T07:06:09.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940547+0000", 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3999999999999999e-06 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940557+0000", 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0566e-05 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940581+0000", 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4066999999999998e-05 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940599+0000", 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.802e-05 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.945443+0000", 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048435459999999998 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.945699+0000", 2024-09-11T07:06:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025649199999999998 2024-09-11T07:06:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.946048+0000", 2024-09-11T07:06:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034892000000000001 2024-09-11T07:06:09.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950883+0000", 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048349789999999997 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951603+0000", 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00072007799999999997 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951681+0000", 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8002000000000003e-05 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951779+0000", 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7232999999999996e-05 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.566 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940649+0000", 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.603581474999999, 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012003827999999999, 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87 2024-09-11T07:06:09.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940649+0000", 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940649+0000", 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940651+0000", 2024-09-11T07:06:09.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.73e-06 2024-09-11T07:06:09.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940781+0000", 2024-09-11T07:06:09.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013028900000000001 2024-09-11T07:06:09.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940839+0000", 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7813999999999999e-05 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940856+0000", 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7462999999999999e-05 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.946932+0000", 2024-09-11T07:06:09.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060756860000000003 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.947149+0000", 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021673499999999999 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.947520+0000", 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037156800000000002 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950893+0000", 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033723199999999998 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.952399+0000", 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015064519999999999 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.952549+0000", 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014964199999999999 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.952653+0000", 2024-09-11T07:06:09.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010412900000000001 2024-09-11T07:06:09.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.573 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.573 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.573 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.940888+0000", 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.603342619999999, 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012343412, 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 88 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940888+0000", 2024-09-11T07:06:09.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940888+0000", 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940890+0000", 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.81e-06 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940902+0000", 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2207e-05 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940923+0000", 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0866e-05 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.940956+0000", 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3189999999999999e-05 2024-09-11T07:06:09.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.949744+0000", 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.008788176 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.949873+0000", 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000129085 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.950072+0000", 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019907900000000001 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.951334+0000", 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012619269999999999 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.953038+0000", 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0017033370000000001 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.953124+0000", 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5835999999999996e-05 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.953231+0000", 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107899 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.579 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104385+0000", 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.439845861999999, 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011221050999999999, 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104385+0000", 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104385+0000", 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104386+0000", 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2869999999999999e-06 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104478+0000", 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1875999999999999e-05 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104494+0000", 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6327000000000001e-05 2024-09-11T07:06:09.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104503+0000", 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1859999999999998e-06 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.112017+0000", 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0075131690000000001 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.112142+0000", 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000125683 2024-09-11T07:06:09.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.112347+0000", 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020447799999999999 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114485+0000", 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021379569999999998 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115419+0000", 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00093446899999999995 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115496+0000", 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6353000000000006e-05 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115606+0000", 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110266 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104521+0000", 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.439709466, 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014408172, 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.587 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.587 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 110 2024-09-11T07:06:09.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.587 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104521+0000", 2024-09-11T07:06:09.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104521+0000", 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104522+0000", 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0860000000000001e-06 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104531+0000", 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3999999999999992e-06 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104541+0000", 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0277e-05 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104548+0000", 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3100000000000003e-06 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114581+0000", 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01003277 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114706+0000", 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124902 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.114894+0000", 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018778800000000001 2024-09-11T07:06:09.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118539+0000", 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003645279 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118689+0000", 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000150345 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118763+0000", 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3720000000000006e-05 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118929+0000", 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016629500000000001 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104561+0000", 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.439669519999999, 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014554475000000001, 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 111 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.593 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104561+0000", 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104561+0000", 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104562+0000", 2024-09-11T07:06:09.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4399999999999999e-07 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104571+0000", 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1500000000000005e-06 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104581+0000", 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6760000000000002e-06 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104588+0000", 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1169999999999998e-06 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115711+0000", 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011123141 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.115986+0000", 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027494800000000001 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.116341+0000", 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035464999999999997 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118669+0000", 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0023285519999999998 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.118945+0000", 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027566100000000002 2024-09-11T07:06:09.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119016+0000", 2024-09-11T07:06:09.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0915999999999997e-05 2024-09-11T07:06:09.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119116+0000", 2024-09-11T07:06:09.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9820000000000003e-05 2024-09-11T07:06:09.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.599 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.599 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.599 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104600+0000", 2024-09-11T07:06:09.599 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.439630163, 2024-09-11T07:06:09.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016285293999999999, 2024-09-11T07:06:09.599 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.599 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 112 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104600+0000", 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104600+0000", 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104601+0000", 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2999999999999999e-07 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104791+0000", 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018977100000000001 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104805+0000", 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4226999999999999e-05 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104815+0000", 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3200000000000006e-06 2024-09-11T07:06:09.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.117204+0000", 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012389331 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.117328+0000", 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012422900000000001 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.117544+0000", 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021566900000000001 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120679+0000", 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003135245 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120698+0000", 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8753000000000002e-05 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120769+0000", 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1229999999999994e-05 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.120886+0000", 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011668899999999999 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104833+0000", 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.439397175, 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021630725999999999, 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 113 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104833+0000", 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104833+0000", 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104835+0000", 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:06:09.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104842+0000", 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2429999999999999e-06 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104852+0000", 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0414000000000001e-05 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104860+0000", 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5460000000000003e-06 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119211+0000", 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014351126000000001 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119441+0000", 2024-09-11T07:06:09.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023001799999999999 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.119799+0000", 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00035755699999999999 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.122532+0000", 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0027336890000000001 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126211+0000", 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0036784090000000001 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126342+0000", 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131882 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126464+0000", 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121712 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.611 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104874+0000", 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.439356362000002, 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021780498999999998, 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.613 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 114 2024-09-11T07:06:09.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.613 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104874+0000", 2024-09-11T07:06:09.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104874+0000", 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104875+0000", 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9299999999999997e-07 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104881+0000", 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1e-06 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104909+0000", 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7433e-05 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104917+0000", 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2770000000000005e-06 2024-09-11T07:06:09.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.121050+0000", 2024-09-11T07:06:09.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016133179000000001 2024-09-11T07:06:09.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.121288+0000", 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023799800000000001 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.121656+0000", 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036769 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126030+0000", 2024-09-11T07:06:09.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0043747439999999999 2024-09-11T07:06:09.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126487+0000", 2024-09-11T07:06:09.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00045610900000000001 2024-09-11T07:06:09.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126556+0000", 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9423000000000003e-05 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126655+0000", 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8752999999999995e-05 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.619 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.439299119000001, 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021917907, 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 115 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.620 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.104932+0000", 2024-09-11T07:06:09.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8599999999999997e-07 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105093+0000", 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016076900000000001 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105133+0000", 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0006999999999998e-05 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105146+0000", 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2612999999999999e-05 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.122642+0000", 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017495825 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.122911+0000", 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026968800000000002 2024-09-11T07:06:09.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.123283+0000", 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037215399999999997 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126185+0000", 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0029011639999999999 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126684+0000", 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00049918599999999999 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126753+0000", 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8786000000000002e-05 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126849+0000", 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6829000000000004e-05 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.105166+0000", 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.439065077999999, 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023310450999999999, 2024-09-11T07:06:09.626 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 116 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105166+0000", 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105166+0000", 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105167+0000", 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.057e-06 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105174+0000", 2024-09-11T07:06:09.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1199999999999996e-06 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105188+0000", 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4426e-05 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105196+0000", 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.52e-06 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.124500+0000", 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.019304808 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.124754+0000", 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025354899999999999 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.125141+0000", 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00038675299999999999 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128258+0000", 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031168459999999999 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128278+0000", 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9922999999999999e-05 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128358+0000", 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.0729999999999994e-05 2024-09-11T07:06:09.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128476+0000", 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117719 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.105209+0000", 2024-09-11T07:06:09.632 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 25.439021785000001, 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.023639472000000002, 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 117 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105209+0000", 2024-09-11T07:06:09.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105209+0000", 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105210+0000", 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7000000000000003e-07 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105218+0000", 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1370000000000002e-06 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105231+0000", 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3132999999999999e-05 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.105240+0000", 2024-09-11T07:06:09.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3100000000000006e-06 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.126951+0000", 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.021710526000000001 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.127194+0000", 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024300799999999999 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.127570+0000", 2024-09-11T07:06:09.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000375798 2024-09-11T07:06:09.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128630+0000", 2024-09-11T07:06:09.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001060538 2024-09-11T07:06:09.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128675+0000", 2024-09-11T07:06:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4946e-05 2024-09-11T07:06:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128749+0000", 2024-09-11T07:06:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3880000000000004e-05 2024-09-11T07:06:09.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.128848+0000", 2024-09-11T07:06:09.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9326000000000004e-05 2024-09-11T07:06:09.639 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.639 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.639 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.639 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:44.606193+0000", 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.938037226999999, 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011487111, 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 141 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606193+0000", 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606193+0000", 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606195+0000", 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606208+0000", 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3497e-05 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606235+0000", 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6747e-05 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.606256+0000", 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0869999999999998e-05 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614487+0000", 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0082313420000000009 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614637+0000", 2024-09-11T07:06:09.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000149574 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.614806+0000", 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000168863 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.615807+0000", 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010008770000000001 2024-09-11T07:06:09.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.617561+0000", 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001753831 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.617632+0000", 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1007999999999995e-05 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:44.617681+0000", 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9016e-05 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:156 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337363+0000", 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.206867949999999, 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011142044, 2024-09-11T07:06:09.646 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 156 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337363+0000", 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337363+0000", 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337364+0000", 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0359999999999999e-06 2024-09-11T07:06:09.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337374+0000", 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0297e-05 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337386+0000", 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1596999999999999e-05 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337393+0000", 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.396e-06 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.343057+0000", 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056641759999999999 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.343311+0000", 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000253945 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.343681+0000", 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00037009 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348060+0000", 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00437828 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348257+0000", 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000197102 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348398+0000", 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014153200000000001 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348505+0000", 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000106593 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:157 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:09.652 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337407+0000", 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.206823877000001, 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011354912, 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 157 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337407+0000", 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337407+0000", 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337408+0000", 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7300000000000005e-07 2024-09-11T07:06:09.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337420+0000", 2024-09-11T07:06:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2627e-05 2024-09-11T07:06:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337431+0000", 2024-09-11T07:06:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0817e-05 2024-09-11T07:06:09.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337439+0000", 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.746e-06 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.344911+0000", 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.007472299 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.345169+0000", 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025795400000000002 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.345374+0000", 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020457900000000001 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348216+0000", 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0028425640000000001 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348530+0000", 2024-09-11T07:06:09.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00031385799999999998 2024-09-11T07:06:09.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348662+0000", 2024-09-11T07:06:09.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013236500000000001 2024-09-11T07:06:09.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348762+0000", 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9329999999999999e-05 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:158 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337451+0000", 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.206779280999999, 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015895230999999999, 2024-09-11T07:06:09.659 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 158 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337451+0000", 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337451+0000", 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337452+0000", 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9699999999999995e-07 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337581+0000", 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012876900000000001 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337594+0000", 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2897e-05 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337602+0000", 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2830000000000001e-06 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.346160+0000", 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0085578100000000008 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.346406+0000", 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024632099999999997 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.346774+0000", 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000367924 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348797+0000", 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0020230180000000001 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.353084+0000", 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0042867369999999997 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.353239+0000", 2024-09-11T07:06:09.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015480600000000001 2024-09-11T07:06:09.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.353347+0000", 2024-09-11T07:06:09.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010786899999999999 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:159 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16)", 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:45.337618+0000", 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.206612585999999, 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018603607000000001, 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 159 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337618+0000", 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337618+0000", 2024-09-11T07:06:09.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337619+0000", 2024-09-11T07:06:09.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9699999999999994e-07 2024-09-11T07:06:09.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337633+0000", 2024-09-11T07:06:09.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4123e-05 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337645+0000", 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1347e-05 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.337652+0000", 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7770000000000002e-06 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.348854+0000", 2024-09-11T07:06:09.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011201823 2024-09-11T07:06:09.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.349013+0000", 2024-09-11T07:06:09.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000158522 2024-09-11T07:06:09.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.349220+0000", 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020700499999999999 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.350829+0000", 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001609388 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.355974+0000", 2024-09-11T07:06:09.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051445670000000001 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.356123+0000", 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014918200000000001 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:45.356222+0000", 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8876000000000007e-05 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.672 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:1707 3.13 3:cf81b412:::rbd_data.11611d63ad3f.0000000000000013:head [write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:06.797510+0000", 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 2.7467204020000002, 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014293406999999999, 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:09.673 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1707 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.797510+0000", 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.797510+0000", 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:09.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.797512+0000", 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2369999999999999e-06 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.797524+0000", 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-05 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.797555+0000", 2024-09-11T07:06:09.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0652999999999999e-05 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.797570+0000", 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5176e-05 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.797688+0000", 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000117543 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.797827+0000", 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013922199999999999 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.799950+0000", 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021225940000000002 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.811558+0000", 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01160897 2024-09-11T07:06:09.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.811641+0000", 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2515999999999994e-05 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.811730+0000", 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9387000000000003e-05 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:09.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:06.811804+0000", 2024-09-11T07:06:09.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3249000000000003e-05 2024-09-11T07:06:09.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.679 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:09.679 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:09.679 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:09.681 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:09.681 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:09.680+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:09.781 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:09.780+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:09.801 INFO:teuthology.orchestra.run.smithi079.stderr:set 3.9 pg_upmap_items mapping to [3->0,5->6] 2024-09-11T07:06:09.819 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:09.819 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:09.819 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:09.819 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:09.835 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:09.883 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:09.884+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:09.958 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone2 from 0x867e57a (overlap 0x3058e29) to 0x1356c10 2024-09-11T07:06:09.983 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:09.984+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:10.007 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:10.007 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:10.008 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:10.008 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:10.023 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:10.115 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:10.116+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:10.126 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #1, image image_client.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent2 2024-09-11T07:06:10.159 INFO:teuthology.orchestra.run.smithi079.stdout:794 write 0xd289d51 thru 0xd296418 (0xc6c8 bytes) 2024-09-11T07:06:10.169 INFO:teuthology.orchestra.run.smithi079.stdout:795 write 0x4acd404 thru 0x4acfa23 (0x2620 bytes) 2024-09-11T07:06:10.179 INFO:teuthology.orchestra.run.smithi079.stdout:796 writesame 0x95f7d89 thru 0x96030be data_size 0x71(0xb336 bytes) 2024-09-11T07:06:10.185 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:10.182+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:10.190 INFO:teuthology.orchestra.run.smithi079.stdout:797 read 0x33d1485 thru 0x33dfc27 (0xe7a3 bytes) 2024-09-11T07:06:10.192 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:10.192 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:10.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:10.192 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:10.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.192 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:74 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'48, mlcod=15'43)", 2024-09-11T07:06:10.192 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.921230+0000", 2024-09-11T07:06:10.192 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.269643309999999, 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046482040000000004, 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921230+0000", 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921230+0000", 2024-09-11T07:06:10.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921231+0000", 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.277e-06 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921240+0000", 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2530000000000004e-06 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921261+0000", 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1897000000000001e-05 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921273+0000", 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1576000000000001e-05 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921399+0000", 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012553600000000001 2024-09-11T07:06:10.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.921430+0000", 2024-09-11T07:06:10.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1690000000000003e-05 2024-09-11T07:06:10.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.925789+0000", 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004358603 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.925878+0000", 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9371999999999997e-05 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:85 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'55, mlcod=15'50)", 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.945750+0000", 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.245122861999999, 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046609199999999998, 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945750+0000", 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945750+0000", 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945753+0000", 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1730000000000002e-06 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945768+0000", 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4970000000000001e-05 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945801+0000", 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2982999999999999e-05 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945819+0000", 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8127000000000001e-05 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945956+0000", 2024-09-11T07:06:10.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013683200000000001 2024-09-11T07:06:10.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.945995+0000", 2024-09-11T07:06:10.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9382999999999999e-05 2024-09-11T07:06:10.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.950324+0000", 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043285930000000004 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.950411+0000", 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7859e-05 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.202 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:86 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'56, mlcod=15'50)", 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:43.947190+0000", 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.243682907, 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051138299999999998, 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947190+0000", 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947190+0000", 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947192+0000", 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.747e-06 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947202+0000", 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0142999999999999e-05 2024-09-11T07:06:10.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947226+0000", 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3997000000000001e-05 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947239+0000", 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2666e-05 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947322+0000", 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3316e-05 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.947350+0000", 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.745e-05 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.952210+0000", 2024-09-11T07:06:10.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048603789999999997 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:43.952304+0000", 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4131999999999999e-05 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:144 1.0 e16/14 1:30306672:devicehealth::main.db.0000000000000000:head v 16'102, mlcod=16'98)", 2024-09-11T07:06:10.207 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.621438+0000", 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.569435104, 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055383699999999999, 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621438+0000", 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621438+0000", 2024-09-11T07:06:10.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621440+0000", 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.967e-06 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621534+0000", 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3945999999999998e-05 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621555+0000", 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1308999999999999e-05 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621570+0000", 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5004000000000001e-05 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621720+0000", 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000149579 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.621752+0000", 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2376000000000003e-05 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.626921+0000", 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051684069999999999 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.626977+0000", 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5782000000000002e-05 2024-09-11T07:06:10.211 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:145 1.0 e16/14 1:30306672:devicehealth::main.db.0000000000000000:head v 16'103, mlcod=16'98)", 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:44.622301+0000", 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 25.568571900999999, 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047136870000000003, 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622301+0000", 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622301+0000", 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622302+0000", 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.04e-06 2024-09-11T07:06:10.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622435+0000", 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000132683 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622470+0000", 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5142999999999999e-05 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622485+0000", 2024-09-11T07:06:10.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4236000000000001e-05 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622567+0000", 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2663000000000005e-05 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.622596+0000", 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9295999999999999e-05 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.626981+0000", 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0043843859999999997 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:44.627015+0000", 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4239999999999997e-05 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:158 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'112, mlcod=16'108)", 2024-09-11T07:06:10.216 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:45.348000+0000", 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.842873685000001, 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056739099999999999, 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348000+0000", 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348000+0000", 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348001+0000", 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.24e-06 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348108+0000", 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000107339 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348127+0000", 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9040000000000001e-05 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348146+0000", 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8879999999999999e-05 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348234+0000", 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7756999999999993e-05 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.348247+0000", 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3057000000000001e-05 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.353637+0000", 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005390181 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.353674+0000", 2024-09-11T07:06:10.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6415999999999998e-05 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:159 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'113, mlcod=16'110)", 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:45.350384+0000", 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.840489393999999, 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0062316070000000001, 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.221 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350384+0000", 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350384+0000", 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350385+0000", 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2330000000000001e-06 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350393+0000", 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2670000000000006e-06 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350413+0000", 2024-09-11T07:06:10.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.982e-05 2024-09-11T07:06:10.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350428+0000", 2024-09-11T07:06:10.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.504e-05 2024-09-11T07:06:10.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350582+0000", 2024-09-11T07:06:10.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015388199999999999 2024-09-11T07:06:10.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.350598+0000", 2024-09-11T07:06:10.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6004000000000001e-05 2024-09-11T07:06:10.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.356580+0000", 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059817500000000001 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.356616+0000", 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5611000000000002e-05 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.226 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4169.0:162 1.0 e16/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 16'116, mlcod=16'114)", 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:45.363592+0000", 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.827281592999999, 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0072654709999999999, 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363592+0000", 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363592+0000", 2024-09-11T07:06:10.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363593+0000", 2024-09-11T07:06:10.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-06 2024-09-11T07:06:10.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363601+0000", 2024-09-11T07:06:10.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0600000000000008e-06 2024-09-11T07:06:10.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363621+0000", 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9692999999999999e-05 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363639+0000", 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8179999999999999e-05 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363730+0000", 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0997999999999998e-05 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.363743+0000", 2024-09-11T07:06:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3016e-05 2024-09-11T07:06:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.370822+0000", 2024-09-11T07:06:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0070786429999999999 2024-09-11T07:06:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:45.370857+0000", 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5630999999999998e-05 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:716 3.12 3:4b8a6084:::rbd_data.11618ae21b77.0000000000000000:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:04.432666+0000", 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.7582077930000004, 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060466540000000003, 2024-09-11T07:06:10.232 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 716 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432666+0000", 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432666+0000", 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432667+0000", 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.186e-06 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432675+0000", 2024-09-11T07:06:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8790000000000003e-06 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432689+0000", 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3973e-05 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432697+0000", 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1019999999999997e-06 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432750+0000", 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3820000000000003e-05 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.432874+0000", 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012327700000000001 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.433906+0000", 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010323369999999999 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.438586+0000", 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046802939999999998 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.438606+0000", 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9405000000000001e-05 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.438658+0000", 2024-09-11T07:06:10.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2156e-05 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:04.438712+0000", 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4224999999999997e-05 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1189 3.6 3:62e9a709:::rbd_data.11611d63ad3f.000000000000000b:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.710834+0000", 2024-09-11T07:06:10.238 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4800396820000001, 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027433923999999998, 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1189 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710834+0000", 2024-09-11T07:06:10.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710834+0000", 2024-09-11T07:06:10.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710834+0000", 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6099999999999999e-07 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710839+0000", 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8289999999999998e-06 2024-09-11T07:06:10.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710850+0000", 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0253e-05 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710855+0000", 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3460000000000001e-06 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710910+0000", 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5111000000000001e-05 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.710965+0000", 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5071999999999997e-05 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.715764+0000", 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0047986579999999999 2024-09-11T07:06:10.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738144+0000", 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022380172 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738158+0000", 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4311000000000001e-05 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738201+0000", 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3217999999999999e-05 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738268+0000", 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6093000000000006e-05 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.246 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4449.0:1189 3.6 e26/21 ondisk, result = 0)", 2024-09-11T07:06:10.246 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.730066+0000", 2024-09-11T07:06:10.246 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4608074349999995, 2024-09-11T07:06:10.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080843140000000004, 2024-09-11T07:06:10.246 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.246 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730066+0000", 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730066+0000", 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730067+0000", 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1100000000000004e-07 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730071+0000", 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4220000000000002e-06 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730086+0000", 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4459e-05 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.730098+0000", 2024-09-11T07:06:10.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2114e-05 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738127+0000", 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080296770000000007 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738138+0000", 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0335e-05 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.738150+0000", 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2396e-05 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1271 3.6 3:62e9a709:::rbd_data.11611d63ad3f.000000000000000b:head [stat,truncate 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.887517+0000", 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3033559390000002, 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005089807, 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1271 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887517+0000", 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887517+0000", 2024-09-11T07:06:10.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887520+0000", 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.154e-06 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887529+0000", 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7429999999999997e-06 2024-09-11T07:06:10.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887562+0000", 2024-09-11T07:06:10.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2382999999999998e-05 2024-09-11T07:06:10.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887582+0000", 2024-09-11T07:06:10.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9996999999999998e-05 2024-09-11T07:06:10.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887729+0000", 2024-09-11T07:06:10.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014764199999999999 2024-09-11T07:06:10.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887917+0000", 2024-09-11T07:06:10.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000187982 2024-09-11T07:06:10.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:06:10.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888220+0000", 2024-09-11T07:06:10.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000302811 2024-09-11T07:06:10.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.891572+0000", 2024-09-11T07:06:10.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0033515820000000001 2024-09-11T07:06:10.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892383+0000", 2024-09-11T07:06:10.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00081165199999999995 2024-09-11T07:06:10.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892529+0000", 2024-09-11T07:06:10.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014594599999999999 2024-09-11T07:06:10.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892607+0000", 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7915000000000002e-05 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1266 3.3 e26/21 3:c7fe507a:::rbd_data.11611d63ad3f.0000000000000006:head v 26'14, mlcod=26'12)", 2024-09-11T07:06:10.259 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.888488+0000", 2024-09-11T07:06:10.260 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3023854159999999, 2024-09-11T07:06:10.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057252630000000004, 2024-09-11T07:06:10.260 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.260 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.260 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888488+0000", 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888488+0000", 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888489+0000", 2024-09-11T07:06:10.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4360000000000001e-06 2024-09-11T07:06:10.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888502+0000", 2024-09-11T07:06:10.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2488e-05 2024-09-11T07:06:10.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888522+0000", 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0528000000000001e-05 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888535+0000", 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2724999999999999e-05 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889048+0000", 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051251499999999995 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889107+0000", 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9206999999999997e-05 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894127+0000", 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050206959999999998 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894213+0000", 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5667999999999994e-05 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1265 3.18 e26/21 3:1ba5c19e:::rbd_data.11611d63ad3f.0000000000000005:head v 26'10, mlcod=26'8)", 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889280+0000", 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3015930860000005, 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050281429999999997, 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.265 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889280+0000", 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889280+0000", 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889294+0000", 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4003e-05 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889306+0000", 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2053e-05 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889330+0000", 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3285000000000002e-05 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889344+0000", 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4579000000000001e-05 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889445+0000", 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000101277 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889487+0000", 2024-09-11T07:06:10.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1668000000000002e-05 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894185+0000", 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046982159999999999 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894308+0000", 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012306200000000001 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1270 3.b e26/21 3:d26d9835:::rbd_data.11611d63ad3f.000000000000000a:head v 26'7, mlcod=26'5)", 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889381+0000", 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3014923610000002, 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048966060000000004, 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889381+0000", 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889381+0000", 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889382+0000", 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1969999999999999e-06 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889390+0000", 2024-09-11T07:06:10.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0350000000000001e-06 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889406+0000", 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5710999999999999e-05 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889417+0000", 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0645000000000001e-05 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889607+0000", 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000190242 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889657+0000", 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0195999999999998e-05 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894218+0000", 2024-09-11T07:06:10.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045610889999999999 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894278+0000", 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9490999999999997e-05 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1483 3.6 3:648bb0d0:::rbd_data.11611d63ad3f.0000000000000011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.369444+0000", 2024-09-11T07:06:10.274 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.821429347, 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050500069999999996, 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1483 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.369444+0000", 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.369444+0000", 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.369447+0000", 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5780000000000001e-06 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.369455+0000", 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9190000000000005e-06 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.369477+0000", 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1080000000000001e-05 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.369486+0000", 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4809999999999995e-06 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.369625+0000", 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013880300000000001 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.369848+0000", 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000223508 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.370140+0000", 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00029170800000000001 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.373968+0000", 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0038276640000000002 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.374289+0000", 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00032133999999999998 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.374384+0000", 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5342999999999998e-05 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.374494+0000", 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109583 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.280 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1639 3.6 3:648bb0d0:::rbd_data.11611d63ad3f.0000000000000011:head [set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.661962+0000", 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.5289111520000001, 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013501505, 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1639 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.661962+0000", 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.661962+0000", 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.661964+0000", 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0619999999999999e-06 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.661972+0000", 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2090000000000005e-06 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.661992+0000", 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9204000000000001e-05 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.662002+0000", 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0536999999999999e-05 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.662072+0000", 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9777000000000006e-05 2024-09-11T07:06:10.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.662161+0000", 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9019999999999998e-05 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.664343+0000", 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021819109999999999 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.675366+0000", 2024-09-11T07:06:10.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011023099999999999 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.675382+0000", 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5698000000000001e-05 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.675424+0000", 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1906999999999997e-05 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.675464+0000", 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0080000000000003e-05 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1641 3.6 3:665c70cb:::rbd_data.11611d63ad3f.0000000000000017:head [truncate 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.678318+0000", 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.5125553780000001, 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0065995070000000001, 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1641 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.678318+0000", 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.678318+0000", 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.678319+0000", 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9400000000000004e-07 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.678323+0000", 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2239999999999997e-06 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.678335+0000", 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2058e-05 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.678342+0000", 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1069999999999999e-06 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.678811+0000", 2024-09-11T07:06:10.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00046862100000000001 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.679085+0000", 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027393200000000001 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.679361+0000", 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276762 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.684470+0000", 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0051086120000000002 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.684802+0000", 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033230500000000002 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.684862+0000", 2024-09-11T07:06:10.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9679999999999998e-05 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.684917+0000", 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5411999999999997e-05 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3876 3.1f 3:fa437cd5:::rbd_object_map.11614fc4d54f:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.162506+0000", 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.028367087999999999, 2024-09-11T07:06:10.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055599129999999997, 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3876 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.162506+0000", 2024-09-11T07:06:10.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.162506+0000", 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.162507+0000", 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0299999999999998e-07 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.162511+0000", 2024-09-11T07:06:10.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.42e-06 2024-09-11T07:06:10.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.162525+0000", 2024-09-11T07:06:10.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3370000000000001e-05 2024-09-11T07:06:10.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.162532+0000", 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0269999999999998e-06 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.165405+0000", 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028728930000000001 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.165466+0000", 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1699999999999995e-05 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.165691+0000", 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022492200000000001 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.166718+0000", 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001026562 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.168015+0000", 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012975739999999999 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.168045+0000", 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9697999999999999e-05 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.168066+0000", 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0944000000000001e-05 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.299 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3903 3.1f 3:fa437cd5:::rbd_object_map.11614fc4d54f:head [call lock.assert_locked in=17b,call rbd.object_map_update in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.183979+0000", 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0068942500000000002, 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0050037809999999997, 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3903 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.183979+0000", 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.183979+0000", 2024-09-11T07:06:10.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.183981+0000", 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8929999999999999e-06 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.183990+0000", 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1970000000000002e-06 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.184013+0000", 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2855999999999999e-05 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.184028+0000", 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5460000000000001e-05 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.185582+0000", 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00155376 2024-09-11T07:06:10.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.185634+0000", 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1697999999999999e-05 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.185839+0000", 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020477599999999999 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.186909+0000", 2024-09-11T07:06:10.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010699139999999999 2024-09-11T07:06:10.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.188892+0000", 2024-09-11T07:06:10.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019831380000000002 2024-09-11T07:06:10.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.188951+0000", 2024-09-11T07:06:10.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9086000000000003e-05 2024-09-11T07:06:10.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.188983+0000", 2024-09-11T07:06:10.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2002999999999998e-05 2024-09-11T07:06:10.306 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.306 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.306 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.306 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.307 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.307 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:798 punch from 0x68e06c8 to 0x68e5b71, (0x54a9 bytes) 2024-09-11T07:06:10.309 INFO:teuthology.orchestra.run.smithi079.stdout:799 write 0x8006ac4 thru 0x80163af (0xf8ec bytes) 2024-09-11T07:06:10.310 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:800 write 0x368a308 thru 0x368a35f (0x58 bytes) 2024-09-11T07:06:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:10.311 INFO:teuthology.orchestra.run.smithi079.stdout:802 writesame 0xd16be5a thru 0xd16cbb6 data_size 0x1(0xd5d bytes) 2024-09-11T07:06:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:804 trunc from 0xd296419 to 0xb96d95a 2024-09-11T07:06:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:805 write 0xdb2acb6 thru 0xdb2f382 (0x46cd bytes) 2024-09-11T07:06:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:806 writesame 0xe35098b thru 0xe3594b9 data_size 0x1(0x8b2f bytes) 2024-09-11T07:06:10.312 INFO:teuthology.orchestra.run.smithi079.stdout:807 write 0x24c2469 thru 0x24cd00c (0xaba4 bytes) 2024-09-11T07:06:10.314 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:10.312+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:10.382 INFO:teuthology.orchestra.run.smithi079.stdout:808 trunc from 0xe3594ba to 0x76f8a56 2024-09-11T07:06:10.414 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:10.412+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:10.430 INFO:teuthology.orchestra.run.smithi079.stdout:809 write 0x2ac6dad thru 0x2ace344 (0x7598 bytes) 2024-09-11T07:06:10.467 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:10.467 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:10.468 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:10.468 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:10.470 INFO:teuthology.orchestra.run.smithi079.stdout:812 punch from 0x1b91d86 to 0x1b97d45, (0x5fbf bytes) 2024-09-11T07:06:10.470 INFO:teuthology.orchestra.run.smithi079.stdout:813 read 0x6401cae thru 0x640d3e4 (0xb737 bytes) 2024-09-11T07:06:10.471 INFO:teuthology.orchestra.run.smithi079.stdout:814 read 0x13cc41c thru 0x13d7495 (0xb07a bytes) 2024-09-11T07:06:10.486 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:10.490 INFO:teuthology.orchestra.run.smithi079.stdout:817 writesame 0xe10ba14 thru 0xe10f2e1 data_size 0xb(0x38ce bytes) 2024-09-11T07:06:10.491 INFO:teuthology.orchestra.run.smithi079.stdout:819 write 0xaf812a5 thru 0xaf85e0c (0x4b68 bytes) 2024-09-11T07:06:10.500 INFO:teuthology.orchestra.run.smithi079.stdout:822 trunc from 0xe10f2e2 to 0xb49282a 2024-09-11T07:06:10.510 INFO:teuthology.orchestra.run.smithi079.stdout:823 punch from 0x1faaf5a to 0x1fb961f, (0xe6c5 bytes) 2024-09-11T07:06:10.510 INFO:teuthology.orchestra.run.smithi079.stdout:824 write 0x205694e thru 0x2063249 (0xc8fc bytes) 2024-09-11T07:06:10.515 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:10.510+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:10.548 INFO:teuthology.orchestra.run.smithi079.stdout:825 trunc from 0xb49282a to 0x544cb2f 2024-09-11T07:06:10.610 INFO:teuthology.orchestra.run.smithi079.stdout:826 punch from 0x4a63433 to 0x4a6f6d7, (0xc2a4 bytes) 2024-09-11T07:06:10.611 INFO:teuthology.orchestra.run.smithi079.stdout:827 read 0x21f2a82 thru 0x21fb0dc (0x865b bytes) 2024-09-11T07:06:10.615 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:10.616+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:10.618 INFO:teuthology.orchestra.run.smithi079.stdout:828 trunc from 0x544cb2f to 0xda304 2024-09-11T07:06:10.627 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:10.628 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:10.628 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:10.646 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:10.739 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:10.740+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:10.781 INFO:teuthology.orchestra.run.smithi079.stdout:830 write 0x154f08d thru 0x1559969 (0xa8dd bytes) 2024-09-11T07:06:10.784 INFO:teuthology.orchestra.run.smithi079.stdout:831 read 0x5a73c2 thru 0x5b3c0d (0xc84c bytes) 2024-09-11T07:06:10.793 INFO:teuthology.orchestra.run.smithi079.stdout:832 write 0x24cb3e9 thru 0x24d9ef1 (0xeb09 bytes) 2024-09-11T07:06:10.802 INFO:teuthology.orchestra.run.smithi079.stdout:833 read 0x2200f07 thru 0x220a85d (0x9957 bytes) 2024-09-11T07:06:10.803 INFO:teuthology.orchestra.run.smithi079.stdout:834 punch from 0xf18951 to 0xf1da25, (0x50d4 bytes) 2024-09-11T07:06:10.803 INFO:teuthology.orchestra.run.smithi079.stdout:836 clone 4 order 19 su 16384 sc 3 2024-09-11T07:06:10.818 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:10.814+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:10.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1225 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.789407+0000", 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.0453082040000004, 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0073596800000000004, 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1225 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789407+0000", 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789407+0000", 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789410+0000", 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1550000000000001e-06 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789419+0000", 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5310000000000007e-06 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789439+0000", 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0166999999999999e-05 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789448+0000", 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1200000000000008e-06 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789522+0000", 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3337999999999995e-05 2024-09-11T07:06:10.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.789622+0000", 2024-09-11T07:06:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010005699999999999 2024-09-11T07:06:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:10.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.790389+0000", 2024-09-11T07:06:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00076713699999999998 2024-09-11T07:06:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796636+0000", 2024-09-11T07:06:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0062471690000000003 2024-09-11T07:06:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796684+0000", 2024-09-11T07:06:10.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7513999999999999e-05 2024-09-11T07:06:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796729+0000", 2024-09-11T07:06:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5561e-05 2024-09-11T07:06:10.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.796767+0000", 2024-09-11T07:06:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7931e-05 2024-09-11T07:06:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.842 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1267 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head [stat,truncate 2097152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-09-11T07:06:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.887576+0000", 2024-09-11T07:06:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.9471392850000004, 2024-09-11T07:06:10.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.007300211, 2024-09-11T07:06:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.844 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1267 2024-09-11T07:06:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887576+0000", 2024-09-11T07:06:10.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887576+0000", 2024-09-11T07:06:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887578+0000", 2024-09-11T07:06:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4559999999999999e-06 2024-09-11T07:06:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887584+0000", 2024-09-11T07:06:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4169999999999997e-06 2024-09-11T07:06:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887603+0000", 2024-09-11T07:06:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8906000000000002e-05 2024-09-11T07:06:10.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887618+0000", 2024-09-11T07:06:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5150000000000001e-05 2024-09-11T07:06:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888853+0000", 2024-09-11T07:06:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0012350530000000001 2024-09-11T07:06:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888956+0000", 2024-09-11T07:06:10.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010271499999999999 2024-09-11T07:06:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889135+0000", 2024-09-11T07:06:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000179397 2024-09-11T07:06:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894439+0000", 2024-09-11T07:06:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053030910000000002 2024-09-11T07:06:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894677+0000", 2024-09-11T07:06:10.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238507 2024-09-11T07:06:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894769+0000", 2024-09-11T07:06:10.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1502000000000006e-05 2024-09-11T07:06:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894877+0000", 2024-09-11T07:06:10.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010801700000000001 2024-09-11T07:06:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.855 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1494 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head [stat,truncate 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T07:06:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.378800+0000", 2024-09-11T07:06:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.4559157269999998, 2024-09-11T07:06:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060138240000000001, 2024-09-11T07:06:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.856 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1494 2024-09-11T07:06:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.378800+0000", 2024-09-11T07:06:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.378800+0000", 2024-09-11T07:06:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.378801+0000", 2024-09-11T07:06:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.313e-06 2024-09-11T07:06:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.378809+0000", 2024-09-11T07:06:10.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1899999999999995e-06 2024-09-11T07:06:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.378830+0000", 2024-09-11T07:06:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0693999999999999e-05 2024-09-11T07:06:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.378845+0000", 2024-09-11T07:06:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5216e-05 2024-09-11T07:06:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381012+0000", 2024-09-11T07:06:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021665040000000001 2024-09-11T07:06:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381084+0000", 2024-09-11T07:06:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2583000000000006e-05 2024-09-11T07:06:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381207+0000", 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000122065 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.383880+0000", 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026732320000000002 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384718+0000", 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00083861700000000005 2024-09-11T07:06:10.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384760+0000", 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1643000000000001e-05 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384814+0000", 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3767000000000002e-05 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1533 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head [stat,truncate 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.461322+0000", 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3733932370000002, 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068980960000000003, 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1533 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461322+0000", 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461322+0000", 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461324+0000", 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.66e-06 2024-09-11T07:06:10.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461332+0000", 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1259999999999998e-06 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461360+0000", 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7597e-05 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461379+0000", 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9443e-05 2024-09-11T07:06:10.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462437+0000", 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001057646 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462709+0000", 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027188100000000002 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:10.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463096+0000", 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038732699999999997 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465403+0000", 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023070579999999999 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.468137+0000", 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027334859999999998 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.468185+0000", 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8708000000000002e-05 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.468221+0000", 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5163999999999997e-05 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:1537 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head [stat,truncate 524288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.461457+0000", 2024-09-11T07:06:10.870 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.3732586549999999, 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0068805309999999996, 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 1537 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461457+0000", 2024-09-11T07:06:10.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461457+0000", 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461458+0000", 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9999999999999996e-07 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461462+0000", 2024-09-11T07:06:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4669999999999998e-06 2024-09-11T07:06:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461475+0000", 2024-09-11T07:06:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2830000000000001e-05 2024-09-11T07:06:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.461484+0000", 2024-09-11T07:06:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.986e-06 2024-09-11T07:06:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463761+0000", 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0022770780000000001 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463904+0000", 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000142989 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:10.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464036+0000", 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013200899999999999 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467795+0000", 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003758249 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.468269+0000", 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00047448599999999998 2024-09-11T07:06:10.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.468309+0000", 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9549999999999999e-05 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.468338+0000", 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8986999999999999e-05 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.877 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3663 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:4 [sparse-read 2097152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.000436+0000", 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83427957399999997, 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055847099999999997, 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3663 2024-09-11T07:06:10.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000436+0000", 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000436+0000", 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000436+0000", 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1600000000000002e-07 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000438+0000", 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.517e-06 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000444+0000", 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7799999999999997e-06 2024-09-11T07:06:10.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000447+0000", 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3270000000000001e-06 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.005834+0000", 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0053869540000000002 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.005918+0000", 2024-09-11T07:06:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3554999999999995e-05 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006021+0000", 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103261 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3664 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:4 [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.000452+0000", 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83426412800000005, 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057069779999999997, 2024-09-11T07:06:10.882 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3664 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000452+0000", 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000452+0000", 2024-09-11T07:06:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000452+0000", 2024-09-11T07:06:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9999999999999999e-07 2024-09-11T07:06:10.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000453+0000", 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.418e-06 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000458+0000", 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3749999999999996e-06 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000461+0000", 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2200000000000001e-06 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006058+0000", 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055968229999999999 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006103+0000", 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5731e-05 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006159+0000", 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5111000000000001e-05 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.887 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3665 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:4 [sparse-read 2359296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.000465+0000", 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83425051299999997, 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059302979999999996, 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3665 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000465+0000", 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000465+0000", 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000465+0000", 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1300000000000001e-07 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000467+0000", 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3519999999999999e-06 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000471+0000", 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.284e-06 2024-09-11T07:06:10.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000474+0000", 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2940000000000001e-06 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006215+0000", 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057402970000000001 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006302+0000", 2024-09-11T07:06:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7410999999999994e-05 2024-09-11T07:06:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006395+0000", 2024-09-11T07:06:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3346999999999999e-05 2024-09-11T07:06:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3666 3.0 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:4 [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.000480+0000", 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83423600099999995, 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060558779999999998, 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.893 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3666 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000480+0000", 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000480+0000", 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000480+0000", 2024-09-11T07:06:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8999999999999998e-07 2024-09-11T07:06:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000481+0000", 2024-09-11T07:06:10.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3939999999999999e-06 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000486+0000", 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2760000000000002e-06 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.000489+0000", 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1939999999999998e-06 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006439+0000", 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059505829999999997 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006484+0000", 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4644999999999997e-05 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006536+0000", 2024-09-11T07:06:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1496000000000003e-05 2024-09-11T07:06:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3704 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 1179648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.001543+0000", 2024-09-11T07:06:10.898 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83317238000000005, 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055356900000000002, 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3704 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001543+0000", 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001543+0000", 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001544+0000", 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.89e-07 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001546+0000", 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5519999999999999e-06 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001554+0000", 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1849999999999998e-06 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001559+0000", 2024-09-11T07:06:10.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7019999999999998e-06 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.006967+0000", 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054073979999999999 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007030+0000", 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3464000000000001e-05 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007079+0000", 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8900000000000003e-05 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3705 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 1310720~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.001568+0000", 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83314809499999998, 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056467000000000002, 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3705 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001568+0000", 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001568+0000", 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001568+0000", 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001571+0000", 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5059999999999998e-06 2024-09-11T07:06:10.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001578+0000", 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3379999999999999e-06 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001583+0000", 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2850000000000002e-06 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007120+0000", 2024-09-11T07:06:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0055364510000000004 2024-09-11T07:06:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007163+0000", 2024-09-11T07:06:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3195999999999998e-05 2024-09-11T07:06:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007214+0000", 2024-09-11T07:06:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1445e-05 2024-09-11T07:06:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3706 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 1441792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.001591+0000", 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83312474999999997, 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057392930000000003, 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.909 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3706 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001591+0000", 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001591+0000", 2024-09-11T07:06:10.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001591+0000", 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.89e-07 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001595+0000", 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1190000000000001e-06 2024-09-11T07:06:10.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001602+0000", 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0520000000000004e-06 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001615+0000", 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2941e-05 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007240+0000", 2024-09-11T07:06:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0056258189999999998 2024-09-11T07:06:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007281+0000", 2024-09-11T07:06:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0339000000000001e-05 2024-09-11T07:06:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007330+0000", 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9533999999999997e-05 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3707 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 1572864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.001623+0000", 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83309312499999999, 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0058266710000000003, 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3707 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001623+0000", 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001623+0000", 2024-09-11T07:06:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001623+0000", 2024-09-11T07:06:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0200000000000002e-07 2024-09-11T07:06:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001625+0000", 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3740000000000001e-06 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001632+0000", 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9240000000000001e-06 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001637+0000", 2024-09-11T07:06:10.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9459999999999997e-06 2024-09-11T07:06:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007355+0000", 2024-09-11T07:06:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0057173720000000001 2024-09-11T07:06:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007399+0000", 2024-09-11T07:06:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4370999999999999e-05 2024-09-11T07:06:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007449+0000", 2024-09-11T07:06:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0182000000000002e-05 2024-09-11T07:06:10.920 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3708 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 1703936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.001645+0000", 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83307096300000005, 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059193290000000001, 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3708 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001645+0000", 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001645+0000", 2024-09-11T07:06:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001645+0000", 2024-09-11T07:06:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2e-07 2024-09-11T07:06:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001647+0000", 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1830000000000001e-06 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001654+0000", 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7320000000000001e-06 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001659+0000", 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7670000000000003e-06 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007476+0000", 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0058167540000000004 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007515+0000", 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9854000000000002e-05 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007564+0000", 2024-09-11T07:06:10.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8619000000000003e-05 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3709 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 1835008~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.001666+0000", 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83304966700000005, 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.006018916, 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3709 2024-09-11T07:06:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001666+0000", 2024-09-11T07:06:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001666+0000", 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001666+0000", 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6100000000000001e-07 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001669+0000", 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.261e-06 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001676+0000", 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9149999999999999e-06 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001680+0000", 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7520000000000004e-06 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007589+0000", 2024-09-11T07:06:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059082379999999997 2024-09-11T07:06:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007628+0000", 2024-09-11T07:06:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9606e-05 2024-09-11T07:06:10.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007685+0000", 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6682999999999999e-05 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3710 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 1966080~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.001688+0000", 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83302806399999996, 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.006111404, 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3710 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001688+0000", 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001688+0000", 2024-09-11T07:06:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001688+0000", 2024-09-11T07:06:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0800000000000004e-07 2024-09-11T07:06:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001691+0000", 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2309999999999999e-06 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001697+0000", 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4509999999999997e-06 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001702+0000", 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.045e-06 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007710+0000", 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060075700000000003 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007751+0000", 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1119999999999999e-05 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007799+0000", 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8279000000000003e-05 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3711 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 2097152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.001887+0000", 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83282895300000004, 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.006030372, 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.936 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3711 2024-09-11T07:06:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001887+0000", 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001887+0000", 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001888+0000", 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6220000000000001e-06 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001897+0000", 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1630000000000002e-06 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001922+0000", 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4128999999999999e-05 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001938+0000", 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6497000000000001e-05 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007823+0000", 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0058852640000000003 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007868+0000", 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4830999999999998e-05 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007917+0000", 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8866000000000003e-05 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3712 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 2228224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.001969+0000", 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.832746451, 2024-09-11T07:06:10.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060629680000000002, 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3712 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001969+0000", 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001969+0000", 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001971+0000", 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3880000000000001e-06 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001976+0000", 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.835e-06 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.001993+0000", 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6194000000000001e-05 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002006+0000", 2024-09-11T07:06:10.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2911000000000001e-05 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007943+0000", 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059373359999999997 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.007984+0000", 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1084000000000002e-05 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.008032+0000", 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8220000000000002e-05 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3713 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 2359296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.002055+0000", 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83266075500000003, 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060900379999999999, 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3713 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002055+0000", 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002055+0000", 2024-09-11T07:06:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002056+0000", 2024-09-11T07:06:10.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3260000000000001e-06 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002062+0000", 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7060000000000001e-06 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002079+0000", 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6877000000000001e-05 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002092+0000", 2024-09-11T07:06:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3088000000000001e-05 2024-09-11T07:06:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.008058+0000", 2024-09-11T07:06:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059665500000000002 2024-09-11T07:06:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.008098+0000", 2024-09-11T07:06:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9084000000000001e-05 2024-09-11T07:06:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.008145+0000", 2024-09-11T07:06:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7407000000000002e-05 2024-09-11T07:06:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.951 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:3714 3.0 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:4 [sparse-read 2490368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.002110+0000", 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.83260590700000003, 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0061547659999999999, 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:10.952 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 3714 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002110+0000", 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002110+0000", 2024-09-11T07:06:10.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002111+0000", 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.049e-06 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002125+0000", 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4037e-05 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:10.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002141+0000", 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5705999999999998e-05 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.002169+0000", 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8722e-05 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.008166+0000", 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0059963450000000001 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:10.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.008217+0000", 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1563000000000001e-05 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.008265+0000", 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7343999999999999e-05 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:10.956 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:10.958 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:10.958 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:10.954+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:11.058 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:11.058+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:11.115 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:11.115 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:11.115 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:11.129 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:11.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:11.180+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:11.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:11.244 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:11.244 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:11.244 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:11.244 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:11.244 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:11.258 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:11.307 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:11.308+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:11.338 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:11.338 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:11.355 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:11.355 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:11.361 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:11.358+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:11.371 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:11.371 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:11.388 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:11.388 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:11.408 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:11.408 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:11.424 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:11.424 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:11.429 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:11.429 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:11.438 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:11.450 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:11.451 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:11.462 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:11.458+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:11.471 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:11.471 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:11.563 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:11.564+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:11.577 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:11.577 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:11.591 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:11.664 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:11.662+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:11.757 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:11.757 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:11.765 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:11.764+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:11.771 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:11.811 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:06:11.879 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:11.880+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:11.939 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:11.939 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:11.954 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:11.963 INFO:teuthology.orchestra.run.smithi079.stdout:leaving image image_client.0-clone3 intact 2024-09-11T07:06:11.966 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:11.968+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:12.068 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:12.068+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:12.091 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:12.091 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:12.107 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:12.108 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #2, image image_client.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent3 2024-09-11T07:06:12.169 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:12.168+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:12.194 INFO:teuthology.orchestra.run.smithi079.stdout:837 read 0x1bf7790 thru 0x1bf8004 (0x875 bytes) 2024-09-11T07:06:12.227 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:12.227 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:12.239 INFO:teuthology.orchestra.run.smithi079.stdout:838 write 0xb11c668 thru 0xb129d87 (0xd720 bytes) 2024-09-11T07:06:12.242 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:12.270 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:12.268+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:12.273 INFO:teuthology.orchestra.run.smithi079.stdout:839 trunc from 0xb129d88 to 0xa982c6 2024-09-11T07:06:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:840 read 0x1c2c23 thru 0x1ccbd0 (0x9fae bytes) 2024-09-11T07:06:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:841 punch from 0xa70c6d to 0xa73e70, (0x3203 bytes) 2024-09-11T07:06:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:844 read 0x31d92e thru 0x31eb16 (0x11e9 bytes) 2024-09-11T07:06:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:845 punch from 0x8c5683 to 0x8c7230, (0x1bad bytes) 2024-09-11T07:06:12.322 INFO:teuthology.orchestra.run.smithi079.stdout:846 write 0x37f0ae5 thru 0x37f8b4c (0x8068 bytes) 2024-09-11T07:06:12.332 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:12.364 INFO:teuthology.orchestra.run.smithi079.stdout:848 write 0xc2e23eb thru 0xc2ef027 (0xcc3d bytes) 2024-09-11T07:06:12.371 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:12.372+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:12.373 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:12.373 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:12.373 INFO:teuthology.orchestra.run.smithi079.stdout:849 clone 5 order 21 su 32768 sc 12 2024-09-11T07:06:12.387 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:12.472 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:12.472+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:12.509 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:12.509 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:12.523 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:12.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:12.572+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:12.644 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:12.645 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:12.660 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:12.708 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:12.706+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:12.775 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:12.770+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:12.781 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:12.781 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:12.795 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:12.876 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:12.876+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:12.973 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:12.973 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:12.976 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:12.976+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:12.988 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:13.004 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone4 from 0xc2ef028 (overlap 0xa982c6) to 0x0 2024-09-11T07:06:13.077 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:13.074+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:13.118 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:13.119 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:13.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:13.224 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:13.222+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:13.230 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #3, image image_client.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent4 2024-09-11T07:06:13.279 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:13.280+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:13.304 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:13.304 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:13.318 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:13.392 INFO:teuthology.orchestra.run.smithi079.stdout:851 write 0x7683394 thru 0x7688e0b (0x5a78 bytes) 2024-09-11T07:06:13.403 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:13.402+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:13.411 INFO:teuthology.orchestra.run.smithi079.stdout:852 punch from 0x9743202 to 0x974a88b, (0x7689 bytes) 2024-09-11T07:06:13.411 INFO:teuthology.orchestra.run.smithi079.stdout:853 read 0x1a288dd thru 0x1a3252c (0x9c50 bytes) 2024-09-11T07:06:13.425 INFO:teuthology.orchestra.run.smithi079.stdout:854 write 0xe19470d thru 0xe19b476 (0x6d6a bytes) 2024-09-11T07:06:13.435 INFO:teuthology.orchestra.run.smithi079.stdout:856 read 0x3d8d6bd thru 0x3d993b2 (0xbcf6 bytes) 2024-09-11T07:06:13.435 INFO:teuthology.orchestra.run.smithi079.stdout:857 read 0x8feff3c thru 0x8fff4e3 (0xf5a8 bytes) 2024-09-11T07:06:13.435 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:13.435 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:13.435 INFO:teuthology.orchestra.run.smithi079.stdout:861 read 0x1d9b4c8 thru 0x1da34e9 (0x8022 bytes) 2024-09-11T07:06:13.436 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:13.436 INFO:teuthology.orchestra.run.smithi079.stdout:863 write 0xe1948b thru 0xe1b580 (0x20f6 bytes) 2024-09-11T07:06:13.454 INFO:teuthology.orchestra.run.smithi079.stdout:864 write 0x3d6965a thru 0x3d6efaf (0x5956 bytes) 2024-09-11T07:06:13.465 INFO:teuthology.orchestra.run.smithi079.stdout:865 punch from 0xd44fbde to 0xd453cef, (0x4111 bytes) 2024-09-11T07:06:13.465 INFO:teuthology.orchestra.run.smithi079.stdout:866 read 0xa0e7356 thru 0xa0eaebf (0x3b6a bytes) 2024-09-11T07:06:13.465 INFO:teuthology.orchestra.run.smithi079.stdout:867 read 0x347b694 thru 0x3486dc7 (0xb734 bytes) 2024-09-11T07:06:13.466 INFO:teuthology.orchestra.run.smithi079.stdout:868 read 0x3bc9ba9 thru 0x3bd8f11 (0xf369 bytes) 2024-09-11T07:06:13.466 INFO:teuthology.orchestra.run.smithi079.stdout:869 writesame 0xa7de3b9 thru 0xa7e7ba7 data_size 0x5(0x97ef bytes) 2024-09-11T07:06:13.481 INFO:teuthology.orchestra.run.smithi079.stdout:870 punch from 0x8d3615c to 0x8d3880b, (0x26af bytes) 2024-09-11T07:06:13.481 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:13.478+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:13.481 INFO:teuthology.orchestra.run.smithi079.stdout:871 writesame 0x230ccdb thru 0x2319f4f data_size 0x1(0xd275 bytes) 2024-09-11T07:06:13.489 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:13.490 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:13.490 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:13.508 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:13.528 INFO:teuthology.orchestra.run.smithi079.stdout:872 punch from 0xd3f493d to 0xd3f67eb, (0x1eae bytes) 2024-09-11T07:06:13.528 INFO:teuthology.orchestra.run.smithi079.stdout:874 read 0x36507f6 thru 0x3651d31 (0x153c bytes) 2024-09-11T07:06:13.528 INFO:teuthology.orchestra.run.smithi079.stdout:876 write 0xdd86bd7 thru 0xdd8e4d7 (0x7901 bytes) 2024-09-11T07:06:13.535 INFO:teuthology.orchestra.run.smithi079.stdout:877 read 0xa2bca23 thru 0xa2c6343 (0x9921 bytes) 2024-09-11T07:06:13.535 INFO:teuthology.orchestra.run.smithi079.stdout:878 read 0x7ce2d53 thru 0x7cf1948 (0xebf6 bytes) 2024-09-11T07:06:13.535 INFO:teuthology.orchestra.run.smithi079.stdout:879 read 0xd9eb1bc thru 0xd9f2012 (0x6e57 bytes) 2024-09-11T07:06:13.535 INFO:teuthology.orchestra.run.smithi079.stdout:881 write 0xc5c7b2f thru 0xc5ca35d (0x282f bytes) 2024-09-11T07:06:13.543 INFO:teuthology.orchestra.run.smithi079.stdout:882 read 0x9374d5e thru 0x9381e37 (0xd0da bytes) 2024-09-11T07:06:13.543 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:13.544 INFO:teuthology.orchestra.run.smithi079.stdout:884 writesame 0x9816e9e thru 0x981d57c data_size 0x17(0x66df bytes) 2024-09-11T07:06:13.548 INFO:teuthology.orchestra.run.smithi079.stdout:885 punch from 0x5abb64f to 0x5ac9b53, (0xe504 bytes) 2024-09-11T07:06:13.548 INFO:teuthology.orchestra.run.smithi079.stdout:888 write 0xa8693d4 thru 0xa8735b1 (0xa1de bytes) 2024-09-11T07:06:13.555 INFO:teuthology.orchestra.run.smithi079.stdout:889 write 0x6172440 thru 0x617f531 (0xd0f2 bytes) 2024-09-11T07:06:13.563 INFO:teuthology.orchestra.run.smithi079.stdout:895 punch from 0x2e65fdf to 0x2e6a549, (0x456a bytes) 2024-09-11T07:06:13.573 INFO:teuthology.orchestra.run.smithi079.stdout:896 trunc from 0xe19b477 to 0x9f92f1c 2024-09-11T07:06:13.582 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:13.580+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:13.631 INFO:teuthology.orchestra.run.smithi079.stdout:897 write 0xeb66abf thru 0xeb69de0 (0x3322 bytes) 2024-09-11T07:06:13.637 INFO:teuthology.orchestra.run.smithi079.stdout:899 read 0xb7a908b thru 0xb7b44bb (0xb431 bytes) 2024-09-11T07:06:13.637 INFO:teuthology.orchestra.run.smithi079.stdout:900 read 0xb13eb41 thru 0xb143d4d (0x520d bytes) 2024-09-11T07:06:13.637 INFO:teuthology.orchestra.run.smithi079.stdout:901 write 0x35e91b9 thru 0x35f7905 (0xe74d bytes) 2024-09-11T07:06:13.645 INFO:teuthology.orchestra.run.smithi079.stdout:902 write 0xd4f4bbe thru 0xd4f8a35 (0x3e78 bytes) 2024-09-11T07:06:13.650 INFO:teuthology.orchestra.run.smithi079.stdout:903 read 0x92be4f1 thru 0x92cabcc (0xc6dc bytes) 2024-09-11T07:06:13.651 INFO:teuthology.orchestra.run.smithi079.stdout:904 clone 6 order 21 su 65536 sc 5 2024-09-11T07:06:13.661 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:13.661 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:13.677 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:13.677 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:13.682 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:13.683 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:13.683 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:13.678+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:13.693 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:13.693 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:13.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:13.709 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:13.709 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:13.729 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:13.729 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:13.749 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:13.750 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:13.768 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:13.768 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:13.783 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:13.782+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:13.788 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:13.788 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:13.836 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:06:13.869 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 30.797665568999999, 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:13.870 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:13.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:06:13.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:06:13.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:06:13.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:13.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:06:13.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:06:13.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:13.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7411 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 8060928~0] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.877 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.695731+0000", 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1702438530000001, 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057485731999999998, 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7411 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695731+0000", 2024-09-11T07:06:13.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695731+0000", 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695732+0000", 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9999999999999996e-07 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695735+0000", 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5919999999999999e-06 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695743+0000", 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8450000000000003e-06 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695754+0000", 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1377e-05 2024-09-11T07:06:13.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.753053+0000", 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057298836999999998 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.753131+0000", 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8430000000000006e-05 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.753217+0000", 2024-09-11T07:06:13.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5750999999999999e-05 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7506 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 98304~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.695764+0000", 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.170211213, 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057675075999999999, 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7506 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695764+0000", 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695764+0000", 2024-09-11T07:06:13.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695764+0000", 2024-09-11T07:06:13.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7700000000000004e-07 2024-09-11T07:06:13.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695767+0000", 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6400000000000001e-06 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695778+0000", 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0988999999999999e-05 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695785+0000", 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0280000000000003e-06 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.753266+0000", 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057480448000000003 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.753338+0000", 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2181999999999994e-05 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.753439+0000", 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010121200000000001 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7507 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 212992~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.695795+0000", 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1701796450000002, 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057883872000000003, 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.887 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7507 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695795+0000", 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.695795+0000", 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697095+0000", 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012995019999999999 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697101+0000", 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.823e-06 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697114+0000", 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3434e-05 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697123+0000", 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8340000000000005e-06 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.753490+0000", 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056367065000000001 2024-09-11T07:06:13.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.753568+0000", 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7676999999999995e-05 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.753679+0000", 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111537 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7512 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 1310720~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.697257+0000", 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.168717902, 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057680132000000002, 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7512 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.892 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697257+0000", 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697257+0000", 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697258+0000", 2024-09-11T07:06:13.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8599999999999998e-07 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697260+0000", 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5490000000000001e-06 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697280+0000", 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9630999999999999e-05 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697296+0000", 2024-09-11T07:06:13.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6328e-05 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.754734+0000", 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057438054000000002 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.754822+0000", 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7601000000000004e-05 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.754937+0000", 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115383 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7513 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 1949696~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.697319+0000", 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.168656505, 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057881762000000003, 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7513 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697319+0000", 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697319+0000", 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697320+0000", 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6299999999999993e-07 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697323+0000", 2024-09-11T07:06:13.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4230000000000001e-06 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697337+0000", 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.366e-05 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697344+0000", 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.08e-06 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.754999+0000", 2024-09-11T07:06:13.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057655062 2024-09-11T07:06:13.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.755068+0000", 2024-09-11T07:06:13.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9583000000000001e-05 2024-09-11T07:06:13.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.755200+0000", 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000131991 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7514 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 2064384~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.697354+0000", 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1686212220000001, 2024-09-11T07:06:13.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058096165999999998, 2024-09-11T07:06:13.902 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.902 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.902 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.902 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7514 2024-09-11T07:06:13.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.902 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697354+0000", 2024-09-11T07:06:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697354+0000", 2024-09-11T07:06:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697354+0000", 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9999999999999997e-07 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697365+0000", 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0437e-05 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697373+0000", 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.337e-06 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697383+0000", 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4369999999999996e-06 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.755260+0000", 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057877197999999998 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.755352+0000", 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1891000000000005e-05 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.755450+0000", 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8265999999999997e-05 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.906 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7515 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 2179072~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.697392+0000", 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.168582588, 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058256513000000003, 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7515 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697392+0000", 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.697392+0000", 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.698972+0000", 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0015791360000000001 2024-09-11T07:06:13.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.698979+0000", 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5800000000000003e-06 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699004+0000", 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4329e-05 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699018+0000", 2024-09-11T07:06:13.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4078e-05 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.755492+0000", 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056474656999999998 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.755561+0000", 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8961999999999995e-05 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.755649+0000", 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7770999999999997e-05 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7520 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 3276800~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699177+0000", 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1667983400000002, 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057560675999999998, 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.912 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7520 2024-09-11T07:06:13.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.912 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699177+0000", 2024-09-11T07:06:13.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699177+0000", 2024-09-11T07:06:13.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699177+0000", 2024-09-11T07:06:13.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6400000000000003e-07 2024-09-11T07:06:13.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699182+0000", 2024-09-11T07:06:13.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4719999999999997e-06 2024-09-11T07:06:13.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699188+0000", 2024-09-11T07:06:13.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4500000000000001e-06 2024-09-11T07:06:13.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699194+0000", 2024-09-11T07:06:13.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9880000000000001e-06 2024-09-11T07:06:13.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.756527+0000", 2024-09-11T07:06:13.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057333242 2024-09-11T07:06:13.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.756623+0000", 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5932000000000002e-05 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.756737+0000", 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000114128 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7521 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 3915776~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699200+0000", 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.166774636, 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057790092000000001, 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7521 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699200+0000", 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699200+0000", 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699201+0000", 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9999999999999997e-07 2024-09-11T07:06:13.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699203+0000", 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1919999999999999e-06 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699211+0000", 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3119999999999996e-06 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699215+0000", 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7759999999999997e-06 2024-09-11T07:06:13.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.756795+0000", 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057579278999999997 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.756901+0000", 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000106372 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.756991+0000", 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9461000000000003e-05 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7522 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4030464~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699222+0000", 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1667532540000001, 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057962266999999998, 2024-09-11T07:06:13.921 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.922 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.922 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7522 2024-09-11T07:06:13.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.922 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699222+0000", 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699222+0000", 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699222+0000", 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4000000000000002e-07 2024-09-11T07:06:13.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699224+0000", 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.114e-06 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699230+0000", 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8379999999999998e-06 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699235+0000", 2024-09-11T07:06:13.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9200000000000003e-06 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757017+0000", 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057781642000000001 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757102+0000", 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4961000000000002e-05 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757184+0000", 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2352e-05 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7523 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4145152~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699244+0000", 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1667313109999999, 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058106724999999998, 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.926 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7523 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699244+0000", 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699244+0000", 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699244+0000", 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2199999999999999e-07 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699246+0000", 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1859999999999999e-06 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699252+0000", 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0140000000000004e-06 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699257+0000", 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8999999999999997e-06 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757209+0000", 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057951489000000002 2024-09-11T07:06:13.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757269+0000", 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0680999999999997e-05 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757350+0000", 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1032999999999995e-05 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7524 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4259840~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699264+0000", 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1667112450000001, 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058427802000000001, 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7524 2024-09-11T07:06:13.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.932 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699264+0000", 2024-09-11T07:06:13.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699264+0000", 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699264+0000", 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.34e-07 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699266+0000", 2024-09-11T07:06:13.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0159999999999998e-06 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699272+0000", 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.032e-06 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699277+0000", 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8620000000000002e-06 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757424+0000", 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058146417999999998 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757554+0000", 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012993999999999999 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757692+0000", 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0001381 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7525 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4898816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1666919569999998, 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058576490000000002, 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7525 2024-09-11T07:06:13.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701087+0000", 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018042780000000001 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701093+0000", 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7880000000000003e-06 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701108+0000", 2024-09-11T07:06:13.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4409999999999999e-05 2024-09-11T07:06:13.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701116+0000", 2024-09-11T07:06:13.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2120000000000003e-06 2024-09-11T07:06:13.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757734+0000", 2024-09-11T07:06:13.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056618467999999998 2024-09-11T07:06:13.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757798+0000", 2024-09-11T07:06:13.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3978000000000003e-05 2024-09-11T07:06:13.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757860+0000", 2024-09-11T07:06:13.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1356e-05 2024-09-11T07:06:13.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.942 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.943 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7531 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 6111232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.943 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.701387+0000", 2024-09-11T07:06:13.943 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1645875829999999, 2024-09-11T07:06:13.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057476119999999999, 2024-09-11T07:06:13.943 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.944 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.944 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.944 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7531 2024-09-11T07:06:13.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.945 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701387+0000", 2024-09-11T07:06:13.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701387+0000", 2024-09-11T07:06:13.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701388+0000", 2024-09-11T07:06:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4600000000000004e-07 2024-09-11T07:06:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701392+0000", 2024-09-11T07:06:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.388e-06 2024-09-11T07:06:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701399+0000", 2024-09-11T07:06:13.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8820000000000001e-06 2024-09-11T07:06:13.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701405+0000", 2024-09-11T07:06:13.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.446e-06 2024-09-11T07:06:13.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.758746+0000", 2024-09-11T07:06:13.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057340929999999998 2024-09-11T07:06:13.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.758805+0000", 2024-09-11T07:06:13.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8921000000000001e-05 2024-09-11T07:06:13.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.758864+0000", 2024-09-11T07:06:13.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8807000000000001e-05 2024-09-11T07:06:13.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.952 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.953 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7532 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.953 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.701412+0000", 2024-09-11T07:06:13.953 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1645626490000001, 2024-09-11T07:06:13.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057624872000000001, 2024-09-11T07:06:13.954 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.954 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.954 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.954 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.954 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.954 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.955 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7532 2024-09-11T07:06:13.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.955 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701412+0000", 2024-09-11T07:06:13.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701412+0000", 2024-09-11T07:06:13.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701413+0000", 2024-09-11T07:06:13.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9999999999999998e-07 2024-09-11T07:06:13.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701415+0000", 2024-09-11T07:06:13.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2500000000000001e-06 2024-09-11T07:06:13.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701421+0000", 2024-09-11T07:06:13.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9900000000000002e-06 2024-09-11T07:06:13.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701426+0000", 2024-09-11T07:06:13.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7960000000000003e-06 2024-09-11T07:06:13.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.758902+0000", 2024-09-11T07:06:13.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057476352000000001 2024-09-11T07:06:13.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.758969+0000", 2024-09-11T07:06:13.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6878000000000006e-05 2024-09-11T07:06:13.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.759037+0000", 2024-09-11T07:06:13.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8206000000000004e-05 2024-09-11T07:06:13.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.963 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.963 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.963 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7533 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.963 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.701432+0000", 2024-09-11T07:06:13.964 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1645430490000002, 2024-09-11T07:06:13.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057757724000000003, 2024-09-11T07:06:13.964 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.964 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.964 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.964 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.965 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.965 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7533 2024-09-11T07:06:13.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.965 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701432+0000", 2024-09-11T07:06:13.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701432+0000", 2024-09-11T07:06:13.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701433+0000", 2024-09-11T07:06:13.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:06:13.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701435+0000", 2024-09-11T07:06:13.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1880000000000001e-06 2024-09-11T07:06:13.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701441+0000", 2024-09-11T07:06:13.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8189999999999997e-06 2024-09-11T07:06:13.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701445+0000", 2024-09-11T07:06:13.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7099999999999998e-06 2024-09-11T07:06:13.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.759073+0000", 2024-09-11T07:06:13.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057627153 2024-09-11T07:06:13.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.759129+0000", 2024-09-11T07:06:13.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6827000000000003e-05 2024-09-11T07:06:13.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.759190+0000", 2024-09-11T07:06:13.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0390999999999998e-05 2024-09-11T07:06:13.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.973 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.973 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.974 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7534 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.974 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.701451+0000", 2024-09-11T07:06:13.974 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.16452387, 2024-09-11T07:06:13.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057910010999999997, 2024-09-11T07:06:13.975 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.975 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.975 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.975 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7534 2024-09-11T07:06:13.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.976 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701451+0000", 2024-09-11T07:06:13.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701451+0000", 2024-09-11T07:06:13.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701452+0000", 2024-09-11T07:06:13.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0600000000000001e-07 2024-09-11T07:06:13.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701454+0000", 2024-09-11T07:06:13.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.984e-06 2024-09-11T07:06:13.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701459+0000", 2024-09-11T07:06:13.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6080000000000003e-06 2024-09-11T07:06:13.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701464+0000", 2024-09-11T07:06:13.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.4959999999999998e-06 2024-09-11T07:06:13.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.759229+0000", 2024-09-11T07:06:13.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057765553999999997 2024-09-11T07:06:13.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.759296+0000", 2024-09-11T07:06:13.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6581999999999994e-05 2024-09-11T07:06:13.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.759361+0000", 2024-09-11T07:06:13.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5381000000000003e-05 2024-09-11T07:06:13.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.983 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.984 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.984 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7535 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 7094272~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.984 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.701470+0000", 2024-09-11T07:06:13.984 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1645053320000001, 2024-09-11T07:06:13.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058046343, 2024-09-11T07:06:13.985 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.985 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.985 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:13.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.986 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.986 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7535 2024-09-11T07:06:13.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.986 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701470+0000", 2024-09-11T07:06:13.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701470+0000", 2024-09-11T07:06:13.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.703755+0000", 2024-09-11T07:06:13.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0022851210000000002 2024-09-11T07:06:13.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.703763+0000", 2024-09-11T07:06:13.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3299999999999999e-06 2024-09-11T07:06:13.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.703780+0000", 2024-09-11T07:06:13.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7246999999999999e-05 2024-09-11T07:06:13.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.703798+0000", 2024-09-11T07:06:13.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7251000000000001e-05 2024-09-11T07:06:13.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.759397+0000", 2024-09-11T07:06:13.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055598912 2024-09-11T07:06:13.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.759455+0000", 2024-09-11T07:06:13.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8754e-05 2024-09-11T07:06:13.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:13.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.759516+0000", 2024-09-11T07:06:13.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0727999999999999e-05 2024-09-11T07:06:13.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.991 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:13.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:13.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.992 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7604 3.d 3:b57d1953:::rbd_data.11614fc4d54f.0000000000000002:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,truncate 65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:13.992 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.704066+0000", 2024-09-11T07:06:13.992 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 3.1619094589999999, 2024-09-11T07:06:13.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057749644000000003, 2024-09-11T07:06:13.992 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:13.992 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:13.992 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:13.992 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:13.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:13.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:13.993 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7604 2024-09-11T07:06:13.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.993 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:13.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:13.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.704066+0000", 2024-09-11T07:06:13.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.704066+0000", 2024-09-11T07:06:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.704067+0000", 2024-09-11T07:06:13.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1379999999999999e-06 2024-09-11T07:06:13.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:13.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.704074+0000", 2024-09-11T07:06:13.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8079999999999999e-06 2024-09-11T07:06:13.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:13.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.704091+0000", 2024-09-11T07:06:13.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7924999999999999e-05 2024-09-11T07:06:13.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:13.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.704103+0000", 2024-09-11T07:06:13.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1411e-05 2024-09-11T07:06:13.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:13.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.760380+0000", 2024-09-11T07:06:13.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056277027 2024-09-11T07:06:13.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:13.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.760519+0000", 2024-09-11T07:06:13.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013933700000000001 2024-09-11T07:06:13.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:06:13.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.760698+0000", 2024-09-11T07:06:13.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017921500000000001 2024-09-11T07:06:13.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:13.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.761601+0000", 2024-09-11T07:06:13.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00090238799999999995 2024-09-11T07:06:13.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:13.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.761751+0000", 2024-09-11T07:06:13.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000150039 2024-09-11T07:06:13.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:13.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:13.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:13.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.761784+0000", 2024-09-11T07:06:13.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3328999999999999e-05 2024-09-11T07:06:14.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:14.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:14.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:14.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.761815+0000", 2024-09-11T07:06:14.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1027e-05 2024-09-11T07:06:14.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:14.001 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:14.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:14.001 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:14.001 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:14.001 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:14.003 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone5 from 0xeb69de1 (overlap 0x9f92f1c) to 0x2fdf488 2024-09-11T07:06:14.004 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:14.004+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:14.005 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:14.104 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:14.102+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:14.134 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:14.135 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:14.135 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:14.150 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:14.205 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:14.204+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:14.227 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #4, image image_client.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent5 2024-09-11T07:06:14.229 INFO:teuthology.orchestra.run.smithi079.stdout:905 punch from 0x242ae97 to 0x242d8e6, (0x2a4f bytes) 2024-09-11T07:06:14.236 INFO:teuthology.orchestra.run.smithi079.stdout:906 read 0xbd616d thru 0xbe2fc7 (0xce5b bytes) 2024-09-11T07:06:14.248 INFO:teuthology.orchestra.run.smithi079.stdout:907 trunc from 0xeb69de1 to 0x69a5d4e 2024-09-11T07:06:14.282 INFO:teuthology.orchestra.run.smithi079.stdout:908 read 0x60b75fa thru 0x60bc3e6 (0x4ded bytes) 2024-09-11T07:06:14.283 INFO:teuthology.orchestra.run.smithi079.stdout:909 write 0x68807e7 thru 0x6880b73 (0x38d bytes) 2024-09-11T07:06:14.284 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:14.284 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:14.284 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:14.285 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:14.285 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:14.287 INFO:teuthology.orchestra.run.smithi079.stdout:911 read 0xcad93a thru 0xcb8970 (0xb037 bytes) 2024-09-11T07:06:14.287 INFO:teuthology.orchestra.run.smithi079.stdout:912 read 0x1968ad9 thru 0x196d7aa (0x4cd2 bytes) 2024-09-11T07:06:14.287 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.287 INFO:teuthology.orchestra.run.smithi079.stdout:914 read 0x4280380 thru 0x428d70d (0xd38e bytes) 2024-09-11T07:06:14.287 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.288 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.288 INFO:teuthology.orchestra.run.smithi079.stdout:917 read 0x2c3a6a7 thru 0x2c3b0ac (0xa06 bytes) 2024-09-11T07:06:14.299 INFO:teuthology.orchestra.run.smithi079.stdout:918 trunc from 0x69a5d4e to 0xd52d274 2024-09-11T07:06:14.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:14.308 INFO:teuthology.orchestra.run.smithi079.stdout:919 writesame 0x85adb07 thru 0x85b2e76 data_size 0x59(0x5370 bytes) 2024-09-11T07:06:14.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:14.308+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:14.316 INFO:teuthology.orchestra.run.smithi079.stdout:920 read 0x1f7dbc4 thru 0x1f8a150 (0xc58d bytes) 2024-09-11T07:06:14.317 INFO:teuthology.orchestra.run.smithi079.stdout:922 writesame 0x57126fa thru 0x571cf67 data_size 0x1(0xa86e bytes) 2024-09-11T07:06:14.389 INFO:teuthology.orchestra.run.smithi079.stdout:923 trunc from 0xd52d274 to 0x4e8c625 2024-09-11T07:06:14.409 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:14.406+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:14.425 INFO:teuthology.orchestra.run.smithi079.stdout:925 read 0x2b23608 thru 0x2b29cdb (0x66d4 bytes) 2024-09-11T07:06:14.425 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.426 INFO:teuthology.orchestra.run.smithi079.stdout:927 write 0x2056536 thru 0x20620aa (0xbb75 bytes) 2024-09-11T07:06:14.438 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.438 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6982 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671210+0000", 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7676090420000001, 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049279088999999998, 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6982 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671210+0000", 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671210+0000", 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671211+0000", 2024-09-11T07:06:14.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9500000000000003e-07 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671213+0000", 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.627e-06 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671220+0000", 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9650000000000002e-06 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671225+0000", 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0989999999999998e-06 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720398+0000", 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049172398999999999 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720435+0000", 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6906000000000002e-05 2024-09-11T07:06:14.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720489+0000", 2024-09-11T07:06:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4598000000000001e-05 2024-09-11T07:06:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7675884229999999, 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:06:14.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:06:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:06:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:06:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:06:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:06:14.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:06:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:06:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:06:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:06:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:06:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:06:14.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:06:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:06:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:06:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7675762829999999, 2024-09-11T07:06:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:06:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.451 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:06:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:06:14.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:06:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:06:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:06:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:06:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:06:14.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:06:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:06:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:06:14.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:06:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:06:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:06:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:06:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:06:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:06:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:06:14.457 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:14.458 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.766925332, 2024-09-11T07:06:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:06:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:06:14.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:14.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:06:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:06:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:06:14.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7668684360000002, 2024-09-11T07:06:14.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:06:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:06:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.465 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:06:14.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:06:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:06:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:06:14.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:06:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.470 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7668414019999998, 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:06:14.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:06:14.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:06:14.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:06:14.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.476 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.476 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:14.476 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7642975400000003, 2024-09-11T07:06:14.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:06:14.476 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.476 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.476 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:06:14.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:06:14.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:06:14.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:06:14.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:06:14.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:06:14.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:06:14.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:06:14.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:06:14.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:06:14.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:06:14.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:06:14.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.482 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.482 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.482 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:14.482 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7642754319999998, 2024-09-11T07:06:14.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:06:14.482 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.483 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.483 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.483 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:06:14.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.483 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:14.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:06:14.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.764255817, 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:06:14.487 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:06:14.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:06:14.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:06:14.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:06:14.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:06:14.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7642329119999998, 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.493 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:06:14.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:06:14.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:06:14.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7638541509999999, 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:06:14.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:06:14.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:06:14.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:06:14.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:06:14.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:06:14.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:06:14.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:06:14.503 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7638226489999997, 2024-09-11T07:06:14.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:06:14.504 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.504 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.504 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.504 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.504 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.504 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.504 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:06:14.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.505 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:06:14.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:06:14.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:06:14.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:06:14.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7633053739999998, 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:06:14.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:06:14.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:06:14.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:06:14.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7632812449999999, 2024-09-11T07:06:14.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:14.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:06:14.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:06:14.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:06:14.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.763267919, 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.520 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:06:14.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7628479910000001, 2024-09-11T07:06:14.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:06:14.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.528 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7628205819999998, 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:06:14.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:06:14.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7106 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5144576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676748+0000", 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7620707490000003, 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049281829999999999, 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.533 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7106 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676748+0000", 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676748+0000", 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676749+0000", 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1500000000000004e-07 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676753+0000", 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5760000000000002e-06 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676762+0000", 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9479999999999997e-06 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676768+0000", 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7039999999999997e-06 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725892+0000", 2024-09-11T07:06:14.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049124088000000003 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725962+0000", 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9930000000000003e-05 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726030+0000", 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7968999999999999e-05 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7620415779999998, 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:06:14.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:06:14.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7569414500000002, 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:14.542 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:14.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.546 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:14.547 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:14.547 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:14.547 INFO:teuthology.orchestra.run.smithi079.stdout:928 writesame 0x3fb89f5 thru 0x3fc4d05 data_size 0x1(0xc311 bytes) 2024-09-11T07:06:14.548 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:14.549 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.549 INFO:teuthology.orchestra.run.smithi079.stdout:931 writesame 0xa711299 thru 0xa71e360 data_size 0x88(0xd0c8 bytes) 2024-09-11T07:06:14.549 INFO:teuthology.orchestra.run.smithi079.stdout:932 writesame 0x66a525 thru 0x66b6d0 data_size 0x27(0x11ac bytes) 2024-09-11T07:06:14.549 INFO:teuthology.orchestra.run.smithi079.stdout:933 write 0x84caf65 thru 0x84d38fa (0x8996 bytes) 2024-09-11T07:06:14.549 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.549 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.550 INFO:teuthology.orchestra.run.smithi079.stdout:936 trunc from 0xa71e361 to 0x914848a 2024-09-11T07:06:14.550 INFO:teuthology.orchestra.run.smithi079.stdout:937 writesame 0x4beb34f thru 0x4bef83f data_size 0x35(0x44f1 bytes) 2024-09-11T07:06:14.550 INFO:teuthology.orchestra.run.smithi079.stdout:938 write 0xbb4ce35 thru 0xbb50076 (0x3242 bytes) 2024-09-11T07:06:14.551 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:14.546+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:14.555 INFO:teuthology.orchestra.run.smithi079.stdout:939 write 0x8d6357c thru 0x8d6fc48 (0xc6cd bytes) 2024-09-11T07:06:14.562 INFO:teuthology.orchestra.run.smithi079.stdout:941 write 0x5e5e4be thru 0x5e6d365 (0xeea8 bytes) 2024-09-11T07:06:14.572 INFO:teuthology.orchestra.run.smithi079.stdout:942 punch from 0xaecf2d8 to 0xaed79be, (0x86e6 bytes) 2024-09-11T07:06:14.572 INFO:teuthology.orchestra.run.smithi079.stdout:946 read 0x99e9857 thru 0x99f223f (0x89e9 bytes) 2024-09-11T07:06:14.594 INFO:teuthology.orchestra.run.smithi079.stdout:948 trunc from 0xbb50077 to 0xd61b8 2024-09-11T07:06:14.652 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:14.650+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:14.662 INFO:teuthology.orchestra.run.smithi079.stdout:949 punch from 0x378d4 to 0x3ce04, (0x5530 bytes) 2024-09-11T07:06:14.672 INFO:teuthology.orchestra.run.smithi079.stdout:951 writesame 0x17f034c thru 0x17f117d data_size 0x1(0xe32 bytes) 2024-09-11T07:06:14.672 INFO:teuthology.orchestra.run.smithi079.stdout:952 read 0x1186f7 thru 0x124f04 (0xc80e bytes) 2024-09-11T07:06:14.688 INFO:teuthology.orchestra.run.smithi079.stdout:953 trunc from 0x17f117e to 0xaa71b78 2024-09-11T07:06:14.697 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.697 INFO:teuthology.orchestra.run.smithi079.stdout:958 punch from 0x1c2917d to 0x1c35040, (0xbec3 bytes) 2024-09-11T07:06:14.697 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.697 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.697 INFO:teuthology.orchestra.run.smithi079.stdout:961 write 0x9270e1f thru 0x9276e4e (0x6030 bytes) 2024-09-11T07:06:14.704 INFO:teuthology.orchestra.run.smithi079.stdout:962 trunc from 0xaa71b78 to 0xc075b25 2024-09-11T07:06:14.705 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:14.705 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:14.705 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:14.705 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:14.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:14.728 INFO:teuthology.orchestra.run.smithi079.stdout:963 trunc from 0xc075b25 to 0x3b7ce6a 2024-09-11T07:06:14.747 INFO:teuthology.orchestra.run.smithi079.stdout:964 read 0x27b636d thru 0x27c1860 (0xb4f4 bytes) 2024-09-11T07:06:14.747 INFO:teuthology.orchestra.run.smithi079.stdout:965 read 0x279fdbd thru 0x27a58e0 (0x5b24 bytes) 2024-09-11T07:06:14.747 INFO:teuthology.orchestra.run.smithi079.stdout:967 trunc from 0x3b7ce6a to 0x433645c 2024-09-11T07:06:14.753 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:14.752+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:14.757 INFO:teuthology.orchestra.run.smithi079.stdout:968 read 0x42ef0c4 thru 0x42fa568 (0xb4a5 bytes) 2024-09-11T07:06:14.773 INFO:teuthology.orchestra.run.smithi079.stdout:969 write 0x8d80c20 thru 0x8d81776 (0xb57 bytes) 2024-09-11T07:06:14.780 INFO:teuthology.orchestra.run.smithi079.stdout:971 punch from 0x53aba4 to 0x53abc3, (0x1f bytes) 2024-09-11T07:06:14.780 INFO:teuthology.orchestra.run.smithi079.stdout:972 write 0x4809393 thru 0x4815c11 (0xc87f bytes) 2024-09-11T07:06:14.788 INFO:teuthology.orchestra.run.smithi079.stdout:973 trunc from 0x8d81777 to 0x8c91c06 2024-09-11T07:06:14.799 INFO:teuthology.orchestra.run.smithi079.stdout:974 write 0x1ffd84 thru 0x201b92 (0x1e0f bytes) 2024-09-11T07:06:14.814 INFO:teuthology.orchestra.run.smithi079.stdout:976 writesame 0x9c536a3 thru 0x9c5f8c5 data_size 0x1(0xc223 bytes) 2024-09-11T07:06:14.814 INFO:teuthology.orchestra.run.smithi079.stdout:977 read 0x74f4c9d thru 0x74fee1d (0xa181 bytes) 2024-09-11T07:06:14.814 INFO:teuthology.orchestra.run.smithi079.stdout:978 read 0x9d0330 thru 0x9d4e7a (0x4b4b bytes) 2024-09-11T07:06:14.814 INFO:teuthology.orchestra.run.smithi079.stdout:980 read 0x9aac5f thru 0x9ae636 (0x39d8 bytes) 2024-09-11T07:06:14.815 INFO:teuthology.orchestra.run.smithi079.stdout:981 punch from 0x14e55d4 to 0x14f3369, (0xdd95 bytes) 2024-09-11T07:06:14.824 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:06:14.824 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:06:14.824 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-11T07:06:14.825 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T07:06:14.830 INFO:teuthology.orchestra.run.smithi079.stdout:982 write 0xdcd6a35 thru 0xdcdfbce (0x919a bytes) 2024-09-11T07:06:14.837 INFO:teuthology.orchestra.run.smithi079.stdout:983 read 0x65a7675 thru 0x65b38e3 (0xc26f bytes) 2024-09-11T07:06:14.837 INFO:teuthology.orchestra.run.smithi079.stdout:984 read 0x840653e thru 0x840c75b (0x621e bytes) 2024-09-11T07:06:14.837 INFO:teuthology.orchestra.run.smithi079.stdout:985 write 0x1dd63e3 thru 0x1ddafa4 (0x4bc2 bytes) 2024-09-11T07:06:14.843 INFO:teuthology.orchestra.run.smithi079.stdout:987 read 0x82a6f44 thru 0x82af888 (0x8945 bytes) 2024-09-11T07:06:14.854 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:14.852+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:14.856 INFO:teuthology.orchestra.run.smithi079.stdout:989 trunc from 0xdcdfbcf to 0x5b85df6 2024-09-11T07:06:14.864 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:14.864 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:14.864 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:14.864 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:14.864 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:14.874 INFO:teuthology.orchestra.run.smithi079.stdout:990 punch from 0x3960636 to 0x396c8dc, (0xc2a6 bytes) 2024-09-11T07:06:14.874 INFO:teuthology.orchestra.run.smithi079.stdout:991 punch from 0x17dc16c to 0x17e819d, (0xc031 bytes) 2024-09-11T07:06:14.875 INFO:teuthology.orchestra.run.smithi079.stdout:992 read 0x3394194 thru 0x33976f1 (0x355e bytes) 2024-09-11T07:06:14.875 INFO:teuthology.orchestra.run.smithi079.stdout:993 read 0x9b917e thru 0x9ba6dd (0x1560 bytes) 2024-09-11T07:06:14.875 INFO:teuthology.orchestra.run.smithi079.stdout:994 write 0x52f0f39 thru 0x5300ccd (0xfd95 bytes) 2024-09-11T07:06:14.885 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:06:14.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:14.889 INFO:teuthology.orchestra.run.smithi079.stdout:995 trunc from 0x5b85df6 to 0x46d0c1a 2024-09-11T07:06:14.932 INFO:teuthology.orchestra.run.smithi079.stdout:996 write 0x93bad99 thru 0x93c99f2 (0xec5a bytes) 2024-09-11T07:06:14.941 INFO:teuthology.orchestra.run.smithi079.stdout:999 read 0x1fc1dd5 thru 0x1fc6be0 (0x4e0c bytes) 2024-09-11T07:06:14.941 INFO:teuthology.orchestra.run.smithi079.stdout:1000 punch from 0x69af865 to 0x69ba58b, (0xad26 bytes) 2024-09-11T07:06:14.941 INFO:teuthology.orchestra.run.smithi079.stdout:1001 write 0x6dd08c6 thru 0x6ddd595 (0xccd0 bytes) 2024-09-11T07:06:14.947 INFO:teuthology.orchestra.run.smithi079.stdout:1002 read 0x6790a50 thru 0x6792380 (0x1931 bytes) 2024-09-11T07:06:14.954 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:14.956+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:14.959 INFO:teuthology.orchestra.run.smithi079.stdout:1003 writesame 0xb69cbab thru 0xb6a52a3 data_size 0x1(0x86f9 bytes) 2024-09-11T07:06:14.959 INFO:teuthology.orchestra.run.smithi079.stdout:1004 read 0x75ab116 thru 0x75b5ee7 (0xadd2 bytes) 2024-09-11T07:06:14.959 INFO:teuthology.orchestra.run.smithi079.stdout:1005 read 0x61d06c5 thru 0x61dbc4e (0xb58a bytes) 2024-09-11T07:06:14.960 INFO:teuthology.orchestra.run.smithi079.stdout:1006 flatten 2024-09-11T07:06:14.970 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.982 INFO:teuthology.orchestra.run.smithi079.stdout:1009 write 0xe3a4b1e thru 0xe3af71e (0xac01 bytes) 2024-09-11T07:06:14.987 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:14.987 INFO:teuthology.orchestra.run.smithi079.stdout:1011 writesame 0xa8c52fb thru 0xa8ce755 data_size 0x1(0x945b bytes) 2024-09-11T07:06:15.010 INFO:teuthology.orchestra.run.smithi079.stdout:1014 punch from 0x7e338d9 to 0x7e378d0, (0x3ff7 bytes) 2024-09-11T07:06:15.010 INFO:teuthology.orchestra.run.smithi079.stdout:1015 write 0xa1fbe89 thru 0xa200021 (0x4199 bytes) 2024-09-11T07:06:15.020 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9385 3.19 3:9a974888:::rbd_data.11612823e096.0000000000000022:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.447814+0000", 2024-09-11T07:06:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.57301247600000005, 2024-09-11T07:06:15.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016670016999999999, 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9385 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447814+0000", 2024-09-11T07:06:15.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447814+0000", 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447817+0000", 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2499999999999998e-06 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447830+0000", 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3134e-05 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447862+0000", 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2153000000000002e-05 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447879+0000", 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6549999999999999e-05 2024-09-11T07:06:15.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447951+0000", 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2829000000000004e-05 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.448067+0000", 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011510000000000001 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:06:15.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.450627+0000", 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025605889999999998 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464373+0000", 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013745754000000001 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464409+0000", 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5676999999999997e-05 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464450+0000", 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1436000000000001e-05 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464484+0000", 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3544999999999998e-05 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9612 3.0 3:0669ea79:::rbd_data.11614fc4d54f.0000000000000000:6 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.614895+0000", 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.405931235, 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0083823030000000007, 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9612 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.027 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614895+0000", 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614895+0000", 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614896+0000", 2024-09-11T07:06:15.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1500000000000003e-07 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614900+0000", 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4279999999999998e-06 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614912+0000", 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1946999999999999e-05 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614921+0000", 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6670000000000002e-06 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.623170+0000", 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082489989999999999 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.623218+0000", 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8126e-05 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.623277+0000", 2024-09-11T07:06:15.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9221000000000001e-05 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9956 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.392404472, 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0084527600000000001, 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9956 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:15.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628424+0000", 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0930000000000001e-06 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628431+0000", 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8990000000000004e-06 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628436+0000", 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.853e-06 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636716+0000", 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082805110000000008 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636798+0000", 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1185000000000003e-05 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636874+0000", 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6693000000000006e-05 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9958 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 622592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:15.035 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39238308100000002, 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086422029999999993, 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9958 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.03e-07 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628446+0000", 2024-09-11T07:06:15.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2520000000000002e-06 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628452+0000", 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4280000000000001e-06 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628458+0000", 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6829999999999996e-06 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636908+0000", 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0084505799999999992 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636975+0000", 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7160000000000001e-05 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637085+0000", 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109697 2024-09-11T07:06:15.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9989 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 212992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39234137699999999, 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087728470000000003, 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9989 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.77e-07 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628488+0000", 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8559999999999998e-06 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628494+0000", 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1120000000000001e-06 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628501+0000", 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7499999999999997e-06 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637117+0000", 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086164710000000005 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637186+0000", 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8487999999999999e-05 2024-09-11T07:06:15.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637258+0000", 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1792999999999995e-05 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9991 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 344064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628556+0000", 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39226992300000002, 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088468039999999998, 2024-09-11T07:06:15.044 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9991 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628556+0000", 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628556+0000", 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628557+0000", 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8899999999999999e-07 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628564+0000", 2024-09-11T07:06:15.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2819999999999999e-06 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628571+0000", 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6969999999999996e-06 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628576+0000", 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3059999999999997e-06 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637293+0000", 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087169269999999993 2024-09-11T07:06:15.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637348+0000", 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5408000000000002e-05 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637403+0000", 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4494999999999999e-05 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9992 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628583+0000", 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39224280500000003, 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0083642779999999993, 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9992 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.049 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628583+0000", 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628583+0000", 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628584+0000", 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8299999999999997e-07 2024-09-11T07:06:15.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628586+0000", 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1110000000000002e-06 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628592+0000", 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0009999999999998e-06 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628597+0000", 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0220000000000004e-06 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636732+0000", 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081352999999999998 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636845+0000", 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113058 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636948+0000", 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102303 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9993 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39222119500000002, 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089343319999999997, 2024-09-11T07:06:15.053 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9993 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5700000000000002e-07 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628608+0000", 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4119999999999999e-06 2024-09-11T07:06:15.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628614+0000", 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.251e-06 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628619+0000", 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8740000000000003e-06 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637425+0000", 2024-09-11T07:06:15.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088061509999999999 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637482+0000", 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6805000000000002e-05 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637539+0000", 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7281999999999998e-05 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9994 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 606208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39220007200000001, 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085150250000000007, 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9994 2024-09-11T07:06:15.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9200000000000002e-07 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628628+0000", 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628635+0000", 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1299999999999998e-06 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628639+0000", 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9130000000000002e-06 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636991+0000", 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0083513919999999991 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637065+0000", 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4510000000000003e-05 2024-09-11T07:06:15.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637141+0000", 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650999999999998e-05 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9995 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 606208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39218005700000003, 2024-09-11T07:06:15.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090897089999999996, 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9995 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9499999999999998e-07 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628648+0000", 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9920000000000002e-06 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628654+0000", 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628659+0000", 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7199999999999997e-06 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637562+0000", 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089024039999999992 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637620+0000", 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8319999999999997e-05 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637736+0000", 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011581799999999999 2024-09-11T07:06:15.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10032 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 147456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628666+0000", 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.392159702, 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087436330000000007, 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10032 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628666+0000", 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628666+0000", 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628667+0000", 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628669+0000", 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2079999999999999e-06 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628675+0000", 2024-09-11T07:06:15.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4999999999999996e-06 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628681+0000", 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9680000000000003e-06 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637191+0000", 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085096589999999993 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637311+0000", 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119571 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637410+0000", 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9309999999999996e-05 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10033 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 147456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.071 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628689+0000", 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39213690499999998, 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092145349999999994, 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10033 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628689+0000", 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628689+0000", 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628690+0000", 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2e-07 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628692+0000", 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4380000000000002e-06 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628699+0000", 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.567e-06 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628704+0000", 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5459999999999999e-06 2024-09-11T07:06:15.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637760+0000", 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090558700000000006 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637811+0000", 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1137999999999997e-05 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637904+0000", 2024-09-11T07:06:15.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2555999999999999e-05 2024-09-11T07:06:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10034 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 278528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39211416700000001, 2024-09-11T07:06:15.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088786860000000002, 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10034 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:15.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4099999999999999e-07 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628715+0000", 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.447e-06 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628721+0000", 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5549999999999999e-06 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628726+0000", 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7650000000000001e-06 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637452+0000", 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087259980000000004 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637522+0000", 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0326000000000004e-05 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637591+0000", 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8153999999999998e-05 2024-09-11T07:06:15.080 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10035 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 278528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628733+0000", 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.392092571, 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093551009999999993, 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.081 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10035 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628733+0000", 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628733+0000", 2024-09-11T07:06:15.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628734+0000", 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1199999999999998e-07 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628736+0000", 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2680000000000001e-06 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628745+0000", 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2869999999999993e-06 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628751+0000", 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7019999999999998e-06 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637928+0000", 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0091772820000000001 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638024+0000", 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5546999999999998e-05 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638089+0000", 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4603000000000005e-05 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.085 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10036 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39205124000000002, 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008972275, 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10036 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9299999999999998e-07 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628779+0000", 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2569999999999999e-06 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628787+0000", 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3480000000000004e-06 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628793+0000", 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6949999999999997e-06 2024-09-11T07:06:15.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637619+0000", 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088259429999999993 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637681+0000", 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2838999999999999e-05 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637747+0000", 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5599999999999995e-05 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10037 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628801+0000", 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.392024653, 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094195819999999993, 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.090 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10037 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628801+0000", 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628801+0000", 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628802+0000", 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6599999999999996e-07 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628805+0000", 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7539999999999998e-06 2024-09-11T07:06:15.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628811+0000", 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7549999999999997e-06 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628817+0000", 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999997e-06 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638121+0000", 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093040369999999994 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638172+0000", 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0705999999999999e-05 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638221+0000", 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8804000000000002e-05 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.094 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10038 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 540672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628827+0000", 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39199857999999999, 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092094519999999999, 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.095 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10038 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628827+0000", 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628827+0000", 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628828+0000", 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628830+0000", 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3659999999999999e-06 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628837+0000", 2024-09-11T07:06:15.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7290000000000003e-06 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628842+0000", 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2580000000000003e-06 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637797+0000", 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089549380000000008 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637926+0000", 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012899999999999999 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638037+0000", 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000110747 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.099 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10039 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 540672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628850+0000", 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39197591900000001, 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095082959999999994, 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10039 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628850+0000", 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628850+0000", 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628851+0000", 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:06:15.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628859+0000", 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8460000000000008e-06 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628867+0000", 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1009999999999992e-06 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628873+0000", 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8159999999999999e-06 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638242+0000", 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093698649999999998 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638308+0000", 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5235999999999997e-05 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638358+0000", 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0797999999999997e-05 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10040 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 671744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628882+0000", 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39194413900000002, 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096786370000000004, 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.104 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10040 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628882+0000", 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628882+0000", 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628883+0000", 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-07 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628885+0000", 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3429999999999998e-06 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628892+0000", 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7830000000000001e-06 2024-09-11T07:06:15.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628897+0000", 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2979999999999999e-06 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638383+0000", 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094860110000000008 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638468+0000", 2024-09-11T07:06:15.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4596000000000001e-05 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638561+0000", 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2885000000000003e-05 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10041 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 671744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:15.108 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.39192051100000003, 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093034399999999996, 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10041 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:15.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0400000000000002e-07 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628908+0000", 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.176e-06 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628915+0000", 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5359999999999998e-06 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628920+0000", 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7860000000000002e-06 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638067+0000", 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0091466810000000003 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638137+0000", 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0236999999999999e-05 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638209+0000", 2024-09-11T07:06:15.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1619999999999995e-05 2024-09-11T07:06:15.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.113 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.113 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.113 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.113 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:15.114 INFO:teuthology.orchestra.run.smithi079.stdout:1016 trunc from 0xe3af71f to 0x319f34f 2024-09-11T07:06:15.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:15.116 INFO:teuthology.orchestra.run.smithi079.stdout:1018 punch from 0xe28dc0 to 0xe353cc, (0xc60c bytes) 2024-09-11T07:06:15.116 INFO:teuthology.orchestra.run.smithi079.stdout:1020 write 0x17194d thru 0x17576d (0x3e21 bytes) 2024-09-11T07:06:15.116 INFO:teuthology.orchestra.run.smithi079.stdout:1021 writesame 0x5914a6e thru 0x59166a4 data_size 0x1(0x1c37 bytes) 2024-09-11T07:06:15.116 INFO:teuthology.orchestra.run.smithi079.stdout:1022 write 0x840d66a thru 0x841c727 (0xf0be bytes) 2024-09-11T07:06:15.116 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:15.116 INFO:teuthology.orchestra.run.smithi079.stdout:1024 trunc from 0x841c728 to 0x6ca094e 2024-09-11T07:06:15.116 INFO:teuthology.orchestra.run.smithi079.stdout:1025 read 0x5230ad7 thru 0x5237e4e (0x7378 bytes) 2024-09-11T07:06:15.116 INFO:teuthology.orchestra.run.smithi079.stdout:1026 write 0x5d956d2 thru 0x5d9e990 (0x92bf bytes) 2024-09-11T07:06:15.117 INFO:teuthology.orchestra.run.smithi079.stdout:1027 write 0x4fad493 thru 0x4fb1fb1 (0x4b1f bytes) 2024-09-11T07:06:15.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:15.112+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:15.117 INFO:teuthology.orchestra.run.smithi079.stdout:1028 read 0x45f35fc thru 0x4600816 (0xd21b bytes) 2024-09-11T07:06:15.118 INFO:teuthology.orchestra.run.smithi079.stdout:1029 read 0x6811f29 thru 0x6820de9 (0xeec1 bytes) 2024-09-11T07:06:15.131 INFO:teuthology.orchestra.run.smithi079.stdout:1030 write 0xa510d1b thru 0xa51fe27 (0xf10d bytes) 2024-09-11T07:06:15.137 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:15.137 INFO:teuthology.orchestra.run.smithi079.stdout:1032 write 0x34cf007 thru 0x34d3ada (0x4ad4 bytes) 2024-09-11T07:06:15.145 INFO:teuthology.orchestra.run.smithi079.stdout:1033 clone 7 order 19 su 4096 sc 9 2024-09-11T07:06:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:06:15.166 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 34, 2024-09-11T07:06:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "e1313abd-54a9-4e53-ab67-469f744048b1", 2024-09-11T07:06:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-11T07:05:29.098467+0000", 2024-09-11T07:06:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-11T07:06:14.877344+0000", 2024-09-11T07:06:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-11T07:05:41.051856+0000", 2024-09-11T07:06:15.166 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-11T07:05:31.688503+0000", 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5804032, 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "nodeep-scrub", 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T07:06:15.167 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "squid", 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:41.897005+0000", 2024-09-11T07:06:15.168 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-11T07:06:15.169 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:06:15.170 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:06:15.171 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:06:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 8, 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 8, 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.25, 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:47.687214+0000", 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:06:15.175 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:06:15.176 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "20", 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 2, 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 20, 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:06:15.177 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:06:15.178 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:06:15.179 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.9900000095367432, 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.9900000095367432, 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.87999999523162842, 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.75, 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.75, 2024-09-11T07:06:15.180 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:57.298060+0000", 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:06:15.181 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-11T07:06:15.182 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "33", 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:06:15.183 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 8, 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 33, 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:06:15.184 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:06:15.185 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.5, 2024-09-11T07:06:15.186 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.5, 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 1, 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.5, 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.5, 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 1, 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 1 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "24d57cdb-2f3a-4a96-903d-11be7dc26a20", 2024-09-11T07:06:15.187 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:15.190 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.191 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/1708235775", 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/1708235775", 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/1708235775", 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/1708235775", 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "aa51dc1b-b783-4212-8736-1f666239613b", 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:15.193 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.194 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-11T07:06:15.195 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.196 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/2076268206", 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/2076268206", 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/2076268206", 2024-09-11T07:06:15.198 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/2076268206", 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "141a913f-7353-44a9-9dbd-70219bcee638", 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:15.199 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:15.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-11T07:06:15.203 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/1904492349", 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/1904492349", 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/1904492349", 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/1904492349", 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:15.204 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "32550aeb-0c8d-4ca9-afd5-3e5258e7255b", 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:15.205 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-11T07:06:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-11T07:06:15.207 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.208 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/1327328912", 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/1327328912", 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/1327328912", 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/1327328912", 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:15.210 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc", 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:15.211 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6808", 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6809", 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:15.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6810", 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6811", 2024-09-11T07:06:15.213 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6814", 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6815", 2024-09-11T07:06:15.214 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6812", 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6813", 2024-09-11T07:06:15.215 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6809/4087452871", 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6811/4087452871", 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6815/4087452871", 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6813/4087452871", 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.216 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "42c83053-328e-4c9b-bdaf-09e1a4cc8b7d", 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:15.217 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6824", 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6825", 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:15.218 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6826", 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6827", 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:15.219 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6830", 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6831", 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.220 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6828", 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6829", 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.221 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6825/2133006853", 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6827/2133006853", 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6831/2133006853", 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6829/2133006853", 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "0ab29b1f-3012-4528-8f47-2cac908122c9", 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:15.222 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.223 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6816", 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6817", 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6818", 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6819", 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6822", 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6823", 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6820", 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6821", 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6817/2083734892", 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6819/2083734892", 2024-09-11T07:06:15.227 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6823/2083734892", 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6821/2083734892", 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d9c7d12b-be93-41c9-a246-773faa65ecaf", 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:15.228 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6800", 2024-09-11T07:06:15.229 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6801", 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6802", 2024-09-11T07:06:15.230 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6803", 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6806", 2024-09-11T07:06:15.231 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6807", 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:15.232 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6804", 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6805", 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6801/2322042784", 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6803/2322042784", 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2322042784", 2024-09-11T07:06:15.233 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2322042784", 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:15.234 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.653648+0000", 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.846269+0000", 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:15.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.970884+0000", 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:06:15.236 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.985630+0000", 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:15.237 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.236412+0000", 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.336953+0000", 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.306806+0000", 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:15.239 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.104744+0000", 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-11T07:06:15.240 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-11T07:06:15.241 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-11T07:06:15.242 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-11T07:06:15.242 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-11T07:06:15.242 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-11T07:06:15.242 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-11T07:06:15.242 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-11T07:06:15.242 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-11T07:06:15.242 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-11T07:06:15.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.242 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:15.244 INFO:tasks.thrashosds.thrasher:j is {'epoch': 34, 'fsid': 'e1313abd-54a9-4e53-ab67-469f744048b1', 'created': '2024-09-11T07:05:29.098467+0000', 'modified': '2024-09-11T07:06:14.877344+0000', 'last_up_change': '2024-09-11T07:05:41.051856+0000', 'last_in_change': '2024-09-11T07:05:31.688503+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T07:05:41.897005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T07:05:47.687214+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T07:05:57.298060+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 8, 'snap_epoch': 33, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '24d57cdb-2f3a-4a96-903d-11be7dc26a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6825', 'nonce': 1708235775}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6826', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 1708235775}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6830', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 1708235775}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6829', 'nonce': 1708235775}]}, 'public_addr': '172.21.15.79:6825/1708235775', 'cluster_addr': '172.21.15.79:6827/1708235775', 'heartbeat_back_addr': '172.21.15.79:6831/1708235775', 'heartbeat_front_addr': '172.21.15.79:6829/1708235775', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa51dc1b-b783-4212-8736-1f666239613b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 2076268206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 2076268206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 2076268206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 2076268206}]}, 'public_addr': '172.21.15.79:6801/2076268206', 'cluster_addr': '172.21.15.79:6803/2076268206', 'heartbeat_back_addr': '172.21.15.79:6807/2076268206', 'heartbeat_front_addr': '172.21.15.79:6805/2076268206', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '141a913f-7353-44a9-9dbd-70219bcee638', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6817', 'nonce': 1904492349}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6818', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1904492349}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6822', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 1904492349}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6821', 'nonce': 1904492349}]}, 'public_addr': '172.21.15.79:6817/1904492349', 'cluster_addr': '172.21.15.79:6819/1904492349', 'heartbeat_back_addr': '172.21.15.79:6823/1904492349', 'heartbeat_front_addr': '172.21.15.79:6821/1904492349', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '32550aeb-0c8d-4ca9-afd5-3e5258e7255b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 1327328912}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 1327328912}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 1327328912}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 1327328912}]}, 'public_addr': '172.21.15.79:6809/1327328912', 'cluster_addr': '172.21.15.79:6811/1327328912', 'heartbeat_back_addr': '172.21.15.79:6815/1327328912', 'heartbeat_front_addr': '172.21.15.79:6813/1327328912', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 4087452871}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 4087452871}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 4087452871}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 4087452871}]}, 'public_addr': '172.21.15.110:6809/4087452871', 'cluster_addr': '172.21.15.110:6811/4087452871', 'heartbeat_back_addr': '172.21.15.110:6815/4087452871', 'heartbeat_front_addr': '172.21.15.110:6813/4087452871', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '42c83053-328e-4c9b-bdaf-09e1a4cc8b7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 2133006853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 2133006853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 2133006853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 2133006853}]}, 'public_addr': '172.21.15.110:6825/2133006853', 'cluster_addr': '172.21.15.110:6827/2133006853', 'heartbeat_back_addr': '172.21.15.110:6831/2133006853', 'heartbeat_front_addr': '172.21.15.110:6829/2133006853', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0ab29b1f-3012-4528-8f47-2cac908122c9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 2083734892}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 2083734892}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 2083734892}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 2083734892}]}, 'public_addr': '172.21.15.110:6817/2083734892', 'cluster_addr': '172.21.15.110:6819/2083734892', 'heartbeat_back_addr': '172.21.15.110:6823/2083734892', 'heartbeat_front_addr': '172.21.15.110:6821/2083734892', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'd9c7d12b-be93-41c9-a246-773faa65ecaf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2322042784}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2322042784}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2322042784}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2322042784}]}, 'public_addr': '172.21.15.110:6801/2322042784', 'cluster_addr': '172.21.15.110:6803/2322042784', 'heartbeat_back_addr': '172.21.15.110:6807/2322042784', 'heartbeat_front_addr': '172.21.15.110:6805/2322042784', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.653648+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.846269+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.970884+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.985630+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.236412+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.336953+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.306806+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.104744+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T07:06:15.244 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-11T07:06:15.244 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:15.245 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:15.245 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:15.245 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:15.245 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:15.244+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:15.253 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:15.344 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:15.344+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:15.410 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:15.411 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:15.423 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:15.467 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:15.468+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:15.546 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:15.542+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:15.589 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4232.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-11T07:06:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.433106095999999, 2024-09-11T07:06:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021932660000000001, 2024-09-11T07:06:15.589 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0200000000000002e-07 2024-09-11T07:06:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154680+0000", 2024-09-11T07:06:15.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4540000000000001e-06 2024-09-11T07:06:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154695+0000", 2024-09-11T07:06:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.518e-05 2024-09-11T07:06:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154706+0000", 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0572e-05 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154769+0000", 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3341000000000002e-05 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154796+0000", 2024-09-11T07:06:15.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6897999999999999e-05 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.156813+0000", 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002016856 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.156865+0000", 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2463000000000002e-05 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1260 3.0 e26/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 26'24, mlcod=26'22)", 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.887992+0000", 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.6997856720000009, 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023221700000000001, 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887992+0000", 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887992+0000", 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887994+0000", 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.438e-06 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888005+0000", 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1136e-05 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888033+0000", 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8428999999999998e-05 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888047+0000", 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4117999999999999e-05 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888172+0000", 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012466500000000001 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888239+0000", 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7058999999999996e-05 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890254+0000", 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020145060000000001 2024-09-11T07:06:15.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890315+0000", 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0819000000000002e-05 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1263 3.0 e26/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 26'25, mlcod=26'22)", 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.6985287610000004, 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002862819, 2024-09-11T07:06:15.599 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889250+0000", 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4e-07 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889259+0000", 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3129999999999999e-06 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889289+0000", 2024-09-11T07:06:15.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0975000000000001e-05 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889302+0000", 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2699e-05 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889815+0000", 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051256399999999997 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889850+0000", 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5583000000000001e-05 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892013+0000", 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021629449999999999 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892112+0000", 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8800000000000003e-05 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1267 3.0 e26/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 26'26, mlcod=26'22)", 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.6979551720000003, 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045762700000000003, 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.604 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:15.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889824+0000", 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-06 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889834+0000", 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9480000000000003e-06 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889852+0000", 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8017e-05 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889863+0000", 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0992000000000001e-05 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890364+0000", 2024-09-11T07:06:15.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050119400000000005 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890395+0000", 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.112e-05 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894342+0000", 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039468189999999998 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894399+0000", 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6929999999999999e-05 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1324 3.0 e26/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 26'27, mlcod=26'25)", 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.010797+0000", 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.5769813169999995, 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023525120000000002, 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.609 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010797+0000", 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010797+0000", 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010798+0000", 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.545e-06 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010827+0000", 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8345000000000001e-05 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010852+0000", 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5613e-05 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010864+0000", 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1362999999999999e-05 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011147+0000", 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028374999999999999 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011174+0000", 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6676999999999999e-05 2024-09-11T07:06:15.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013092+0000", 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019180480000000001 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013149+0000", 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7170999999999999e-05 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1409 3.0 e26/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 26'35, mlcod=26'33)", 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.146979+0000", 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.4407989640000007, 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00185703, 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146979+0000", 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146979+0000", 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146980+0000", 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4419999999999999e-06 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146990+0000", 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6439999999999995e-06 2024-09-11T07:06:15.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147013+0000", 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3368000000000001e-05 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147023+0000", 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8830000000000001e-06 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147227+0000", 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000203857 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147248+0000", 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0767999999999998e-05 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.148790+0000", 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001541564 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.148836+0000", 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6504000000000001e-05 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1461 3.0 e26/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 26'39, mlcod=26'37)", 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.224397+0000", 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.3633808809999994, 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019313550000000001, 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224397+0000", 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224397+0000", 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224399+0000", 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-06 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224439+0000", 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9459999999999998e-05 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224476+0000", 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7719000000000003e-05 2024-09-11T07:06:15.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224496+0000", 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9752999999999999e-05 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224594+0000", 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7850000000000007e-05 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224621+0000", 2024-09-11T07:06:15.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6463999999999999e-05 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.226240+0000", 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001619908 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.226328+0000", 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030999999999998e-05 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1487 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'41, mlcod=26'39)", 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.380230+0000", 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.2075480140000003, 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025963000000000002, 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380230+0000", 2024-09-11T07:06:15.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380230+0000", 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380232+0000", 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4830000000000002e-06 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380252+0000", 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9879999999999999e-05 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380298+0000", 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5392999999999997e-05 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380324+0000", 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5962999999999999e-05 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380609+0000", 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000285634 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380679+0000", 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9843000000000002e-05 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382748+0000", 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002068987 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382826+0000", 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8116999999999998e-05 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1490 3.0 e27/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 27'42, mlcod=26'39)", 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.381462+0000", 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.2063159169999995, 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024154110000000001, 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.627 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381462+0000", 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381462+0000", 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381464+0000", 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7e-06 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381477+0000", 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.331e-05 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381502+0000", 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4786e-05 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381529+0000", 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6979999999999999e-05 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381714+0000", 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184888 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381733+0000", 2024-09-11T07:06:15.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9707e-05 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.383765+0000", 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020319240000000001 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.383878+0000", 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000112116 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1494 3.0 e27/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 27'43, mlcod=26'39)", 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.2061991049999996, 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002949344, 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:15.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381580+0000", 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8400000000000002e-07 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381590+0000", 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0163000000000001e-05 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381618+0000", 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7705999999999999e-05 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381634+0000", 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6362999999999999e-05 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382022+0000", 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038785099999999998 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382076+0000", 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4440000000000001e-05 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384415+0000", 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002338578 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384528+0000", 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011325899999999999 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1530 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'44, mlcod=27'42)", 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.1257130760000003, 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031748789999999998, 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462067+0000", 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4839999999999998e-06 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462088+0000", 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0539000000000001e-05 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462135+0000", 2024-09-11T07:06:15.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7102999999999999e-05 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462157+0000", 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2399999999999999e-05 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462289+0000", 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000131509 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462357+0000", 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8085999999999998e-05 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465119+0000", 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002762029 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465240+0000", 2024-09-11T07:06:15.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000120729 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1533 3.0 e27/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 27'45, mlcod=27'42)", 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.1245001329999997, 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004605179, 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463279+0000", 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4619999999999999e-06 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463290+0000", 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1092e-05 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463310+0000", 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9647999999999999e-05 2024-09-11T07:06:15.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463326+0000", 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5614e-05 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463402+0000", 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6174000000000006e-05 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463431+0000", 2024-09-11T07:06:15.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8875999999999999e-05 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467839+0000", 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044084079999999999 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467883+0000", 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3905000000000001e-05 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1537 3.0 e27/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 27'46, mlcod=27'42)", 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.1236280399999998, 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037617390000000001, 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:15.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464151+0000", 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.232e-06 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464161+0000", 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3479999999999993e-06 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464182+0000", 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1141999999999998e-05 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464193+0000", 2024-09-11T07:06:15.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.163e-05 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464273+0000", 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9396999999999999e-05 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464300+0000", 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6811000000000001e-05 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467890+0000", 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003590626 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467912+0000", 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1552999999999998e-05 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1574 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'47, mlcod=27'45)", 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.535781+0000", 2024-09-11T07:06:15.650 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0519973319999991, 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019771369999999999, 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535781+0000", 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535781+0000", 2024-09-11T07:06:15.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535783+0000", 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.283e-06 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535859+0000", 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6234000000000002e-05 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535903+0000", 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4091999999999997e-05 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535927+0000", 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.366e-05 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.536069+0000", 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014184899999999999 2024-09-11T07:06:15.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.536117+0000", 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.782e-05 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.537710+0000", 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001593061 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.537758+0000", 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8137999999999999e-05 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:3919 3.9 e30/21 3:906e061f:::rbd_data.11614fc4d54f.0000000000000041:head v 30'7, mlcod=25'5)", 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.203847+0000", 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.3839313200000003, 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025166630000000001, 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.655 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203847+0000", 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203847+0000", 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203848+0000", 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4e-07 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203954+0000", 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106536 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203989+0000", 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4539999999999998e-05 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.204011+0000", 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.27e-05 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.204097+0000", 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5618000000000006e-05 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.204120+0000", 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2976000000000002e-05 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.206319+0000", 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021993529999999998 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.206363+0000", 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3999999999999999e-05 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:4085 3.9 e30/21 3:92922d72:::rbd_data.11614fc4d54f.000000000000006b:head v 30'8, mlcod=25'6)", 2024-09-11T07:06:15.659 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.297818+0000", 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.2899597759999999, 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0018185440000000001, 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.297818+0000", 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.297818+0000", 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.297819+0000", 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2160000000000001e-06 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.297839+0000", 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9168e-05 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.297851+0000", 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2813000000000001e-05 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.297858+0000", 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4729999999999997e-06 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.297996+0000", 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013806300000000001 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.298060+0000", 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3713000000000005e-05 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.299591+0000", 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001531571 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.299637+0000", 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5527e-05 2024-09-11T07:06:15.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:8899 3.4 e33/21 3:26e1d6b2:::rbd_data.116153756644.0000000000000025:head v 33'30, mlcod=33'27)", 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:13.985178+0000", 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.602600467, 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0018016079999999999, 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:13.985178+0000", 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:13.985178+0000", 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:13.985178+0000", 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5000000000000002e-07 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:13.985186+0000", 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9910000000000002e-06 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:13.985202+0000", 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5801999999999999e-05 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:13.985210+0000", 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7309999999999993e-06 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:13.985404+0000", 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000194422 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:13.985426+0000", 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1838e-05 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:13.986923+0000", 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001496659 2024-09-11T07:06:15.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:13.986979+0000", 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6415000000000001e-05 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.0 epoch 33/21 rep_tid 136 entries 33'88 (0'0) error 3:00d3d0eb:::rbd_data.116153756644.0000000000000033:head by client.4449.0:8937 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 33'86)", 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.58461648, 2024-09-11T07:06:15.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026246419999999999, 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003163+0000", 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1009999999999999e-06 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003175+0000", 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2041999999999999e-05 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003197+0000", 2024-09-11T07:06:15.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2286e-05 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003213+0000", 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6160000000000001e-05 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003315+0000", 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102329 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.005786+0000", 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024707240000000001 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:8976 3.9 e33/21 3:96232816:::rbd_data.116153756644.0000000000000043:head v 33'22, mlcod=33'20)", 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.021190+0000", 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.5665879550000001, 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023778330000000002, 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021190+0000", 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021190+0000", 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021191+0000", 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3039999999999999e-06 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021199+0000", 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6799999999999993e-06 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021211+0000", 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2208000000000001e-05 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021219+0000", 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8499999999999994e-06 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021318+0000", 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9077e-05 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021337+0000", 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9174e-05 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.023526+0000", 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021883670000000001 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.023568+0000", 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2172999999999998e-05 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:10198 3.0 e34/21 3:0497d956:::rbd_data.11612823e096.000000000000002a:head v 34'96, mlcod=33'94)", 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.884481+0000", 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.70329652799999998, 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019149029999999999, 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884481+0000", 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884481+0000", 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884482+0000", 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4699999999999998e-07 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884537+0000", 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5723000000000002e-05 2024-09-11T07:06:15.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884550+0000", 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2604e-05 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884560+0000", 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7499999999999998e-06 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884654+0000", 2024-09-11T07:06:15.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4252000000000005e-05 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884676+0000", 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2052000000000002e-05 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.886357+0000", 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001681201 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:15.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.886396+0000", 2024-09-11T07:06:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9073999999999999e-05 2024-09-11T07:06:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:15.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:15.681 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:15.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:15.683 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:15.684+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:15.783 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:15.784+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:15.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:15.853 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:15.853 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:15.855 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:15.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:15.885 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:15.882+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:15.955 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:15.955 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:15.973 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:15.974 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:15.986 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:15.982+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:15.990 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:15.991 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:16.006 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:16.007 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:16.009 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:16.009 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:16.024 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:16.030 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:16.030 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:16.051 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:16.073 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:16.073 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:16.088 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:16.086+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:16.096 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:16.096 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:16.146 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:16.146 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:16.160 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:16.183 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #5, image image_client.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent6 2024-09-11T07:06:16.188 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:16.188+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:16.289 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:16.288+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:16.302 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:16.302 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:16.316 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:16.322 INFO:teuthology.orchestra.run.smithi079.stdout:1034 read 0x865d57c thru 0x8669475 (0xbefa bytes) 2024-09-11T07:06:16.342 INFO:teuthology.orchestra.run.smithi079.stdout:1035 writesame 0xd039eb2 thru 0xd03ca26 data_size 0x19(0x2b75 bytes) 2024-09-11T07:06:16.342 INFO:teuthology.orchestra.run.smithi079.stdout:1036 write 0xbd90bcf thru 0xbda0119 (0xf54b bytes) 2024-09-11T07:06:16.357 INFO:teuthology.orchestra.run.smithi079.stdout:1037 write 0x3736686 thru 0x373b307 (0x4c82 bytes) 2024-09-11T07:06:16.390 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:16.386+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:16.436 INFO:teuthology.orchestra.run.smithi079.stdout:1038 trunc from 0xd03ca27 to 0xa7950b9 2024-09-11T07:06:16.447 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:16.448 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:16.463 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:16.464 INFO:teuthology.orchestra.run.smithi079.stdout:1040 punch from 0x7d8553a to 0x7d94129, (0xebef bytes) 2024-09-11T07:06:16.483 INFO:teuthology.orchestra.run.smithi079.stdout:1041 writesame 0xd41856c thru 0xd41b928 data_size 0x5(0x33bd bytes) 2024-09-11T07:06:16.483 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:16.483 INFO:teuthology.orchestra.run.smithi079.stdout:1045 write 0x6721eb1 thru 0x672fc3f (0xdd8f bytes) 2024-09-11T07:06:16.503 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:16.503 INFO:teuthology.orchestra.run.smithi079.stdout:1047 read 0x45096d8 thru 0x450d00d (0x3936 bytes) 2024-09-11T07:06:16.503 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:16.503 INFO:teuthology.orchestra.run.smithi079.stdout:1050 punch from 0x5074dcc to 0x507aa18, (0x5c4c bytes) 2024-09-11T07:06:16.503 INFO:teuthology.orchestra.run.smithi079.stdout:1051 read 0x958e62c thru 0x9595369 (0x6d3e bytes) 2024-09-11T07:06:16.503 INFO:teuthology.orchestra.run.smithi079.stdout:1052 read 0x3ff28b4 thru 0x3ffbd23 (0x9470 bytes) 2024-09-11T07:06:16.504 INFO:teuthology.orchestra.run.smithi079.stdout:1053 punch from 0x60b5f30 to 0x60bf045, (0x9115 bytes) 2024-09-11T07:06:16.504 INFO:teuthology.orchestra.run.smithi079.stdout:1054 punch from 0x6c353bf to 0x6c3fe90, (0xaad1 bytes) 2024-09-11T07:06:16.504 INFO:teuthology.orchestra.run.smithi079.stdout:1056 write 0x16bdad7 thru 0x16c177b (0x3ca5 bytes) 2024-09-11T07:06:16.507 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:16.506+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:16.542 INFO:teuthology.orchestra.run.smithi079.stdout:1057 write 0xcf4ebda thru 0xcf5b923 (0xcd4a bytes) 2024-09-11T07:06:16.560 INFO:teuthology.orchestra.run.smithi079.stdout:1058 writesame 0x2cade24 thru 0x2caecff data_size 0x6(0xedc bytes) 2024-09-11T07:06:16.568 INFO:teuthology.orchestra.run.smithi079.stdout:1059 write 0x9b7a815 thru 0x9b80978 (0x6164 bytes) 2024-09-11T07:06:16.584 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:16.585 INFO:teuthology.orchestra.run.smithi079.stdout:1061 read 0x6ae6748 thru 0x6aeedf8 (0x86b1 bytes) 2024-09-11T07:06:16.585 INFO:teuthology.orchestra.run.smithi079.stdout:1062 write 0x2cf59c9 thru 0x2cfaec9 (0x5501 bytes) 2024-09-11T07:06:16.591 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:16.586+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:16.597 INFO:teuthology.orchestra.run.smithi079.stdout:1063 clone 8 order 19 su 32768 sc 12 2024-09-11T07:06:16.641 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:16.642 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:16.655 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:16.692 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:16.692+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:16.793 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:16.790+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:16.821 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:16.821 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:16.835 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:16.915 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:06:16.923 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:16.922+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:16.994 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:16.992+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:17.009 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:17.009 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:17.011 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone7 from 0xd41b929 (overlap 0xa51fe28) to 0x949cb24 2024-09-11T07:06:17.026 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:17.095 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:17.096+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:17.196 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:17.196+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:17.198 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:17.198 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:17.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:17.257 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #6, image image_client.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent7 2024-09-11T07:06:17.297 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:17.296+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:17.339 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:17.339 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:17.354 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:17.399 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:17.398+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:17.475 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:17.475 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:17.489 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:17.501 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:17.500+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:17.590 INFO:teuthology.orchestra.run.smithi079.stdout:1064 read 0x36dc4fd thru 0x36e00e5 (0x3be9 bytes) 2024-09-11T07:06:17.591 INFO:teuthology.orchestra.run.smithi079.stdout:1067 punch from 0x3e35ec0 to 0x3e42ed4, (0xd014 bytes) 2024-09-11T07:06:17.596 INFO:teuthology.orchestra.run.smithi079.stdout:1068 read 0x40b2dd7 thru 0x40b5210 (0x243a bytes) 2024-09-11T07:06:17.597 INFO:teuthology.orchestra.run.smithi079.stdout:1069 read 0x4821896 thru 0x4826544 (0x4caf bytes) 2024-09-11T07:06:17.598 INFO:teuthology.orchestra.run.smithi079.stdout:1070 punch from 0x7aca298 to 0x7acf6e9, (0x5451 bytes) 2024-09-11T07:06:17.598 INFO:teuthology.orchestra.run.smithi079.stdout:1072 write 0x81cafbf thru 0x81d33e3 (0x8425 bytes) 2024-09-11T07:06:17.601 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:17.600+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:17.607 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:17.607 INFO:teuthology.orchestra.run.smithi079.stdout:1075 punch from 0xac04c90 to 0xac076c0, (0x2a30 bytes) 2024-09-11T07:06:17.608 INFO:teuthology.orchestra.run.smithi079.stdout:1076 punch from 0x2110f5b to 0x211e566, (0xd60b bytes) 2024-09-11T07:06:17.608 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:17.608 INFO:teuthology.orchestra.run.smithi079.stdout:1081 write 0x5f6c576 thru 0x5f7779f (0xb22a bytes) 2024-09-11T07:06:17.627 INFO:teuthology.orchestra.run.smithi079.stdout:1085 write 0xc03d75c thru 0xc048c84 (0xb529 bytes) 2024-09-11T07:06:17.639 INFO:teuthology.orchestra.run.smithi079.stdout:1086 read 0xb01eec0 thru 0xb02c270 (0xd3b1 bytes) 2024-09-11T07:06:17.639 INFO:teuthology.orchestra.run.smithi079.stdout:1088 read 0x12d6e53 thru 0x12dfab1 (0x8c5f bytes) 2024-09-11T07:06:17.639 INFO:teuthology.orchestra.run.smithi079.stdout:1089 write 0xa9618e8 thru 0xa96d30f (0xba28 bytes) 2024-09-11T07:06:17.648 INFO:teuthology.orchestra.run.smithi079.stdout:1090 punch from 0xcc98466 to 0xcc98d80, (0x91a bytes) 2024-09-11T07:06:17.648 INFO:teuthology.orchestra.run.smithi079.stdout:1091 read 0xa911a1c thru 0xa91dfeb (0xc5d0 bytes) 2024-09-11T07:06:17.649 INFO:teuthology.orchestra.run.smithi079.stdout:1092 read 0x27720b8 thru 0x277bcf4 (0x9c3d bytes) 2024-09-11T07:06:17.649 INFO:teuthology.orchestra.run.smithi079.stdout:1093 punch from 0x2ec996 to 0x2f45d4, (0x7c3e bytes) 2024-09-11T07:06:17.649 INFO:teuthology.orchestra.run.smithi079.stdout:1094 read 0x5e3cf8a thru 0x5e3e8dc (0x1953 bytes) 2024-09-11T07:06:17.650 INFO:teuthology.orchestra.run.smithi079.stdout:1096 writesame 0xaa015ba thru 0xaa04e04 data_size 0x1(0x384b bytes) 2024-09-11T07:06:17.665 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:17.665 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:17.671 INFO:teuthology.orchestra.run.smithi079.stdout:1098 write 0x2681abe thru 0x268f568 (0xdaab bytes) 2024-09-11T07:06:17.680 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:17.703 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:17.704+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:17.709 INFO:teuthology.orchestra.run.smithi079.stdout:1100 trunc from 0xd41b929 to 0x277342b 2024-09-11T07:06:17.756 INFO:teuthology.orchestra.run.smithi079.stdout:truncating to largest ever: 0xed81064 2024-09-11T07:06:17.783 INFO:teuthology.orchestra.run.smithi079.stdout:1101 trunc from 0x277342b to 0xed81064 2024-09-11T07:06:17.796 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:17.796 INFO:teuthology.orchestra.run.smithi079.stdout:1103 write 0xb01b6ef thru 0xb022064 (0x6976 bytes) 2024-09-11T07:06:17.803 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:17.804+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:17.805 INFO:teuthology.orchestra.run.smithi079.stdout:1104 write 0xa63b2f5 thru 0xa64619a (0xaea6 bytes) 2024-09-11T07:06:17.813 INFO:teuthology.orchestra.run.smithi079.stdout:1105 read 0x719ec77 thru 0x71a5ba7 (0x6f31 bytes) 2024-09-11T07:06:17.813 INFO:teuthology.orchestra.run.smithi079.stdout:1107 write 0x3a6471 thru 0x3abda5 (0x5935 bytes) 2024-09-11T07:06:17.821 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:17.821 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:17.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:17.844 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:17.844 INFO:teuthology.orchestra.run.smithi079.stdout:1110 writesame 0x9b9b715 thru 0x9b9c7ed data_size 0x1(0x10d9 bytes) 2024-09-11T07:06:17.850 INFO:teuthology.orchestra.run.smithi079.stdout:1111 read 0x2a2a146 thru 0x2a335f7 (0x94b2 bytes) 2024-09-11T07:06:17.850 INFO:teuthology.orchestra.run.smithi079.stdout:1114 read 0x7fb2cab thru 0x7fbcb92 (0x9ee8 bytes) 2024-09-11T07:06:17.850 INFO:teuthology.orchestra.run.smithi079.stdout:1115 read 0xc2a42dd thru 0xc2aca91 (0x87b5 bytes) 2024-09-11T07:06:17.850 INFO:teuthology.orchestra.run.smithi079.stdout:1117 write 0x9cada0e thru 0x9cbb345 (0xd938 bytes) 2024-09-11T07:06:17.857 INFO:teuthology.orchestra.run.smithi079.stdout:1118 write 0x219652 thru 0x228b53 (0xf502 bytes) 2024-09-11T07:06:17.880 INFO:teuthology.orchestra.run.smithi079.stdout:1119 punch from 0x53564a4 to 0x535a69e, (0x41fa bytes) 2024-09-11T07:06:17.880 INFO:teuthology.orchestra.run.smithi079.stdout:1120 write 0x9d91311 thru 0x9d9f0c1 (0xddb1 bytes) 2024-09-11T07:06:17.885 INFO:teuthology.orchestra.run.smithi079.stdout:1122 write 0x76ed6c7 thru 0x76f4ac2 (0x73fc bytes) 2024-09-11T07:06:17.891 INFO:teuthology.orchestra.run.smithi079.stdout:1123 read 0x833bd2e thru 0x8348074 (0xc347 bytes) 2024-09-11T07:06:17.891 INFO:teuthology.orchestra.run.smithi079.stdout:1124 punch from 0x2b164ed to 0x2b237c5, (0xd2d8 bytes) 2024-09-11T07:06:17.891 INFO:teuthology.orchestra.run.smithi079.stdout:1126 writesame 0x6ba72f6 thru 0x6bb0a06 data_size 0x3(0x9711 bytes) 2024-09-11T07:06:17.903 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:06:17.904 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:17.904+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:17.907 INFO:teuthology.orchestra.run.smithi079.stdout:1127 write 0xea3c8e3 thru 0xea40f85 (0x46a3 bytes) 2024-09-11T07:06:17.917 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:17.917 INFO:teuthology.orchestra.run.smithi079.stdout:1130 write 0x281d27a thru 0x2824303 (0x708a bytes) 2024-09-11T07:06:17.920 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:17.920 INFO:teuthology.orchestra.run.smithi079.stdout:1133 read 0xb11fd08 thru 0xb128382 (0x867b bytes) 2024-09-11T07:06:17.920 INFO:teuthology.orchestra.run.smithi079.stdout:1134 read 0x3b8d67e thru 0x3b90e61 (0x37e4 bytes) 2024-09-11T07:06:17.920 INFO:teuthology.orchestra.run.smithi079.stdout:1135 writesame 0x90e5c2c thru 0x90e698d data_size 0x3(0xd62 bytes) 2024-09-11T07:06:17.948 INFO:teuthology.orchestra.run.smithi079.stdout:1137 trunc from 0xed81064 to 0x28ea2e1 2024-09-11T07:06:17.971 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:17.971 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:17.980 INFO:teuthology.orchestra.run.smithi079.stdout:1139 read 0x2581c5 thru 0x25e9b6 (0x67f2 bytes) 2024-09-11T07:06:17.983 INFO:teuthology.orchestra.run.smithi079.stdout:1140 trunc from 0x28ea2e1 to 0x2b05e86 2024-09-11T07:06:17.987 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:17.997 INFO:teuthology.orchestra.run.smithi079.stdout:1141 trunc from 0x2b05e86 to 0x4d5f028 2024-09-11T07:06:18.004 INFO:teuthology.orchestra.run.smithi079.stdout:1142 read 0x4246679 thru 0x4249a16 (0x339e bytes) 2024-09-11T07:06:18.018 INFO:teuthology.orchestra.run.smithi079.stdout:1143 write 0x7f13669 thru 0x7f169ff (0x3397 bytes) 2024-09-11T07:06:18.022 INFO:teuthology.orchestra.run.smithi079.stdout:1144 write 0x3957c63 thru 0x39603d0 (0x876e bytes) 2024-09-11T07:06:18.029 INFO:teuthology.orchestra.run.smithi079.stdout:1145 read 0x7b2c430 thru 0x7b2dd0e (0x18df bytes) 2024-09-11T07:06:18.029 INFO:teuthology.orchestra.run.smithi079.stdout:1146 read 0x4c384a0 thru 0x4c3fb3b (0x769c bytes) 2024-09-11T07:06:18.029 INFO:teuthology.orchestra.run.smithi079.stdout:1147 punch from 0x64b4308 to 0x64c2c2b, (0xe923 bytes) 2024-09-11T07:06:18.029 INFO:teuthology.orchestra.run.smithi079.stdout:1149 writesame 0x1af0573 thru 0x1afaba7 data_size 0xd(0xa635 bytes) 2024-09-11T07:06:18.031 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:18.030+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:18.042 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.062 INFO:teuthology.orchestra.run.smithi079.stdout:1151 write 0xd306ff4 thru 0xd30aeb9 (0x3ec6 bytes) 2024-09-11T07:06:18.069 INFO:teuthology.orchestra.run.smithi079.stdout:1152 read 0x6dff303 thru 0x6e007c3 (0x14c1 bytes) 2024-09-11T07:06:18.069 INFO:teuthology.orchestra.run.smithi079.stdout:1153 punch from 0x1280681 to 0x12826cd, (0x204c bytes) 2024-09-11T07:06:18.069 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.069 INFO:teuthology.orchestra.run.smithi079.stdout:1155 write 0x837b7c5 thru 0x8386cf0 (0xb52c bytes) 2024-09-11T07:06:18.074 INFO:teuthology.orchestra.run.smithi079.stdout:1156 write 0x67931e5 thru 0x679377b (0x597 bytes) 2024-09-11T07:06:18.078 INFO:teuthology.orchestra.run.smithi079.stdout:1157 punch from 0x2548289 to 0x2556103, (0xde7a bytes) 2024-09-11T07:06:18.078 INFO:teuthology.orchestra.run.smithi079.stdout:1158 punch from 0x8c69ccf to 0x8c7712e, (0xd45f bytes) 2024-09-11T07:06:18.078 INFO:teuthology.orchestra.run.smithi079.stdout:1159 write 0x5a86d28 thru 0x5a8798e (0xc67 bytes) 2024-09-11T07:06:18.081 INFO:teuthology.orchestra.run.smithi079.stdout:1160 punch from 0x6cf3b9b to 0x6cf9101, (0x5566 bytes) 2024-09-11T07:06:18.082 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.082 INFO:teuthology.orchestra.run.smithi079.stdout:1163 write 0x76ea9e2 thru 0x76f1f37 (0x7556 bytes) 2024-09-11T07:06:18.086 INFO:teuthology.orchestra.run.smithi079.stdout:1164 read 0x7318eee thru 0x7326dda (0xdeed bytes) 2024-09-11T07:06:18.086 INFO:teuthology.orchestra.run.smithi079.stdout:1167 read 0x7a6ba98 thru 0x7a72da3 (0x730c bytes) 2024-09-11T07:06:18.089 INFO:teuthology.orchestra.run.smithi079.stdout:1168 trunc from 0xd30aeba to 0xe717360 2024-09-11T07:06:18.096 INFO:teuthology.orchestra.run.smithi079.stdout:1169 writesame 0x9973d20 thru 0x997fcc3 data_size 0x6e(0xbfa4 bytes) 2024-09-11T07:06:18.103 INFO:teuthology.orchestra.run.smithi079.stdout:1170 punch from 0xb1ec81a to 0xb1ef3aa, (0x2b90 bytes) 2024-09-11T07:06:18.106 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:18.102+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:18.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:18.121 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:18.121 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:18.134 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:18.134 INFO:teuthology.orchestra.run.smithi079.stdout:1171 trunc from 0xe717360 to 0x1c57e8e 2024-09-11T07:06:18.206 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:18.208+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:18.214 INFO:teuthology.orchestra.run.smithi079.stdout:1172 writesame 0xeece31 thru 0xef5259 data_size 0x1(0x8429 bytes) 2024-09-11T07:06:18.246 INFO:teuthology.orchestra.run.smithi079.stdout:1174 trunc from 0x1c57e8e to 0xb0b5642 2024-09-11T07:06:18.254 INFO:teuthology.orchestra.run.smithi079.stdout:1175 write 0x98a3135 thru 0x98a3e3b (0xd07 bytes) 2024-09-11T07:06:18.259 INFO:teuthology.orchestra.run.smithi079.stdout:1176 read 0xbd3aae thru 0xbd525c (0x17af bytes) 2024-09-11T07:06:18.259 INFO:teuthology.orchestra.run.smithi079.stdout:1177 write 0xaefba97 thru 0xaf0a615 (0xeb7f bytes) 2024-09-11T07:06:18.267 INFO:teuthology.orchestra.run.smithi079.stdout:1180 write 0x5603660 thru 0x5605511 (0x1eb2 bytes) 2024-09-11T07:06:18.271 INFO:teuthology.orchestra.run.smithi079.stdout:1181 read 0x8336337 thru 0x833933c (0x3006 bytes) 2024-09-11T07:06:18.280 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:18.280 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:18.281 INFO:teuthology.orchestra.run.smithi079.stdout:1182 write 0xcedae23 thru 0xcee6fc4 (0xc1a2 bytes) 2024-09-11T07:06:18.288 INFO:teuthology.orchestra.run.smithi079.stdout:1183 trunc from 0xcee6fc5 to 0xb7273c4 2024-09-11T07:06:18.297 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:18.298 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:18.303 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:18.309 INFO:teuthology.orchestra.run.smithi079.stdout:1184 trunc from 0xb7273c4 to 0xe36d458 2024-09-11T07:06:18.309 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:18.308+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:18.315 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:18.316 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:18.321 INFO:teuthology.orchestra.run.smithi079.stdout:1185 read 0x14179c8 thru 0x1422952 (0xaf8b bytes) 2024-09-11T07:06:18.323 INFO:teuthology.orchestra.run.smithi079.stdout:1186 read 0x7dcc875 thru 0x7dcdefc (0x1688 bytes) 2024-09-11T07:06:18.323 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.323 INFO:teuthology.orchestra.run.smithi079.stdout:1189 write 0x97f56ed thru 0x98042fd (0xec11 bytes) 2024-09-11T07:06:18.333 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:18.334 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:18.335 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.335 INFO:teuthology.orchestra.run.smithi079.stdout:1195 read 0x9947d98 thru 0x99556d4 (0xd93d bytes) 2024-09-11T07:06:18.335 INFO:teuthology.orchestra.run.smithi079.stdout:1197 punch from 0x3c5dd28 to 0x3c6b670, (0xd948 bytes) 2024-09-11T07:06:18.336 INFO:teuthology.orchestra.run.smithi079.stdout:1198 write 0x2566799 thru 0x256a6f5 (0x3f5d bytes) 2024-09-11T07:06:18.342 INFO:teuthology.orchestra.run.smithi079.stdout:1199 trunc from 0xe36d458 to 0xe9c632d 2024-09-11T07:06:18.350 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:18.351 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:18.354 INFO:teuthology.orchestra.run.smithi079.stdout:1200 write 0x6584c3f thru 0x658bcd1 (0x7093 bytes) 2024-09-11T07:06:18.363 INFO:teuthology.orchestra.run.smithi079.stdout:1201 write 0x5814285 thru 0x5820288 (0xc004 bytes) 2024-09-11T07:06:18.372 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:18.372 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:18.377 INFO:teuthology.orchestra.run.smithi079.stdout:1204 write 0xca430fb thru 0xca4aadb (0x79e1 bytes) 2024-09-11T07:06:18.385 INFO:teuthology.orchestra.run.smithi079.stdout:1205 write 0xd2095e4 thru 0xd20e49f (0x4ebc bytes) 2024-09-11T07:06:18.394 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:18.403 INFO:teuthology.orchestra.run.smithi079.stdout:1208 trunc from 0xe9c632d to 0x72ef39c 2024-09-11T07:06:18.409 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:18.406+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:18.417 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:18.417 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:18.426 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.426 INFO:teuthology.orchestra.run.smithi079.stdout:1211 writesame 0x4a467c6 thru 0x4a4c742 data_size 0x1(0x5f7d bytes) 2024-09-11T07:06:18.430 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:18.430 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:18.430 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:18.439 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:18.439 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:18.441 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.442 INFO:teuthology.orchestra.run.smithi079.stdout:1214 read 0x5e891b thru 0x5f4f54 (0xc63a bytes) 2024-09-11T07:06:18.443 INFO:teuthology.orchestra.run.smithi079.stdout:1215 write 0x5ebf1f3 thru 0x5ec1a5b (0x2869 bytes) 2024-09-11T07:06:18.449 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:18.451 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.451 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.463 INFO:teuthology.orchestra.run.smithi079.stdout:1219 writesame 0x76e69fe thru 0x76ea66e data_size 0x1(0x3c71 bytes) 2024-09-11T07:06:18.463 INFO:teuthology.orchestra.run.smithi079.stdout:1220 writesame 0x369a96f thru 0x369b42d data_size 0x3(0xabf bytes) 2024-09-11T07:06:18.474 INFO:teuthology.orchestra.run.smithi079.stdout:1221 trunc from 0x76ea66f to 0x519da51 2024-09-11T07:06:18.499 INFO:teuthology.orchestra.run.smithi079.stdout:1222 write 0x94a0ff thru 0x94cbfa (0x2afc bytes) 2024-09-11T07:06:18.509 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:18.506+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:18.515 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.542 INFO:teuthology.orchestra.run.smithi079.stdout:1225 write 0xd6d58f1 thru 0xd6d726f (0x197f bytes) 2024-09-11T07:06:18.549 INFO:teuthology.orchestra.run.smithi079.stdout:1227 write 0x2d45a25 thru 0x2d461bf (0x79b bytes) 2024-09-11T07:06:18.555 INFO:teuthology.orchestra.run.smithi079.stdout:1229 read 0x5ca28db thru 0x5cab898 (0x8fbe bytes) 2024-09-11T07:06:18.555 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.555 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.555 INFO:teuthology.orchestra.run.smithi079.stdout:1234 write 0x156c04b thru 0x1573f03 (0x7eb9 bytes) 2024-09-11T07:06:18.574 INFO:teuthology.orchestra.run.smithi079.stdout:1236 write 0xacaf0c1 thru 0xacb1800 (0x2740 bytes) 2024-09-11T07:06:18.581 INFO:teuthology.orchestra.run.smithi079.stdout:1237 writesame 0x5a3b3c7 thru 0x5a47e5c data_size 0x1(0xca96 bytes) 2024-09-11T07:06:18.583 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6982 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671210+0000", 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9138113209999998, 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049279088999999998, 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6982 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671210+0000", 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671210+0000", 2024-09-11T07:06:18.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671211+0000", 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9500000000000003e-07 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671213+0000", 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.627e-06 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671220+0000", 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9650000000000002e-06 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671225+0000", 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0989999999999998e-06 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720398+0000", 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049172398999999999 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720435+0000", 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6906000000000002e-05 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720489+0000", 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4598000000000001e-05 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.588 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.913790702, 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:06:18.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:06:18.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9137785620000001, 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:06:18.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9131276110000002, 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.598 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:18.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9130707149999999, 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:06:18.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9130436809999996, 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:06:18.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:06:18.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.910499819, 2024-09-11T07:06:18.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:06:18.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9104777110000004, 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.616 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:18.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.620 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9104580960000002, 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:06:18.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9104351910000004, 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.625 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:06:18.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:06:18.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:06:18.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:06:18.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:06:18.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.91005643, 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.630 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:06:18.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9100249280000003, 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:06:18.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:06:18.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9095076530000004, 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:06:18.639 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:06:18.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.643 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9094835239999997, 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.644 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:06:18.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:06:18.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9094701980000002, 2024-09-11T07:06:18.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:06:18.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.652 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9090502699999998, 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.653 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.658 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.658 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:06:18.658 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9090228610000004, 2024-09-11T07:06:18.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:06:18.658 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.658 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.658 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.658 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.658 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.658 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:06:18.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:06:18.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7106 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5144576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676748+0000", 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.908273028, 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049281829999999999, 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7106 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.663 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676748+0000", 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676748+0000", 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676749+0000", 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1500000000000004e-07 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676753+0000", 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5760000000000002e-06 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676762+0000", 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9479999999999997e-06 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676768+0000", 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7039999999999997e-06 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725892+0000", 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049124088000000003 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725962+0000", 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9930000000000003e-05 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726030+0000", 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7968999999999999e-05 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.9082438570000004, 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.667 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:06:18.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.903143729, 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:06:18.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:18.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:18.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:18.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:18.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:06:18.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:06:18.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.676 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:18.676 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:18.676 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:18.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:18.678 INFO:teuthology.orchestra.run.smithi079.stdout:1238 write 0x98cadd4 thru 0x98cf664 (0x4891 bytes) 2024-09-11T07:06:18.678 INFO:teuthology.orchestra.run.smithi079.stdout:1239 write 0xe5c645e thru 0xe5ccf0e (0x6ab1 bytes) 2024-09-11T07:06:18.678 INFO:teuthology.orchestra.run.smithi079.stdout:1240 trunc from 0xe5ccf0f to 0xd17aa42 2024-09-11T07:06:18.679 INFO:teuthology.orchestra.run.smithi079.stdout:1241 read 0xa170c2e thru 0xa176f33 (0x6306 bytes) 2024-09-11T07:06:18.679 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:18.674+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:18.685 INFO:teuthology.orchestra.run.smithi079.stdout:1243 write 0xe3eb1ca thru 0xe3f5697 (0xa4ce bytes) 2024-09-11T07:06:18.695 INFO:teuthology.orchestra.run.smithi079.stdout:1244 read 0x26ae9d5 thru 0x26bb86b (0xce97 bytes) 2024-09-11T07:06:18.696 INFO:teuthology.orchestra.run.smithi079.stdout:1245 read 0x77c1386 thru 0x77cf164 (0xdddf bytes) 2024-09-11T07:06:18.696 INFO:teuthology.orchestra.run.smithi079.stdout:1246 write 0x4ef8d36 thru 0x4f01832 (0x8afd bytes) 2024-09-11T07:06:18.705 INFO:teuthology.orchestra.run.smithi079.stdout:1247 punch from 0x1efeb73 to 0x1f0ab36, (0xbfc3 bytes) 2024-09-11T07:06:18.706 INFO:teuthology.orchestra.run.smithi079.stdout:1248 read 0x8ac5329 thru 0x8ad28e7 (0xd5bf bytes) 2024-09-11T07:06:18.714 INFO:teuthology.orchestra.run.smithi079.stdout:1249 trunc from 0xe3f5698 to 0xb05b8ad 2024-09-11T07:06:18.739 INFO:teuthology.orchestra.run.smithi079.stdout:1250 writesame 0x6ed4c07 thru 0x6edfa09 data_size 0x1f(0xae03 bytes) 2024-09-11T07:06:18.749 INFO:teuthology.orchestra.run.smithi079.stdout:1252 write 0x8b4b8a5 thru 0x8b56d75 (0xb4d1 bytes) 2024-09-11T07:06:18.758 INFO:teuthology.orchestra.run.smithi079.stdout:1256 read 0x261d36d thru 0x2623a22 (0x66b6 bytes) 2024-09-11T07:06:18.773 INFO:teuthology.orchestra.run.smithi079.stdout:1257 trunc from 0xb05b8ad to 0x45ec5be 2024-09-11T07:06:18.778 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:18.774+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:18.803 INFO:teuthology.orchestra.run.smithi079.stdout:1258 punch from 0x1ece1b to 0x1fb327, (0xe50c bytes) 2024-09-11T07:06:18.803 INFO:teuthology.orchestra.run.smithi079.stdout:1259 write 0x914ec0 thru 0x9154d4 (0x615 bytes) 2024-09-11T07:06:18.822 INFO:teuthology.orchestra.run.smithi079.stdout:1260 write 0x2874a68 thru 0x28759fe (0xf97 bytes) 2024-09-11T07:06:18.822 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:18.823 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:18.823 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:18.829 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:18.829 INFO:teuthology.orchestra.run.smithi079.stdout:1262 writesame 0x3f00f66 thru 0x3f0f79a data_size 0xf(0xe835 bytes) 2024-09-11T07:06:18.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:18.840 INFO:teuthology.orchestra.run.smithi079.stdout:1263 flatten 2024-09-11T07:06:18.879 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:18.874+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:18.979 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:18.980+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:18.991 INFO:teuthology.orchestra.run.smithi079.stdout:1264 read 0x61d3de thru 0x62471d (0x7340 bytes) 2024-09-11T07:06:19.001 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:19.001 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:19.002 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:19.002 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:19.003 INFO:teuthology.orchestra.run.smithi079.stdout:1265 writesame 0x8084372 thru 0x8086ab7 data_size 0xb(0x2746 bytes) 2024-09-11T07:06:19.014 INFO:teuthology.orchestra.run.smithi079.stdout:1266 writesame 0xa65edfc thru 0xa665ff0 data_size 0x1(0x71f5 bytes) 2024-09-11T07:06:19.014 INFO:teuthology.orchestra.run.smithi079.stdout:1267 read 0x3a794e8 thru 0x3a80aa0 (0x75b9 bytes) 2024-09-11T07:06:19.014 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:19.014 INFO:teuthology.orchestra.run.smithi079.stdout:1273 read 0x78fa32a thru 0x78fe64a (0x4321 bytes) 2024-09-11T07:06:19.014 INFO:teuthology.orchestra.run.smithi079.stdout:1275 read 0x64ddd5d thru 0x64e43ec (0x6690 bytes) 2024-09-11T07:06:19.014 INFO:teuthology.orchestra.run.smithi079.stdout:1277 write 0x8cac3 thru 0x971a2 (0xa6e0 bytes) 2024-09-11T07:06:19.022 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:19.027 INFO:teuthology.orchestra.run.smithi079.stdout:1279 writesame 0xc329523 thru 0xc335cb8 data_size 0x1(0xc796 bytes) 2024-09-11T07:06:19.027 INFO:teuthology.orchestra.run.smithi079.stdout:1280 read 0x7447b6e thru 0x744de21 (0x62b4 bytes) 2024-09-11T07:06:19.027 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:19.028 INFO:teuthology.orchestra.run.smithi079.stdout:1282 writesame 0xaedb4a5 thru 0xaee032a data_size 0x17(0x4e86 bytes) 2024-09-11T07:06:19.031 INFO:teuthology.orchestra.run.smithi079.stdout:1283 punch from 0x260000e to 0x2601c14, (0x1c06 bytes) 2024-09-11T07:06:19.032 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:19.032 INFO:teuthology.orchestra.run.smithi079.stdout:1287 write 0x8167c7b thru 0x816df62 (0x62e8 bytes) 2024-09-11T07:06:19.043 INFO:teuthology.orchestra.run.smithi079.stdout:1288 writesame 0xcef618d thru 0xcefabd0 data_size 0xe(0x4a44 bytes) 2024-09-11T07:06:19.043 INFO:teuthology.orchestra.run.smithi079.stdout:1289 write 0x99b1d51 thru 0x99b6aa7 (0x4d57 bytes) 2024-09-11T07:06:19.058 INFO:teuthology.orchestra.run.smithi079.stdout:1290 trunc from 0xcefabd1 to 0x570960d 2024-09-11T07:06:19.074 INFO:teuthology.orchestra.run.smithi079.stdout:1291 punch from 0xcec4be to 0xcf9102, (0xcc44 bytes) 2024-09-11T07:06:19.075 INFO:teuthology.orchestra.run.smithi079.stdout:1292 punch from 0x4005224 to 0x4005d96, (0xb72 bytes) 2024-09-11T07:06:19.075 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:19.080 INFO:teuthology.orchestra.run.smithi079.stdout:1294 trunc from 0x570960d to 0x8fad06c 2024-09-11T07:06:19.080 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:19.080+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:19.089 INFO:teuthology.orchestra.run.smithi079.stdout:1295 read 0x4a4b2ef thru 0x4a4ec11 (0x3923 bytes) 2024-09-11T07:06:19.109 INFO:teuthology.orchestra.run.smithi079.stdout:1297 write 0xd483ca4 thru 0xd48cdb0 (0x910d bytes) 2024-09-11T07:06:19.118 INFO:teuthology.orchestra.run.smithi079.stdout:1299 write 0x25b471b thru 0x25bd20f (0x8af5 bytes) 2024-09-11T07:06:19.125 INFO:teuthology.orchestra.run.smithi079.stdout:1302 write 0xb9d5053 thru 0xb9df4e3 (0xa491 bytes) 2024-09-11T07:06:19.133 INFO:teuthology.orchestra.run.smithi079.stdout:1303 trunc from 0xd48cdb1 to 0xce6f9aa 2024-09-11T07:06:19.152 INFO:teuthology.orchestra.run.smithi079.stdout:1304 read 0x90f095e thru 0x90f142a (0xacd bytes) 2024-09-11T07:06:19.152 INFO:teuthology.orchestra.run.smithi079.stdout:1305 read 0x5fc9dfe thru 0x5fcdb03 (0x3d06 bytes) 2024-09-11T07:06:19.152 INFO:teuthology.orchestra.run.smithi079.stdout:1306 writesame 0xc3148eb thru 0xc315ade data_size 0x6(0x11f4 bytes) 2024-09-11T07:06:19.157 INFO:teuthology.orchestra.run.smithi079.stdout:1307 writesame 0x921c202 thru 0x921ffca data_size 0x1(0x3dc9 bytes) 2024-09-11T07:06:19.166 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9385 3.19 3:9a974888:::rbd_data.11612823e096.0000000000000022:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.166 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.447814+0000", 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.7178505160000004, 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016670016999999999, 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9385 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447814+0000", 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447814+0000", 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447817+0000", 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2499999999999998e-06 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447830+0000", 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3134e-05 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447862+0000", 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2153000000000002e-05 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447879+0000", 2024-09-11T07:06:19.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6549999999999999e-05 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447951+0000", 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2829000000000004e-05 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.448067+0000", 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011510000000000001 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.450627+0000", 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025605889999999998 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464373+0000", 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013745754000000001 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464409+0000", 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5676999999999997e-05 2024-09-11T07:06:19.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464450+0000", 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1436000000000001e-05 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464484+0000", 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3544999999999998e-05 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9612 3.0 3:0669ea79:::rbd_data.11614fc4d54f.0000000000000000:6 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.614895+0000", 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5507692750000004, 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0083823030000000007, 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9612 2024-09-11T07:06:19.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614895+0000", 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614895+0000", 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614896+0000", 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1500000000000003e-07 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614900+0000", 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4279999999999998e-06 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614912+0000", 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1946999999999999e-05 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614921+0000", 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6670000000000002e-06 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.623170+0000", 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082489989999999999 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.623218+0000", 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8126e-05 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.623277+0000", 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9221000000000001e-05 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9956 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5372425119999997, 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0084527600000000001, 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.177 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9956 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:19.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628424+0000", 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0930000000000001e-06 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628431+0000", 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8990000000000004e-06 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628436+0000", 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.853e-06 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636716+0000", 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082805110000000008 2024-09-11T07:06:19.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636798+0000", 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1185000000000003e-05 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636874+0000", 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6693000000000006e-05 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9958 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 622592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.537221121, 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086422029999999993, 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9958 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.182 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:19.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.03e-07 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628446+0000", 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2520000000000002e-06 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628452+0000", 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4280000000000001e-06 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628458+0000", 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6829999999999996e-06 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636908+0000", 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0084505799999999992 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636975+0000", 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7160000000000001e-05 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637085+0000", 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109697 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9989 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 212992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5371794169999999, 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087728470000000003, 2024-09-11T07:06:19.186 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9989 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.77e-07 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628488+0000", 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8559999999999998e-06 2024-09-11T07:06:19.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628494+0000", 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1120000000000001e-06 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628501+0000", 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7499999999999997e-06 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637117+0000", 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086164710000000005 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637186+0000", 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8487999999999999e-05 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637258+0000", 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1792999999999995e-05 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.190 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9991 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 344064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628556+0000", 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5371079630000004, 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088468039999999998, 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.191 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9991 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628556+0000", 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628556+0000", 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628557+0000", 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8899999999999999e-07 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628564+0000", 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2819999999999999e-06 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628571+0000", 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6969999999999996e-06 2024-09-11T07:06:19.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628576+0000", 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3059999999999997e-06 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637293+0000", 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087169269999999993 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637348+0000", 2024-09-11T07:06:19.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5408000000000002e-05 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637403+0000", 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4494999999999999e-05 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9992 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628583+0000", 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5370808450000002, 2024-09-11T07:06:19.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0083642779999999993, 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9992 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628583+0000", 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628583+0000", 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628584+0000", 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8299999999999997e-07 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628586+0000", 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1110000000000002e-06 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628592+0000", 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0009999999999998e-06 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628597+0000", 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0220000000000004e-06 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636732+0000", 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081352999999999998 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636845+0000", 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113058 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636948+0000", 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102303 2024-09-11T07:06:19.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9993 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5370592350000001, 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089343319999999997, 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9993 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:19.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5700000000000002e-07 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628608+0000", 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4119999999999999e-06 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628614+0000", 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.251e-06 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628619+0000", 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8740000000000003e-06 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637425+0000", 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088061509999999999 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637482+0000", 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6805000000000002e-05 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637539+0000", 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7281999999999998e-05 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9994 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 606208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5370381120000003, 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085150250000000007, 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9994 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9200000000000002e-07 2024-09-11T07:06:19.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628628+0000", 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628635+0000", 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1299999999999998e-06 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628639+0000", 2024-09-11T07:06:19.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9130000000000002e-06 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636991+0000", 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0083513919999999991 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637065+0000", 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4510000000000003e-05 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637141+0000", 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650999999999998e-05 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9995 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 606208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5370180969999998, 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090897089999999996, 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9995 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9499999999999998e-07 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628648+0000", 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9920000000000002e-06 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628654+0000", 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628659+0000", 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7199999999999997e-06 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637562+0000", 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089024039999999992 2024-09-11T07:06:19.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637620+0000", 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8319999999999997e-05 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637736+0000", 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011581799999999999 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10032 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 147456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628666+0000", 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5369977419999996, 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087436330000000007, 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10032 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628666+0000", 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628666+0000", 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628667+0000", 2024-09-11T07:06:19.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628669+0000", 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2079999999999999e-06 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628675+0000", 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4999999999999996e-06 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628681+0000", 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9680000000000003e-06 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637191+0000", 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085096589999999993 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637311+0000", 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119571 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637410+0000", 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9309999999999996e-05 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10033 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 147456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628689+0000", 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5369749449999999, 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092145349999999994, 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10033 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628689+0000", 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628689+0000", 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628690+0000", 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2e-07 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628692+0000", 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4380000000000002e-06 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628699+0000", 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.567e-06 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628704+0000", 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5459999999999999e-06 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637760+0000", 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090558700000000006 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637811+0000", 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1137999999999997e-05 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637904+0000", 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2555999999999999e-05 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10034 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 278528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5369522069999997, 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088786860000000002, 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10034 2024-09-11T07:06:19.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4099999999999999e-07 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628715+0000", 2024-09-11T07:06:19.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.447e-06 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628721+0000", 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5549999999999999e-06 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628726+0000", 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7650000000000001e-06 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637452+0000", 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087259980000000004 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637522+0000", 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0326000000000004e-05 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637591+0000", 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8153999999999998e-05 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10035 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 278528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628733+0000", 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5369306109999998, 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093551009999999993, 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.228 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10035 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628733+0000", 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628733+0000", 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628734+0000", 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1199999999999998e-07 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628736+0000", 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2680000000000001e-06 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628745+0000", 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2869999999999993e-06 2024-09-11T07:06:19.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628751+0000", 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7019999999999998e-06 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637928+0000", 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0091772820000000001 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638024+0000", 2024-09-11T07:06:19.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5546999999999998e-05 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638089+0000", 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4603000000000005e-05 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10036 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5368892800000005, 2024-09-11T07:06:19.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008972275, 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10036 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:19.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9299999999999998e-07 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628779+0000", 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2569999999999999e-06 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628787+0000", 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3480000000000004e-06 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628793+0000", 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6949999999999997e-06 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637619+0000", 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088259429999999993 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637681+0000", 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2838999999999999e-05 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637747+0000", 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5599999999999995e-05 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10037 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628801+0000", 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5368626929999998, 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094195819999999993, 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.237 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10037 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628801+0000", 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628801+0000", 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628802+0000", 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6599999999999996e-07 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628805+0000", 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7539999999999998e-06 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628811+0000", 2024-09-11T07:06:19.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7549999999999997e-06 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628817+0000", 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999997e-06 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638121+0000", 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093040369999999994 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638172+0000", 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0705999999999999e-05 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638221+0000", 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8804000000000002e-05 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10038 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 540672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628827+0000", 2024-09-11T07:06:19.241 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5368366199999999, 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092094519999999999, 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10038 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628827+0000", 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628827+0000", 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628828+0000", 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628830+0000", 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3659999999999999e-06 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628837+0000", 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7290000000000003e-06 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628842+0000", 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2580000000000003e-06 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637797+0000", 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089549380000000008 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637926+0000", 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012899999999999999 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638037+0000", 2024-09-11T07:06:19.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000110747 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10039 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 540672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628850+0000", 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5368139589999998, 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095082959999999994, 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10039 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628850+0000", 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628850+0000", 2024-09-11T07:06:19.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628851+0000", 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628859+0000", 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8460000000000008e-06 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628867+0000", 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1009999999999992e-06 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628873+0000", 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8159999999999999e-06 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638242+0000", 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093698649999999998 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638308+0000", 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5235999999999997e-05 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638358+0000", 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0797999999999997e-05 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10040 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 671744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.250 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628882+0000", 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5367821790000002, 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096786370000000004, 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10040 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628882+0000", 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628882+0000", 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628883+0000", 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-07 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628885+0000", 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3429999999999998e-06 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628892+0000", 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7830000000000001e-06 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628897+0000", 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2979999999999999e-06 2024-09-11T07:06:19.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638383+0000", 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094860110000000008 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638468+0000", 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4596000000000001e-05 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638561+0000", 2024-09-11T07:06:19.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2885000000000003e-05 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10041 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 671744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.5367585510000001, 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093034399999999996, 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:19.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10041 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:19.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0400000000000002e-07 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628908+0000", 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.176e-06 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628915+0000", 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5359999999999998e-06 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628920+0000", 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7860000000000002e-06 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638067+0000", 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0091466810000000003 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638137+0000", 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0236999999999999e-05 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638209+0000", 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1619999999999995e-05 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.259 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:19.261 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:19.262 INFO:teuthology.orchestra.run.smithi079.stdout:1308 trunc from 0xce6f9aa to 0x68ab3e3 2024-09-11T07:06:19.262 INFO:teuthology.orchestra.run.smithi079.stdout:1310 writesame 0x5bd88da thru 0x5be0e1f data_size 0x7(0x8546 bytes) 2024-09-11T07:06:19.262 INFO:teuthology.orchestra.run.smithi079.stdout:1312 punch from 0x3a3ee29 to 0x3a4b0eb, (0xc2c2 bytes) 2024-09-11T07:06:19.262 INFO:teuthology.orchestra.run.smithi079.stdout:1313 read 0x28713d5 thru 0x287a327 (0x8f53 bytes) 2024-09-11T07:06:19.262 INFO:teuthology.orchestra.run.smithi079.stdout:1315 writesame 0x4f75903 thru 0x4f7d234 data_size 0x3(0x7932 bytes) 2024-09-11T07:06:19.262 INFO:teuthology.orchestra.run.smithi079.stdout:1316 punch from 0x65fdd0b to 0x660c6ba, (0xe9af bytes) 2024-09-11T07:06:19.263 INFO:teuthology.orchestra.run.smithi079.stdout:1317 punch from 0x60f7d6f to 0x60fe77a, (0x6a0b bytes) 2024-09-11T07:06:19.263 INFO:teuthology.orchestra.run.smithi079.stdout:1318 read 0x46ebf45 thru 0x46f3691 (0x774d bytes) 2024-09-11T07:06:19.263 INFO:teuthology.orchestra.run.smithi079.stdout:1320 punch from 0x182f55 to 0x18dabf, (0xab6a bytes) 2024-09-11T07:06:19.263 INFO:teuthology.orchestra.run.smithi079.stdout:1321 trunc from 0x68ab3e3 to 0xb2a384a 2024-09-11T07:06:19.263 INFO:teuthology.orchestra.run.smithi079.stdout:1324 write 0xa9bea0 thru 0xa9ef91 (0x30f2 bytes) 2024-09-11T07:06:19.263 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:19.258+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:19.268 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:19.268 INFO:teuthology.orchestra.run.smithi079.stdout:1329 write 0xa2113f2 thru 0xa220afc (0xf70b bytes) 2024-09-11T07:06:19.297 INFO:teuthology.orchestra.run.smithi079.stdout:1330 write 0xc7aca53 thru 0xc7b6f2c (0xa4da bytes) 2024-09-11T07:06:19.305 INFO:teuthology.orchestra.run.smithi079.stdout:1333 read 0x79890ab thru 0x7997ad4 (0xea2a bytes) 2024-09-11T07:06:19.320 INFO:teuthology.orchestra.run.smithi079.stdout:1334 trunc from 0xc7b6f2d to 0x41b954c 2024-09-11T07:06:19.348 INFO:teuthology.orchestra.run.smithi079.stdout:1335 read 0x122e35c thru 0x12344f8 (0x619d bytes) 2024-09-11T07:06:19.355 INFO:teuthology.orchestra.run.smithi079.stdout:1336 trunc from 0x41b954c to 0x95bdcda 2024-09-11T07:06:19.361 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:19.360+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:19.369 INFO:teuthology.orchestra.run.smithi079.stdout:1337 punch from 0x6ba504e to 0x6bab416, (0x63c8 bytes) 2024-09-11T07:06:19.370 INFO:teuthology.orchestra.run.smithi079.stdout:1338 read 0x7b8375b thru 0x7b89743 (0x5fe9 bytes) 2024-09-11T07:06:19.370 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:19.370 INFO:teuthology.orchestra.run.smithi079.stdout:1341 write 0x5a501 thru 0x6a2a4 (0xfda4 bytes) 2024-09-11T07:06:19.382 INFO:teuthology.orchestra.run.smithi079.stdout:1343 read 0x5b47655 thru 0x5b5034c (0x8cf8 bytes) 2024-09-11T07:06:19.382 INFO:teuthology.orchestra.run.smithi079.stdout:1344 punch from 0x56e47d6 to 0x56ea896, (0x60c0 bytes) 2024-09-11T07:06:19.382 INFO:teuthology.orchestra.run.smithi079.stdout:1346 write 0x2c5a355 thru 0x2c66237 (0xbee3 bytes) 2024-09-11T07:06:19.390 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:19.390 INFO:teuthology.orchestra.run.smithi079.stdout:1350 read 0x31f1a1c thru 0x32005e2 (0xebc7 bytes) 2024-09-11T07:06:19.391 INFO:teuthology.orchestra.run.smithi079.stdout:1354 clone 9 order 20 su 524288 sc 9 2024-09-11T07:06:19.401 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:19.401 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:19.401 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:19.415 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:19.503 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:19.504+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:19.563 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:19.562+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:19.580 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:19.580 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:19.595 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:19.687 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:19.688+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:19.766 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:19.766 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4232.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-11T07:06:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 30.610991408, 2024-09-11T07:06:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021932660000000001, 2024-09-11T07:06:19.767 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0200000000000002e-07 2024-09-11T07:06:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154680+0000", 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4540000000000001e-06 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154695+0000", 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.518e-05 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154706+0000", 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0572e-05 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154769+0000", 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3341000000000002e-05 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154796+0000", 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6897999999999999e-05 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.156813+0000", 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002016856 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.156865+0000", 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2463000000000002e-05 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.772 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1260 3.0 e26/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 26'24, mlcod=26'22)", 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.887992+0000", 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.877670984, 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023221700000000001, 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887992+0000", 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887992+0000", 2024-09-11T07:06:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887994+0000", 2024-09-11T07:06:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.438e-06 2024-09-11T07:06:19.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888005+0000", 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1136e-05 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888033+0000", 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8428999999999998e-05 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888047+0000", 2024-09-11T07:06:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4117999999999999e-05 2024-09-11T07:06:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888172+0000", 2024-09-11T07:06:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012466500000000001 2024-09-11T07:06:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888239+0000", 2024-09-11T07:06:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7058999999999996e-05 2024-09-11T07:06:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890254+0000", 2024-09-11T07:06:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020145060000000001 2024-09-11T07:06:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890315+0000", 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0819000000000002e-05 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1263 3.0 e26/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 26'25, mlcod=26'22)", 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.876414072999999, 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002862819, 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:19.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889250+0000", 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4e-07 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889259+0000", 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3129999999999999e-06 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889289+0000", 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0975000000000001e-05 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889302+0000", 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2699e-05 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889815+0000", 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051256399999999997 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889850+0000", 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5583000000000001e-05 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892013+0000", 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021629449999999999 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892112+0000", 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8800000000000003e-05 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.782 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1267 3.0 e26/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 26'26, mlcod=26'22)", 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.875840483999999, 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045762700000000003, 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.783 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889824+0000", 2024-09-11T07:06:19.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-06 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889834+0000", 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9480000000000003e-06 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889852+0000", 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8017e-05 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889863+0000", 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0992000000000001e-05 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890364+0000", 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050119400000000005 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890395+0000", 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.112e-05 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894342+0000", 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039468189999999998 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894399+0000", 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6929999999999999e-05 2024-09-11T07:06:19.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1324 3.0 e26/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 26'27, mlcod=26'25)", 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.010797+0000", 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.754866629, 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023525120000000002, 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010797+0000", 2024-09-11T07:06:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010797+0000", 2024-09-11T07:06:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010798+0000", 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.545e-06 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010827+0000", 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8345000000000001e-05 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010852+0000", 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5613e-05 2024-09-11T07:06:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010864+0000", 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1362999999999999e-05 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011147+0000", 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028374999999999999 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011174+0000", 2024-09-11T07:06:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6676999999999999e-05 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013092+0000", 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019180480000000001 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013149+0000", 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7170999999999999e-05 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1409 3.0 e26/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 26'35, mlcod=26'33)", 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.146979+0000", 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.618684276, 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00185703, 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146979+0000", 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146979+0000", 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146980+0000", 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4419999999999999e-06 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146990+0000", 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6439999999999995e-06 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147013+0000", 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3368000000000001e-05 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147023+0000", 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8830000000000001e-06 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147227+0000", 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000203857 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147248+0000", 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0767999999999998e-05 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.148790+0000", 2024-09-11T07:06:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001541564 2024-09-11T07:06:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.148836+0000", 2024-09-11T07:06:19.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6504000000000001e-05 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1461 3.0 e26/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 26'39, mlcod=26'37)", 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.224397+0000", 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.541266193, 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019313550000000001, 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.798 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224397+0000", 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224397+0000", 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224399+0000", 2024-09-11T07:06:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-06 2024-09-11T07:06:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224439+0000", 2024-09-11T07:06:19.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9459999999999998e-05 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224476+0000", 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7719000000000003e-05 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224496+0000", 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9752999999999999e-05 2024-09-11T07:06:19.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224594+0000", 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7850000000000007e-05 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224621+0000", 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6463999999999999e-05 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.226240+0000", 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001619908 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.226328+0000", 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030999999999998e-05 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1487 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'41, mlcod=26'39)", 2024-09-11T07:06:19.803 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.380230+0000", 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.385433325999999, 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025963000000000002, 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380230+0000", 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380230+0000", 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380232+0000", 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4830000000000002e-06 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380252+0000", 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9879999999999999e-05 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380298+0000", 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5392999999999997e-05 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380324+0000", 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5962999999999999e-05 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380609+0000", 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000285634 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380679+0000", 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9843000000000002e-05 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382748+0000", 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002068987 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382826+0000", 2024-09-11T07:06:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8116999999999998e-05 2024-09-11T07:06:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1490 3.0 e27/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 27'42, mlcod=26'39)", 2024-09-11T07:06:19.808 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.381462+0000", 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.384201229, 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024154110000000001, 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381462+0000", 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381462+0000", 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381464+0000", 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7e-06 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381477+0000", 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.331e-05 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381502+0000", 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4786e-05 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381529+0000", 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6979999999999999e-05 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381714+0000", 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184888 2024-09-11T07:06:19.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381733+0000", 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9707e-05 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.383765+0000", 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020319240000000001 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.383878+0000", 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000112116 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1494 3.0 e27/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 27'43, mlcod=26'39)", 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.384084417, 2024-09-11T07:06:19.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002949344, 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381580+0000", 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8400000000000002e-07 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381590+0000", 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0163000000000001e-05 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381618+0000", 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7705999999999999e-05 2024-09-11T07:06:19.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381634+0000", 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6362999999999999e-05 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382022+0000", 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038785099999999998 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382076+0000", 2024-09-11T07:06:19.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4440000000000001e-05 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384415+0000", 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002338578 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384528+0000", 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011325899999999999 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1530 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'44, mlcod=27'42)", 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.303598387999999, 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031748789999999998, 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:19.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462067+0000", 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4839999999999998e-06 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462088+0000", 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0539000000000001e-05 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462135+0000", 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7102999999999999e-05 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462157+0000", 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2399999999999999e-05 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462289+0000", 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000131509 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462357+0000", 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8085999999999998e-05 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465119+0000", 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002762029 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465240+0000", 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000120729 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1533 3.0 e27/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 27'45, mlcod=27'42)", 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.302385445000001, 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004605179, 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463279+0000", 2024-09-11T07:06:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4619999999999999e-06 2024-09-11T07:06:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463290+0000", 2024-09-11T07:06:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1092e-05 2024-09-11T07:06:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463310+0000", 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9647999999999999e-05 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463326+0000", 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5614e-05 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463402+0000", 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6174000000000006e-05 2024-09-11T07:06:19.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463431+0000", 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8875999999999999e-05 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467839+0000", 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044084079999999999 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467883+0000", 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3905000000000001e-05 2024-09-11T07:06:19.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1537 3.0 e27/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 27'46, mlcod=27'42)", 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.301513352000001, 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037617390000000001, 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464151+0000", 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.232e-06 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464161+0000", 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3479999999999993e-06 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464182+0000", 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1141999999999998e-05 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464193+0000", 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.163e-05 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464273+0000", 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9396999999999999e-05 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464300+0000", 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6811000000000001e-05 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467890+0000", 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003590626 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467912+0000", 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1552999999999998e-05 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1574 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'47, mlcod=27'45)", 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.535781+0000", 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.229882644, 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019771369999999999, 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535781+0000", 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535781+0000", 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535783+0000", 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.283e-06 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535859+0000", 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6234000000000002e-05 2024-09-11T07:06:19.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535903+0000", 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4091999999999997e-05 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535927+0000", 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.366e-05 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.536069+0000", 2024-09-11T07:06:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014184899999999999 2024-09-11T07:06:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.536117+0000", 2024-09-11T07:06:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.782e-05 2024-09-11T07:06:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.537710+0000", 2024-09-11T07:06:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001593061 2024-09-11T07:06:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.537758+0000", 2024-09-11T07:06:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8137999999999999e-05 2024-09-11T07:06:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.836 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:3919 3.9 e30/21 3:906e061f:::rbd_data.11614fc4d54f.0000000000000041:head v 30'7, mlcod=25'5)", 2024-09-11T07:06:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.203847+0000", 2024-09-11T07:06:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.5618166319999993, 2024-09-11T07:06:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025166630000000001, 2024-09-11T07:06:19.837 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203847+0000", 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203847+0000", 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203848+0000", 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4e-07 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203954+0000", 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106536 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203989+0000", 2024-09-11T07:06:19.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4539999999999998e-05 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.204011+0000", 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.27e-05 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.204097+0000", 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5618000000000006e-05 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.204120+0000", 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2976000000000002e-05 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.206319+0000", 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021993529999999998 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.206363+0000", 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3999999999999999e-05 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.0 epoch 33/21 rep_tid 136 entries 33'88 (0'0) error 3:00d3d0eb:::rbd_data.116153756644.0000000000000033:head by client.4449.0:8937 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 33'86)", 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.7625017920000001, 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026246419999999999, 2024-09-11T07:06:19.842 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003163+0000", 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1009999999999999e-06 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003175+0000", 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2041999999999999e-05 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003197+0000", 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2286e-05 2024-09-11T07:06:19.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003213+0000", 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6160000000000001e-05 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003315+0000", 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102329 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.005786+0000", 2024-09-11T07:06:19.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024707240000000001 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:8976 3.9 e33/21 3:96232816:::rbd_data.116153756644.0000000000000043:head v 33'22, mlcod=33'20)", 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.021190+0000", 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.744473267, 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023778330000000002, 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.846 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021190+0000", 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021190+0000", 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021191+0000", 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3039999999999999e-06 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021199+0000", 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6799999999999993e-06 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021211+0000", 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2208000000000001e-05 2024-09-11T07:06:19.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021219+0000", 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8499999999999994e-06 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021318+0000", 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9077e-05 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021337+0000", 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9174e-05 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.023526+0000", 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021883670000000001 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.023568+0000", 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2172999999999998e-05 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:10198 3.0 e34/21 3:0497d956:::rbd_data.11612823e096.000000000000002a:head v 34'96, mlcod=33'94)", 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.884481+0000", 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.88118184, 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019149029999999999, 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884481+0000", 2024-09-11T07:06:19.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884481+0000", 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884482+0000", 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4699999999999998e-07 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884537+0000", 2024-09-11T07:06:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5723000000000002e-05 2024-09-11T07:06:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884550+0000", 2024-09-11T07:06:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2604e-05 2024-09-11T07:06:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884560+0000", 2024-09-11T07:06:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7499999999999998e-06 2024-09-11T07:06:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884654+0000", 2024-09-11T07:06:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4252000000000005e-05 2024-09-11T07:06:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884676+0000", 2024-09-11T07:06:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2052000000000002e-05 2024-09-11T07:06:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.886357+0000", 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001681201 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.886396+0000", 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9073999999999999e-05 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.857 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:14563 3.4 e37/21 3:22c3ced6:::rbd_data.116120e0a896.000000000000011a:head v 37'45, mlcod=37'43)", 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:18.758343+0000", 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.007320633, 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020331490000000002, 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758343+0000", 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758343+0000", 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758344+0000", 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6029999999999999e-06 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758377+0000", 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2546999999999999e-05 2024-09-11T07:06:19.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758402+0000", 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5040000000000001e-05 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758414+0000", 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1630999999999999e-05 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758538+0000", 2024-09-11T07:06:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124888 2024-09-11T07:06:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758604+0000", 2024-09-11T07:06:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5380000000000001e-05 2024-09-11T07:06:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.760332+0000", 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017281900000000001 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.760376+0000", 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3869999999999998e-05 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:17025 3.0 e37/21 3:075df309:::rbd_data.116120e0a896.000000000000002c:head v 37'115, mlcod=37'113)", 2024-09-11T07:06:19.862 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:18.985994+0000", 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.77966975100000002, 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0018807229999999999, 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.985994+0000", 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:19.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.985994+0000", 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.985995+0000", 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.986271+0000", 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276452 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.986288+0000", 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7234000000000001e-05 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.986296+0000", 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9070000000000007e-06 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.986358+0000", 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1587999999999994e-05 2024-09-11T07:06:19.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.986377+0000", 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8841000000000001e-05 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.987808+0000", 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014313920000000001 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:19.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.987874+0000", 2024-09-11T07:06:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6146e-05 2024-09-11T07:06:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:19.867 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:19.867 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:19.867 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:19.764+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:19.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:19.911 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:19.912+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:19.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:06:19.970 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:19.966+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:20.044 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:20.044 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:20.045 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:20.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:20.111 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:20.112+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:20.173 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:20.170+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:20.182 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #7, image image_client.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent8 2024-09-11T07:06:20.186 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:20.187 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:20.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:20.245 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:06:20.245 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:06:20.246 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-11T07:06:20.246 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T07:06:20.246 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T07:06:20.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-11T07:06:20.274 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:20.270+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:20.374 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:20.370+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:20.426 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6914 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4472832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7503742669999998, 2024-09-11T07:06:20.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030418942000000001, 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6914 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:20.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4799999999999998e-07 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675891+0000", 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5150000000000001e-06 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675898+0000", 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9040000000000003e-06 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675903+0000", 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6180000000000003e-06 2024-09-11T07:06:20.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706154+0000", 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030250969999999999 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706235+0000", 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0343e-05 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706307+0000", 2024-09-11T07:06:20.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1944000000000001e-05 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6915 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7503515269999994, 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030587597000000001, 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6915 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676263+0000", 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035270599999999999 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676268+0000", 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0860000000000001e-06 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676280+0000", 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1863e-05 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676288+0000", 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5599999999999996e-06 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706353+0000", 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030065614000000001 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706438+0000", 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5041000000000001e-05 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706498+0000", 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9726999999999999e-05 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6916 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5226496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676301+0000", 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7499610590000003, 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030333954, 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6916 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.436 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676301+0000", 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676301+0000", 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676302+0000", 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6000000000000003e-07 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676304+0000", 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6460000000000002e-06 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676312+0000", 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2919999999999998e-06 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676317+0000", 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4029999999999998e-06 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706528+0000", 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030211407999999999 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706573+0000", 2024-09-11T07:06:20.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5037999999999998e-05 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706635+0000", 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1507000000000006e-05 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6917 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5341184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:20.440 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7499373120000001, 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030468918000000001, 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6917 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0500000000000003e-07 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676328+0000", 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3980000000000002e-06 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676335+0000", 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2649999999999999e-06 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676340+0000", 2024-09-11T07:06:20.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4809999999999997e-06 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706664+0000", 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030323033999999999 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706731+0000", 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7639999999999996e-05 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706794+0000", 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2495000000000004e-05 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6918 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5455872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7499142519999999, 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594758999999999, 2024-09-11T07:06:20.445 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6918 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-07 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676350+0000", 2024-09-11T07:06:20.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0940000000000002e-06 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676357+0000", 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5699999999999998e-06 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676362+0000", 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706819+0000", 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456987000000001 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706885+0000", 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6054000000000001e-05 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706943+0000", 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7556000000000003e-05 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.449 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6919 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7498924999999996, 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030730071000000001, 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.450 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6919 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676595+0000", 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225577 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676599+0000", 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3540000000000002e-06 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676611+0000", 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1037e-05 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676618+0000", 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4050000000000003e-06 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706966+0000", 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030348373000000001 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707032+0000", 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5736999999999998e-05 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707100+0000", 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7588000000000004e-05 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6920 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6209536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.454 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7496319119999999, 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030647992999999998, 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6920 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676631+0000", 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999999e-07 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676633+0000", 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.729e-06 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676641+0000", 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7659999999999998e-06 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676647+0000", 2024-09-11T07:06:20.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7930000000000003e-06 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707128+0000", 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030481028 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707211+0000", 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2792000000000003e-05 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707278+0000", 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7288999999999999e-05 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6921 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6324224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7496064830000009, 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030787063999999999, 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6921 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7700000000000004e-07 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676660+0000", 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.997e-06 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676667+0000", 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2910000000000002e-06 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676673+0000", 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6010000000000002e-06 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707305+0000", 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030632029000000002 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707380+0000", 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5265999999999994e-05 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707443+0000", 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2303000000000003e-05 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.463 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6922 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6438912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7495809559999991, 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031018718000000001, 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6922 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676852+0000", 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000171371 2024-09-11T07:06:20.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676857+0000", 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6380000000000003e-06 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676867+0000", 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0268000000000001e-05 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676875+0000", 2024-09-11T07:06:20.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5320000000000001e-06 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707469+0000", 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030593615000000001 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707632+0000", 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016336399999999999 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707700+0000", 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7929999999999995e-05 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6923 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6553600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7493747269999993, 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030968105999999999, 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.468 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6923 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676888+0000", 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7000000000000005e-07 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676895+0000", 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1110000000000002e-06 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676902+0000", 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2030000000000003e-06 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676908+0000", 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6200000000000004e-06 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707728+0000", 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030820163000000001 2024-09-11T07:06:20.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707797+0000", 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8737000000000003e-05 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707855+0000", 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8702000000000001e-05 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6924 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7192576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7493453960000007, 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031099157999999998, 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6924 2024-09-11T07:06:20.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4000000000000001e-07 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676921+0000", 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6899999999999998e-06 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676928+0000", 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8260000000000004e-06 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676933+0000", 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3109999999999996e-06 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707879+0000", 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030946265000000001 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707946+0000", 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6365000000000006e-05 2024-09-11T07:06:20.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708016+0000", 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0061000000000006e-05 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6925 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7493195410000002, 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.03121956, 2024-09-11T07:06:20.477 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6925 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676996+0000", 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3483000000000003e-05 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677000+0000", 2024-09-11T07:06:20.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1840000000000001e-06 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677009+0000", 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2390000000000008e-06 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677016+0000", 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0600000000000002e-06 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708042+0000", 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031025569999999999 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708106+0000", 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3723e-05 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708162+0000", 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6301000000000002e-05 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7045 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5472256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7443079840000006, 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456286999999999, 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7045 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682107+0000", 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015256800000000001 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682111+0000", 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0450000000000002e-06 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682120+0000", 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6569999999999992e-06 2024-09-11T07:06:20.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682127+0000", 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6239999999999996e-06 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712254+0000", 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030127068 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712333+0000", 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8788999999999994e-05 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712410+0000", 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7535999999999998e-05 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7046 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5586944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:20.486 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7441233969999992, 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030486447, 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7046 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:20.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5400000000000001e-07 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682142+0000", 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7429999999999998e-06 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682149+0000", 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3209999999999999e-06 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682155+0000", 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7620000000000001e-06 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712454+0000", 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030298814 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712563+0000", 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010932 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712625+0000", 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1933000000000005e-05 2024-09-11T07:06:20.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7047 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7440993460000005, 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030677043000000001, 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7047 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682532+0000", 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036941099999999999 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682537+0000", 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2469999999999999e-06 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682547+0000", 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9000000000000001e-06 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682554+0000", 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2060000000000001e-06 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712666+0000", 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030111422999999998 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712761+0000", 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5212999999999998e-05 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712840+0000", 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8642999999999999e-05 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7048 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6340608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.495 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7436941749999999, 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494950999999999, 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7048 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7299999999999996e-07 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682571+0000", 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7760000000000002e-06 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682577+0000", 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0209999999999996e-06 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682584+0000", 2024-09-11T07:06:20.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8630000000000002e-06 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712904+0000", 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030320347000000001 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712987+0000", 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2367000000000006e-05 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713063+0000", 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6003999999999999e-05 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7049 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6455296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7436695239999995, 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030670962999999999, 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7049 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7199999999999999e-07 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682596+0000", 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5189999999999999e-06 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682602+0000", 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7240000000000003e-06 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682607+0000", 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2410000000000003e-06 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713102+0000", 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494841000000002 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713189+0000", 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6697e-05 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713263+0000", 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4468999999999995e-05 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7050 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6569984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7436459630000005, 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030850200000000001, 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7050 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682617+0000", 2024-09-11T07:06:20.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682619+0000", 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2450000000000001e-06 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682627+0000", 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0520000000000002e-06 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682632+0000", 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2750000000000003e-06 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713310+0000", 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030678305999999999 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713391+0000", 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0164e-05 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713466+0000", 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5703000000000003e-05 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7051 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6684672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7436224369999991, 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030997008, 2024-09-11T07:06:20.509 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7051 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682684+0000", 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4625e-05 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682695+0000", 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0575e-05 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682703+0000", 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1389999999999995e-06 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682709+0000", 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713498+0000", 2024-09-11T07:06:20.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030789092000000001 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713571+0000", 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2554999999999999e-05 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713637+0000", 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5950000000000004e-05 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7052 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7435432500000001, 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031135348, 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7052 2024-09-11T07:06:20.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:20.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683050+0000", 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033088699999999998 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683054+0000", 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.651e-06 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683066+0000", 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1372000000000001e-05 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683074+0000", 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5939999999999994e-06 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713669+0000", 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594982 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713786+0000", 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116937 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:20.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713854+0000", 2024-09-11T07:06:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7924999999999998e-05 2024-09-11T07:06:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:20.518 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:20.518 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:20.518 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:20.519 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:20.520 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T07:06:20.520 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:20.520 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:20.522 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:20.518+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:20.621 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:20.618+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:20.642 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:20.643 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:20.643 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:20.643 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:20.657 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:20.735 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:20.735 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:20.743 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:20.742+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:20.754 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:20.754 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:20.770 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:20.770 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:20.785 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:20.786 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:20.805 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:20.822 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:20.822 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:20.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:20.824+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:20.823 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:20.823 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:20.837 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:20.843 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:20.843 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:20.862 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:20.862 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:20.867 INFO:teuthology.orchestra.run.smithi079.stdout:1355 read 0x35da0a thru 0x36684f (0x8e46 bytes) 2024-09-11T07:06:20.871 INFO:teuthology.orchestra.run.smithi079.stdout:1356 trunc from 0x95bdcda to 0xb2926f8 2024-09-11T07:06:20.888 INFO:teuthology.orchestra.run.smithi079.stdout:1359 trunc from 0xb2926f8 to 0x72d7443 2024-09-11T07:06:20.913 INFO:teuthology.orchestra.run.smithi079.stdout:1360 trunc from 0x72d7443 to 0x2db69f5 2024-09-11T07:06:20.917 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:06:20.924 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:20.924+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:20.963 INFO:teuthology.orchestra.run.smithi079.stdout:1361 writesame 0xdc401d1 thru 0xdc495aa data_size 0x19(0x93da bytes) 2024-09-11T07:06:20.963 INFO:teuthology.orchestra.run.smithi079.stdout:1365 read 0x2e72ca1 thru 0x2e7e676 (0xb9d6 bytes) 2024-09-11T07:06:20.963 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:20.963 INFO:teuthology.orchestra.run.smithi079.stdout:1367 writesame 0x8cded2a thru 0x8ce6c5f data_size 0x13(0x7f36 bytes) 2024-09-11T07:06:20.968 INFO:teuthology.orchestra.run.smithi079.stdout:1368 write 0x610597a thru 0x610700f (0x1696 bytes) 2024-09-11T07:06:20.972 INFO:teuthology.orchestra.run.smithi079.stdout:1369 read 0x8ca461e thru 0x8cb0e68 (0xc84b bytes) 2024-09-11T07:06:20.973 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:20.973 INFO:teuthology.orchestra.run.smithi079.stdout:1372 writesame 0x4626acf thru 0x462df55 data_size 0x1(0x7487 bytes) 2024-09-11T07:06:21.005 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:21.006 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:21.007 INFO:teuthology.orchestra.run.smithi079.stdout:1373 writesame 0xa25c0c3 thru 0xa267701 data_size 0x2b(0xb63f bytes) 2024-09-11T07:06:21.013 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:21.014 INFO:teuthology.orchestra.run.smithi079.stdout:1375 write 0x4e3d09d thru 0x4e3d604 (0x568 bytes) 2024-09-11T07:06:21.018 INFO:teuthology.orchestra.run.smithi079.stdout:1378 read 0xac62f08 thru 0xac69d07 (0x6e00 bytes) 2024-09-11T07:06:21.018 INFO:teuthology.orchestra.run.smithi079.stdout:1380 write 0x186ad93 thru 0x18724cf (0x773d bytes) 2024-09-11T07:06:21.020 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:21.026 INFO:teuthology.orchestra.run.smithi079.stdout:1381 write 0xaee72d9 thru 0xaef38c7 (0xc5ef bytes) 2024-09-11T07:06:21.033 INFO:teuthology.orchestra.run.smithi079.stdout:1382 write 0x153072e thru 0x1534dd3 (0x46a6 bytes) 2024-09-11T07:06:21.041 INFO:teuthology.orchestra.run.smithi079.stdout:1383 write 0xd438caf thru 0xd43aff5 (0x2347 bytes) 2024-09-11T07:06:21.046 INFO:teuthology.orchestra.run.smithi079.stdout:1384 read 0x3e6369 thru 0x3e9755 (0x33ed bytes) 2024-09-11T07:06:21.047 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:21.064 INFO:teuthology.orchestra.run.smithi079.stdout:1387 trunc from 0xdc495ab to 0x5c26c45 2024-09-11T07:06:21.067 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:21.066+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:21.092 INFO:teuthology.orchestra.run.smithi079.stdout:1388 writesame 0x4a62081 thru 0x4a6f0b2 data_size 0x8d(0xd032 bytes) 2024-09-11T07:06:21.098 INFO:teuthology.orchestra.run.smithi079.stdout:1391 read 0x369fa51 thru 0x36a30c5 (0x3675 bytes) 2024-09-11T07:06:21.102 INFO:teuthology.orchestra.run.smithi079.stdout:1392 trunc from 0x5c26c45 to 0x3c38e62 2024-09-11T07:06:21.125 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:21.124+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:21.149 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:21.150 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:21.153 INFO:teuthology.orchestra.run.smithi079.stdout:1393 writesame 0xd0536a3 thru 0xd0578ac data_size 0x2(0x420a bytes) 2024-09-11T07:06:21.153 INFO:teuthology.orchestra.run.smithi079.stdout:1394 write 0xbe95c85 thru 0xbe9999c (0x3d18 bytes) 2024-09-11T07:06:21.164 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:21.165 INFO:teuthology.orchestra.run.smithi079.stdout:1395 trunc from 0xd0578ad to 0xa7cc156 2024-09-11T07:06:21.186 INFO:teuthology.orchestra.run.smithi079.stdout:1398 writesame 0x30ac0f0 thru 0x30bb37e data_size 0xb(0xf28f bytes) 2024-09-11T07:06:21.194 INFO:teuthology.orchestra.run.smithi079.stdout:1400 writesame 0x1431e9f thru 0x143d0f9 data_size 0x1(0xb25b bytes) 2024-09-11T07:06:21.226 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:21.224+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:21.258 INFO:teuthology.orchestra.run.smithi079.stdout:1401 write 0xc3b4b7 thru 0xc403d4 (0x4f1e bytes) 2024-09-11T07:06:21.267 INFO:teuthology.orchestra.run.smithi079.stdout:1402 write 0x7207b58 thru 0x720f05e (0x7507 bytes) 2024-09-11T07:06:21.290 INFO:teuthology.orchestra.run.smithi079.stdout:1404 trunc from 0xa7cc156 to 0x37e2484 2024-09-11T07:06:21.314 INFO:teuthology.orchestra.run.smithi079.stdout:1405 read 0xa19496 thru 0xa1ec08 (0x5773 bytes) 2024-09-11T07:06:21.327 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:21.328+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:21.332 INFO:teuthology.orchestra.run.smithi079.stdout:1406 write 0x44fdef0 thru 0x4502339 (0x444a bytes) 2024-09-11T07:06:21.335 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:21.335 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:21.350 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:21.359 INFO:teuthology.orchestra.run.smithi079.stdout:1408 writesame 0x726ca56 thru 0x72706bf data_size 0x26(0x3c6a bytes) 2024-09-11T07:06:21.359 INFO:teuthology.orchestra.run.smithi079.stdout:1409 punch from 0x171513b to 0x1719677, (0x453c bytes) 2024-09-11T07:06:21.359 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:21.359 INFO:teuthology.orchestra.run.smithi079.stdout:1411 read 0x27f1821 thru 0x27ff58f (0xdd6f bytes) 2024-09-11T07:06:21.360 INFO:teuthology.orchestra.run.smithi079.stdout:1412 punch from 0x197782e to 0x197ac68, (0x343a bytes) 2024-09-11T07:06:21.360 INFO:teuthology.orchestra.run.smithi079.stdout:1415 read 0x4e2b705 thru 0x4e33bc8 (0x84c4 bytes) 2024-09-11T07:06:21.364 INFO:teuthology.orchestra.run.smithi079.stdout:1416 trunc from 0x72706c0 to 0x5846310 2024-09-11T07:06:21.374 INFO:teuthology.orchestra.run.smithi079.stdout:1417 writesame 0x4060aef thru 0x4063e15 data_size 0xf(0x3327 bytes) 2024-09-11T07:06:21.377 INFO:teuthology.orchestra.run.smithi079.stdout:1418 read 0x5411a37 thru 0x541e1cd (0xc797 bytes) 2024-09-11T07:06:21.384 INFO:teuthology.orchestra.run.smithi079.stdout:1419 trunc from 0x5846310 to 0x3352782 2024-09-11T07:06:21.425 INFO:teuthology.orchestra.run.smithi079.stdout:1422 writesame 0x5be2304 thru 0x5beca2a data_size 0x1(0xa727 bytes) 2024-09-11T07:06:21.425 INFO:teuthology.orchestra.run.smithi079.stdout:1423 punch from 0xb7c4d8 to 0xb7d179, (0xca1 bytes) 2024-09-11T07:06:21.428 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:21.426+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:21.436 INFO:teuthology.orchestra.run.smithi079.stdout:1426 trunc from 0x5beca2b to 0xa0b4b06 2024-09-11T07:06:21.454 INFO:teuthology.orchestra.run.smithi079.stdout:1428 trunc from 0xa0b4b06 to 0x7b63571 2024-09-11T07:06:21.480 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:21.480 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:21.484 INFO:teuthology.orchestra.run.smithi079.stdout:1429 write 0x837f589 thru 0x838df54 (0xe9cc bytes) 2024-09-11T07:06:21.493 INFO:teuthology.orchestra.run.smithi079.stdout:1431 read 0x2409bbd thru 0x240e0fe (0x4542 bytes) 2024-09-11T07:06:21.494 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:21.510 INFO:teuthology.orchestra.run.smithi079.stdout:1432 trunc from 0x838df55 to 0xc883f0 2024-09-11T07:06:21.529 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:21.528+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:21.552 INFO:teuthology.orchestra.run.smithi079.stdout:1433 read 0x2bc971 thru 0x2c1b76 (0x5206 bytes) 2024-09-11T07:06:21.553 INFO:teuthology.orchestra.run.smithi079.stdout:1434 read 0xac6e8f thru 0xad46be (0xd830 bytes) 2024-09-11T07:06:21.554 INFO:teuthology.orchestra.run.smithi079.stdout:1435 read 0x7f5d96 thru 0x7fa7a5 (0x4a10 bytes) 2024-09-11T07:06:21.555 INFO:teuthology.orchestra.run.smithi079.stdout:1436 punch from 0x9727db to 0x97d1a8, (0xa9cd bytes) 2024-09-11T07:06:21.581 INFO:teuthology.orchestra.run.smithi079.stdout:1437 writesame 0x686a4e0 thru 0x6876a95 data_size 0x1(0xc5b6 bytes) 2024-09-11T07:06:21.594 INFO:teuthology.orchestra.run.smithi079.stdout:1439 trunc from 0x6876a96 to 0x1b7ef1b 2024-09-11T07:06:21.605 INFO:teuthology.orchestra.run.smithi079.stdout:1441 punch from 0x1398e8d to 0x13a2c24, (0x9d97 bytes) 2024-09-11T07:06:21.630 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:21.626+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:21.634 INFO:teuthology.orchestra.run.smithi079.stdout:1442 trunc from 0x1b7ef1b to 0xe2fdb05 2024-09-11T07:06:21.647 INFO:teuthology.orchestra.run.smithi079.stdout:1443 punch from 0xbecf67e to 0xbeddd1d, (0xe69f bytes) 2024-09-11T07:06:21.647 INFO:teuthology.orchestra.run.smithi079.stdout:1444 punch from 0xba3f78d to 0xba4b720, (0xbf93 bytes) 2024-09-11T07:06:21.647 INFO:teuthology.orchestra.run.smithi079.stdout:1446 read 0x2294152 thru 0x22a12ee (0xd19d bytes) 2024-09-11T07:06:21.647 INFO:teuthology.orchestra.run.smithi079.stdout:1447 write 0x1457a40 thru 0x1461ffe (0xa5bf bytes) 2024-09-11T07:06:21.653 INFO:teuthology.orchestra.run.smithi079.stdout:1448 write 0x67bcfc2 thru 0x67c5d7c (0x8dbb bytes) 2024-09-11T07:06:21.655 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:21.656 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:21.661 INFO:teuthology.orchestra.run.smithi079.stdout:1451 read 0x9d5a8be thru 0x9d5e7cc (0x3f0f bytes) 2024-09-11T07:06:21.661 INFO:teuthology.orchestra.run.smithi079.stdout:1452 write 0x8050894 thru 0x805df9f (0xd70c bytes) 2024-09-11T07:06:21.669 INFO:teuthology.orchestra.run.smithi079.stdout:1454 trunc from 0xe2fdb05 to 0xe5dab69 2024-09-11T07:06:21.671 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:21.678 INFO:teuthology.orchestra.run.smithi079.stdout:1455 read 0x8a5bbcd thru 0x8a6300f (0x7443 bytes) 2024-09-11T07:06:21.678 INFO:teuthology.orchestra.run.smithi079.stdout:1458 read 0xcfee20a thru 0xcfef287 (0x107e bytes) 2024-09-11T07:06:21.678 INFO:teuthology.orchestra.run.smithi079.stdout:1459 read 0x859c3db thru 0x85ac032 (0xfc58 bytes) 2024-09-11T07:06:21.678 INFO:teuthology.orchestra.run.smithi079.stdout:1460 punch from 0xbbb36f7 to 0xbbbcabb, (0x93c4 bytes) 2024-09-11T07:06:21.678 INFO:teuthology.orchestra.run.smithi079.stdout:1461 write 0x5f26a4c thru 0x5f29730 (0x2ce5 bytes) 2024-09-11T07:06:21.684 INFO:teuthology.orchestra.run.smithi079.stdout:1463 write 0x7f8b90 thru 0x7ffbb2 (0x7023 bytes) 2024-09-11T07:06:21.694 INFO:teuthology.orchestra.run.smithi079.stdout:1465 read 0x3b2eae5 thru 0x3b31db1 (0x32cd bytes) 2024-09-11T07:06:21.694 INFO:teuthology.orchestra.run.smithi079.stdout:1466 clone 10 order 25 su 262144 sc 12 2024-09-11T07:06:21.732 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:21.732+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:21.833 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:21.830+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:21.839 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:21.839 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:21.854 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:21.934 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:21.932+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:22.024 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:22.024 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:22.035 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:22.036+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:22.041 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:22.049 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone9 from 0xe5dab69 (overlap 0xc883f0) to 0x0 2024-09-11T07:06:22.136 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:22.134+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:22.178 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:22.178 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:22.193 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:22.198 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #8, image image_client.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent9 2024-09-11T07:06:22.237 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:22.236+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:22.338 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:22.336+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:22.358 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:22.358 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:22.372 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:22.439 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:22.438+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:22.491 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:22.491 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:22.506 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:22.547 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:22.546+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:22.584 INFO:teuthology.orchestra.run.smithi079.stdout:1467 writesame 0x45d0b21 thru 0x45dae26 data_size 0x16(0xa306 bytes) 2024-09-11T07:06:22.596 INFO:teuthology.orchestra.run.smithi079.stdout:1470 punch from 0x95ec77e to 0x95fa31b, (0xdb9d bytes) 2024-09-11T07:06:22.596 INFO:teuthology.orchestra.run.smithi079.stdout:1471 write 0x8e2feb7 thru 0x8e36a4e (0x6b98 bytes) 2024-09-11T07:06:22.604 INFO:teuthology.orchestra.run.smithi079.stdout:1472 punch from 0x4fbfd4d to 0x4fc4eb5, (0x5168 bytes) 2024-09-11T07:06:22.604 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:22.604 INFO:teuthology.orchestra.run.smithi079.stdout:1474 writesame 0xa2cfc14 thru 0xa2d9625 data_size 0x4a(0x9a12 bytes) 2024-09-11T07:06:22.606 INFO:teuthology.orchestra.run.smithi079.stdout:1475 read 0x1efe3e9 thru 0x1f06c2c (0x8844 bytes) 2024-09-11T07:06:22.606 INFO:teuthology.orchestra.run.smithi079.stdout:1477 read 0x14ba8ad thru 0x14bc380 (0x1ad4 bytes) 2024-09-11T07:06:22.606 INFO:teuthology.orchestra.run.smithi079.stdout:1478 trunc from 0xe5dab69 to 0xe4700d0 2024-09-11T07:06:22.636 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:22.636 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:22.641 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:22.638+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:22.642 INFO:teuthology.orchestra.run.smithi079.stdout:1479 read 0x6d05e51 thru 0x6d15d7e (0xff2e bytes) 2024-09-11T07:06:22.643 INFO:teuthology.orchestra.run.smithi079.stdout:1480 read 0x71bf21b thru 0x71c1697 (0x247d bytes) 2024-09-11T07:06:22.643 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:22.643 INFO:teuthology.orchestra.run.smithi079.stdout:1482 read 0xc111cc3 thru 0xc1120e9 (0x427 bytes) 2024-09-11T07:06:22.649 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:22.655 INFO:teuthology.orchestra.run.smithi079.stdout:1483 trunc from 0xe4700d0 to 0x73bab6a 2024-09-11T07:06:22.695 INFO:teuthology.orchestra.run.smithi079.stdout:1484 read 0x1475064 thru 0x147aa93 (0x5a30 bytes) 2024-09-11T07:06:22.696 INFO:teuthology.orchestra.run.smithi079.stdout:1485 write 0x47572f8 thru 0x4762b9c (0xb8a5 bytes) 2024-09-11T07:06:22.700 INFO:teuthology.orchestra.run.smithi079.stdout:1486 read 0x65c7fe thru 0x66b775 (0xef78 bytes) 2024-09-11T07:06:22.701 INFO:teuthology.orchestra.run.smithi079.stdout:1487 read 0x73b2484 thru 0x73bab69 (0x86e6 bytes) 2024-09-11T07:06:22.702 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:22.711 INFO:teuthology.orchestra.run.smithi079.stdout:1491 trunc from 0x73bab6a to 0x261ab09 2024-09-11T07:06:22.742 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:22.738+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:22.762 INFO:teuthology.orchestra.run.smithi079.stdout:1492 write 0xbbc3351 thru 0xbbc8771 (0x5421 bytes) 2024-09-11T07:06:22.766 INFO:teuthology.orchestra.run.smithi079.stdout:1493 read 0x54d57f3 thru 0x54da09f (0x48ad bytes) 2024-09-11T07:06:22.776 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:22.776 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:22.782 INFO:teuthology.orchestra.run.smithi079.stdout:1494 trunc from 0xbbc8772 to 0x534e613 2024-09-11T07:06:22.796 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:22.802 INFO:teuthology.orchestra.run.smithi079.stdout:1495 punch from 0x3401e1f to 0x3403354, (0x1535 bytes) 2024-09-11T07:06:22.810 INFO:teuthology.orchestra.run.smithi079.stdout:1496 trunc from 0x534e613 to 0x17a0452 2024-09-11T07:06:22.828 INFO:teuthology.orchestra.run.smithi079.stdout:1497 read 0x176a874 thru 0x1777573 (0xcd00 bytes) 2024-09-11T07:06:22.829 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:22.842 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:22.840+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:22.853 INFO:teuthology.orchestra.run.smithi079.stdout:1501 write 0x782b8ec thru 0x782bf3a (0x64f bytes) 2024-09-11T07:06:22.880 INFO:teuthology.orchestra.run.smithi079.stdout:1503 write 0xde391e9 thru 0xde3a5b2 (0x13ca bytes) 2024-09-11T07:06:22.881 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:22.884 INFO:teuthology.orchestra.run.smithi079.stdout:1504 punch from 0x99ded58 to 0x99e0c91, (0x1f39 bytes) 2024-09-11T07:06:22.888 INFO:teuthology.orchestra.run.smithi079.stdout:1505 trunc from 0xde3a5b3 to 0xb7066b9 2024-09-11T07:06:22.909 INFO:teuthology.orchestra.run.smithi079.stdout:1507 punch from 0x6bba86d to 0x6bc988a, (0xf01d bytes) 2024-09-11T07:06:22.909 INFO:teuthology.orchestra.run.smithi079.stdout:1508 write 0x18a371a thru 0x18a82b5 (0x4b9c bytes) 2024-09-11T07:06:22.912 INFO:teuthology.orchestra.run.smithi079.stdout:1509 writesame 0x8f6613 thru 0x9055c4 data_size 0x9(0xefb2 bytes) 2024-09-11T07:06:22.918 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:22.932 INFO:teuthology.orchestra.run.smithi079.stdout:1511 trunc from 0xb7066b9 to 0x22252b1 2024-09-11T07:06:22.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:06:22.943 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:22.942+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:22.949 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:22.949 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:22.973 INFO:teuthology.orchestra.run.smithi079.stdout:1512 trunc from 0x22252b1 to 0xec92766 2024-09-11T07:06:22.983 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:22.986 INFO:teuthology.orchestra.run.smithi079.stdout:1513 writesame 0x7bc7af9 thru 0x7bd6d38 data_size 0x18(0xf240 bytes) 2024-09-11T07:06:22.990 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:22.990 INFO:teuthology.orchestra.run.smithi079.stdout:1515 punch from 0xd11b764 to 0xd1226fb, (0x6f97 bytes) 2024-09-11T07:06:22.990 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:22.990 INFO:teuthology.orchestra.run.smithi079.stdout:1517 write 0x4daa637 thru 0x4daeba2 (0x456c bytes) 2024-09-11T07:06:22.993 INFO:teuthology.orchestra.run.smithi079.stdout:1519 read 0x7384ad1 thru 0x7384ff9 (0x529 bytes) 2024-09-11T07:06:22.994 INFO:teuthology.orchestra.run.smithi079.stdout:1520 read 0xd98ad8c thru 0xd9974a7 (0xc71c bytes) 2024-09-11T07:06:22.995 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:22.995 INFO:teuthology.orchestra.run.smithi079.stdout:1522 read 0x2158c0c thru 0x21657dc (0xcbd1 bytes) 2024-09-11T07:06:22.996 INFO:teuthology.orchestra.run.smithi079.stdout:1523 read 0x244f3c1 thru 0x2451a59 (0x2699 bytes) 2024-09-11T07:06:22.996 INFO:teuthology.orchestra.run.smithi079.stdout:1524 read 0x2ec44b5 thru 0x2ed4472 (0xffbe bytes) 2024-09-11T07:06:22.997 INFO:teuthology.orchestra.run.smithi079.stdout:1525 read 0x9ef5acb thru 0x9eff832 (0x9d68 bytes) 2024-09-11T07:06:22.998 INFO:teuthology.orchestra.run.smithi079.stdout:1526 clone 11 order 18 su 2048 sc 6 2024-09-11T07:06:23.037 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:23.037 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:23.045 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:23.042+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:23.055 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:23.055 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:23.072 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:23.073 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:23.089 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:23.089 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:23.107 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:23.107 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:23.107 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:23.107 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:23.110 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:23.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:23.131 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:23.131 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:23.146 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:23.142+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:23.151 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:23.152 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:23.172 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:23.172 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:23.250 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:23.250 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:23.250 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:23.250 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:23.250+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:23.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:23.351 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:23.350+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:23.376 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:23.377 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:23.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:23.377 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:23.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.377 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9385 3.19 3:9a974888:::rbd_data.11612823e096.0000000000000022:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.377 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.447814+0000", 2024-09-11T07:06:23.377 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.9296445549999994, 2024-09-11T07:06:23.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.016670016999999999, 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9385 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447814+0000", 2024-09-11T07:06:23.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447814+0000", 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447817+0000", 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2499999999999998e-06 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447830+0000", 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3134e-05 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447862+0000", 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2153000000000002e-05 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447879+0000", 2024-09-11T07:06:23.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6549999999999999e-05 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.447951+0000", 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2829000000000004e-05 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.448067+0000", 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011510000000000001 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.450627+0000", 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025605889999999998 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464373+0000", 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013745754000000001 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464409+0000", 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5676999999999997e-05 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464450+0000", 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1436000000000001e-05 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.464484+0000", 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3544999999999998e-05 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.383 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9612 3.0 3:0669ea79:::rbd_data.11614fc4d54f.0000000000000000:6 [read 262144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.614895+0000", 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7625633139999994, 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0083823030000000007, 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9612 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614895+0000", 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614895+0000", 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614896+0000", 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1500000000000003e-07 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614900+0000", 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4279999999999998e-06 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614912+0000", 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1946999999999999e-05 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.614921+0000", 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6670000000000002e-06 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.623170+0000", 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082489989999999999 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.623218+0000", 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8126e-05 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.623277+0000", 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9221000000000001e-05 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.387 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9956 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 491520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7490365509999997, 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0084527600000000001, 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.388 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9956 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628422+0000", 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628424+0000", 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0930000000000001e-06 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628431+0000", 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8990000000000004e-06 2024-09-11T07:06:23.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628436+0000", 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.853e-06 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636716+0000", 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082805110000000008 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636798+0000", 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1185000000000003e-05 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636874+0000", 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6693000000000006e-05 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9958 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 622592~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:23.392 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7490151600000008, 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086422029999999993, 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9958 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628443+0000", 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.03e-07 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628446+0000", 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2520000000000002e-06 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628452+0000", 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4280000000000001e-06 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628458+0000", 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6829999999999996e-06 2024-09-11T07:06:23.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636908+0000", 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0084505799999999992 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636975+0000", 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7160000000000001e-05 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637085+0000", 2024-09-11T07:06:23.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000109697 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9989 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 212992~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7489734559999999, 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087728470000000003, 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9989 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628485+0000", 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.77e-07 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628488+0000", 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8559999999999998e-06 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628494+0000", 2024-09-11T07:06:23.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1120000000000001e-06 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628501+0000", 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7499999999999997e-06 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637117+0000", 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086164710000000005 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637186+0000", 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8487999999999999e-05 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637258+0000", 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1792999999999995e-05 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.401 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9991 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 344064~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628556+0000", 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7489020019999995, 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088468039999999998, 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9991 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628556+0000", 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628556+0000", 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628557+0000", 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8899999999999999e-07 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628564+0000", 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2819999999999999e-06 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628571+0000", 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6969999999999996e-06 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628576+0000", 2024-09-11T07:06:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3059999999999997e-06 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637293+0000", 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087169269999999993 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637348+0000", 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5408000000000002e-05 2024-09-11T07:06:23.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637403+0000", 2024-09-11T07:06:23.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4494999999999999e-05 2024-09-11T07:06:23.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.406 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9992 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628583+0000", 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7488748839999992, 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0083642779999999993, 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.407 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9992 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628583+0000", 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628583+0000", 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628584+0000", 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8299999999999997e-07 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628586+0000", 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1110000000000002e-06 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628592+0000", 2024-09-11T07:06:23.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0009999999999998e-06 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628597+0000", 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0220000000000004e-06 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636732+0000", 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081352999999999998 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636845+0000", 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113058 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636948+0000", 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102303 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9993 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 475136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.748853274, 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089343319999999997, 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9993 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.412 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628605+0000", 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5700000000000002e-07 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628608+0000", 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4119999999999999e-06 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628614+0000", 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.251e-06 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628619+0000", 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8740000000000003e-06 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637425+0000", 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088061509999999999 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637482+0000", 2024-09-11T07:06:23.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6805000000000002e-05 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637539+0000", 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7281999999999998e-05 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9994 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 606208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.416 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7488321510000002, 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085150250000000007, 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9994 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628626+0000", 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9200000000000002e-07 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628628+0000", 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628635+0000", 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1299999999999998e-06 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628639+0000", 2024-09-11T07:06:23.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9130000000000002e-06 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.636991+0000", 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0083513919999999991 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637065+0000", 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4510000000000003e-05 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637141+0000", 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650999999999998e-05 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:9995 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 606208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7488121359999997, 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090897089999999996, 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 9995 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628646+0000", 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9499999999999998e-07 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628648+0000", 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9920000000000002e-06 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628654+0000", 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628659+0000", 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7199999999999997e-06 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637562+0000", 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089024039999999992 2024-09-11T07:06:23.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637620+0000", 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8319999999999997e-05 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637736+0000", 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011581799999999999 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10032 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 147456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628666+0000", 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7487917809999995, 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087436330000000007, 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10032 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628666+0000", 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628666+0000", 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628667+0000", 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1699999999999999e-07 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628669+0000", 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2079999999999999e-06 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628675+0000", 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4999999999999996e-06 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628681+0000", 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9680000000000003e-06 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637191+0000", 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0085096589999999993 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637311+0000", 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119571 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637410+0000", 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9309999999999996e-05 2024-09-11T07:06:23.429 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10033 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 147456~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628689+0000", 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7487689839999998, 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092145349999999994, 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.430 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10033 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628689+0000", 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628689+0000", 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628690+0000", 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2e-07 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628692+0000", 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4380000000000002e-06 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628699+0000", 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.567e-06 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628704+0000", 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5459999999999999e-06 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637760+0000", 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090558700000000006 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637811+0000", 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1137999999999997e-05 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637904+0000", 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2555999999999999e-05 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.434 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10034 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 278528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7487462459999996, 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088786860000000002, 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10034 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628712+0000", 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4099999999999999e-07 2024-09-11T07:06:23.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628715+0000", 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.447e-06 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628721+0000", 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5549999999999999e-06 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628726+0000", 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7650000000000001e-06 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637452+0000", 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087259980000000004 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637522+0000", 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0326000000000004e-05 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637591+0000", 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8153999999999998e-05 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10035 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 278528~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628733+0000", 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7487246499999998, 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093551009999999993, 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.439 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10035 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628733+0000", 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628733+0000", 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628734+0000", 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1199999999999998e-07 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628736+0000", 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2680000000000001e-06 2024-09-11T07:06:23.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628745+0000", 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2869999999999993e-06 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628751+0000", 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7019999999999998e-06 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637928+0000", 2024-09-11T07:06:23.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0091772820000000001 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638024+0000", 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5546999999999998e-05 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638089+0000", 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4603000000000005e-05 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.443 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10036 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7486833189999995, 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008972275, 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.444 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10036 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628775+0000", 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9299999999999998e-07 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628779+0000", 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2569999999999999e-06 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628787+0000", 2024-09-11T07:06:23.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3480000000000004e-06 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628793+0000", 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6949999999999997e-06 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637619+0000", 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0088259429999999993 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637681+0000", 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2838999999999999e-05 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637747+0000", 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5599999999999995e-05 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10037 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 409600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.448 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628801+0000", 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7486567320000006, 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094195819999999993, 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10037 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628801+0000", 2024-09-11T07:06:23.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628801+0000", 2024-09-11T07:06:23.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628802+0000", 2024-09-11T07:06:23.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6599999999999996e-07 2024-09-11T07:06:23.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628805+0000", 2024-09-11T07:06:23.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7539999999999998e-06 2024-09-11T07:06:23.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628811+0000", 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7549999999999997e-06 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628817+0000", 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999997e-06 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638121+0000", 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093040369999999994 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638172+0000", 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0705999999999999e-05 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638221+0000", 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8804000000000002e-05 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.453 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10038 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 540672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628827+0000", 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7486306589999998, 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0092094519999999999, 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.454 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10038 2024-09-11T07:06:23.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.456 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628827+0000", 2024-09-11T07:06:23.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628827+0000", 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628828+0000", 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628830+0000", 2024-09-11T07:06:23.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3659999999999999e-06 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628837+0000", 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7290000000000003e-06 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628842+0000", 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2580000000000003e-06 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637797+0000", 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089549380000000008 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.637926+0000", 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012899999999999999 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638037+0000", 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000110747 2024-09-11T07:06:23.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10039 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 540672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628850+0000", 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7486079980000007, 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095082959999999994, 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10039 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628850+0000", 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628850+0000", 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628851+0000", 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628859+0000", 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8460000000000008e-06 2024-09-11T07:06:23.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628867+0000", 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1009999999999992e-06 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628873+0000", 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8159999999999999e-06 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638242+0000", 2024-09-11T07:06:23.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093698649999999998 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638308+0000", 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5235999999999997e-05 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638358+0000", 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0797999999999997e-05 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.464 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10040 3.4 3:2578e33e:::rbd_data.11614fc4d54f.0000000000000004:6 [read 671744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628882+0000", 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7485762180000002, 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0096786370000000004, 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.465 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.466 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10040 2024-09-11T07:06:23.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.466 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628882+0000", 2024-09-11T07:06:23.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628882+0000", 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628883+0000", 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-07 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628885+0000", 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3429999999999998e-06 2024-09-11T07:06:23.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628892+0000", 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7830000000000001e-06 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628897+0000", 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2979999999999999e-06 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638383+0000", 2024-09-11T07:06:23.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0094860110000000008 2024-09-11T07:06:23.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638468+0000", 2024-09-11T07:06:23.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4596000000000001e-05 2024-09-11T07:06:23.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638561+0000", 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2885000000000003e-05 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:10041 3.0 3:03718daa:::rbd_data.11614fc4d54f.0000000000000003:6 [read 671744~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.7485525899999992, 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0093034399999999996, 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.470 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 10041 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628906+0000", 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0400000000000002e-07 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628908+0000", 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.176e-06 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628915+0000", 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5359999999999998e-06 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.628920+0000", 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7860000000000002e-06 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638067+0000", 2024-09-11T07:06:23.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0091466810000000003 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638137+0000", 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0236999999999999e-05 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.638209+0000", 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1619999999999995e-05 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.474 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:23.476 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:23.477 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:23.474+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:23.578 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:23.574+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:23.603 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:23.603 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:23.603 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:23.617 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:23.679 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:23.680+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:23.734 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:23.734 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:23.734 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:23.734 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:23.734 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:23.748 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:23.791 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:23.792+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:23.880 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:23.880+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:23.916 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4232.0:1 2.3 e18/17 2:c4c92e5a:::rbd_trash:head v 18'1, mlcod=0'0)", 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 34.761060395000001, 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021932660000000001, 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.917 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154672+0000", 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0200000000000002e-07 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154680+0000", 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4540000000000001e-06 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154695+0000", 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.518e-05 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154706+0000", 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0572e-05 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154769+0000", 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3341000000000002e-05 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.154796+0000", 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6897999999999999e-05 2024-09-11T07:06:23.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.156813+0000", 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002016856 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:05:49.156865+0000", 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2463000000000002e-05 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1260 3.0 e26/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 26'24, mlcod=26'22)", 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.887992+0000", 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.027739970999999, 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023221700000000001, 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887992+0000", 2024-09-11T07:06:23.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887992+0000", 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.887994+0000", 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.438e-06 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888005+0000", 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1136e-05 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888033+0000", 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8428999999999998e-05 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888047+0000", 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4117999999999999e-05 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888172+0000", 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012466500000000001 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.888239+0000", 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7058999999999996e-05 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890254+0000", 2024-09-11T07:06:23.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020145060000000001 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890315+0000", 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0819000000000002e-05 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1263 3.0 e26/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 26'25, mlcod=26'22)", 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:23.926 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.02648306, 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002862819, 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889250+0000", 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4e-07 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889259+0000", 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3129999999999999e-06 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889289+0000", 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0975000000000001e-05 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889302+0000", 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2699e-05 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889815+0000", 2024-09-11T07:06:23.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051256399999999997 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889850+0000", 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5583000000000001e-05 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892013+0000", 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021629449999999999 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892112+0000", 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8800000000000003e-05 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1267 3.0 e26/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 26'26, mlcod=26'22)", 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.025909470999999, 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045762700000000003, 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889824+0000", 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-06 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889834+0000", 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9480000000000003e-06 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889852+0000", 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8017e-05 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889863+0000", 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0992000000000001e-05 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890364+0000", 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050119400000000005 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890395+0000", 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.112e-05 2024-09-11T07:06:23.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894342+0000", 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039468189999999998 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894399+0000", 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6929999999999999e-05 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.935 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1324 3.0 e26/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 26'27, mlcod=26'25)", 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.010797+0000", 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.904935615999999, 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023525120000000002, 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010797+0000", 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010797+0000", 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010798+0000", 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.545e-06 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010827+0000", 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8345000000000001e-05 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010852+0000", 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5613e-05 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.010864+0000", 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1362999999999999e-05 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011147+0000", 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00028374999999999999 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.011174+0000", 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6676999999999999e-05 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013092+0000", 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019180480000000001 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.013149+0000", 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7170999999999999e-05 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1409 3.0 e26/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 26'35, mlcod=26'33)", 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.146979+0000", 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.768753263000001, 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00185703, 2024-09-11T07:06:23.940 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146979+0000", 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146979+0000", 2024-09-11T07:06:23.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146980+0000", 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4419999999999999e-06 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.146990+0000", 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6439999999999995e-06 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147013+0000", 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3368000000000001e-05 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147023+0000", 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8830000000000001e-06 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147227+0000", 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000203857 2024-09-11T07:06:23.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.147248+0000", 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0767999999999998e-05 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.148790+0000", 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001541564 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.148836+0000", 2024-09-11T07:06:23.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6504000000000001e-05 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1461 3.0 e26/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 26'39, mlcod=26'37)", 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.224397+0000", 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.691335179999999, 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019313550000000001, 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.945 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224397+0000", 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224397+0000", 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224399+0000", 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-06 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224439+0000", 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9459999999999998e-05 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224476+0000", 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7719000000000003e-05 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224496+0000", 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9752999999999999e-05 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224594+0000", 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7850000000000007e-05 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.224621+0000", 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6463999999999999e-05 2024-09-11T07:06:23.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.226240+0000", 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001619908 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.226328+0000", 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030999999999998e-05 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1487 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'41, mlcod=26'39)", 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.380230+0000", 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.535502312999999, 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025963000000000002, 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380230+0000", 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380230+0000", 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380232+0000", 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4830000000000002e-06 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380252+0000", 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9879999999999999e-05 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380298+0000", 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5392999999999997e-05 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380324+0000", 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5962999999999999e-05 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380609+0000", 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000285634 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.380679+0000", 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9843000000000002e-05 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382748+0000", 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002068987 2024-09-11T07:06:23.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382826+0000", 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8116999999999998e-05 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1490 3.0 e27/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 27'42, mlcod=26'39)", 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.381462+0000", 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.534270215999999, 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024154110000000001, 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381462+0000", 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381462+0000", 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381464+0000", 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7e-06 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381477+0000", 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.331e-05 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381502+0000", 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4786e-05 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381529+0000", 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6979999999999999e-05 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381714+0000", 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184888 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381733+0000", 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9707e-05 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.383765+0000", 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020319240000000001 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.383878+0000", 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000112116 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1494 3.0 e27/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 27'43, mlcod=26'39)", 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.534153404000001, 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002949344, 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381580+0000", 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8400000000000002e-07 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381590+0000", 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0163000000000001e-05 2024-09-11T07:06:23.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381618+0000", 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7705999999999999e-05 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381634+0000", 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6362999999999999e-05 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382022+0000", 2024-09-11T07:06:23.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038785099999999998 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382076+0000", 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4440000000000001e-05 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384415+0000", 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002338578 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384528+0000", 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011325899999999999 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1530 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'44, mlcod=27'42)", 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.453667374999998, 2024-09-11T07:06:23.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031748789999999998, 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:23.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462067+0000", 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4839999999999998e-06 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462088+0000", 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0539000000000001e-05 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462135+0000", 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7102999999999999e-05 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462157+0000", 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2399999999999999e-05 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462289+0000", 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000131509 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462357+0000", 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8085999999999998e-05 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465119+0000", 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002762029 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465240+0000", 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000120729 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1533 3.0 e27/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 27'45, mlcod=27'42)", 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.452454432, 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004605179, 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:23.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463279+0000", 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4619999999999999e-06 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463290+0000", 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1092e-05 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463310+0000", 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9647999999999999e-05 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463326+0000", 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5614e-05 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463402+0000", 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6174000000000006e-05 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463431+0000", 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8875999999999999e-05 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467839+0000", 2024-09-11T07:06:23.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044084079999999999 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467883+0000", 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3905000000000001e-05 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1537 3.0 e27/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 27'46, mlcod=27'42)", 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:23.972 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.451582339000002, 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037617390000000001, 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:23.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464151+0000", 2024-09-11T07:06:23.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.232e-06 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464161+0000", 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3479999999999993e-06 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464182+0000", 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1141999999999998e-05 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464193+0000", 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.163e-05 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464273+0000", 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9396999999999999e-05 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464300+0000", 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6811000000000001e-05 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467890+0000", 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003590626 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467912+0000", 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1552999999999998e-05 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.977 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1574 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'47, mlcod=27'45)", 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.535781+0000", 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 17.379951631000001, 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019771369999999999, 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535781+0000", 2024-09-11T07:06:23.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535781+0000", 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535783+0000", 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.283e-06 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535859+0000", 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6234000000000002e-05 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535903+0000", 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4091999999999997e-05 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.535927+0000", 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.366e-05 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.536069+0000", 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014184899999999999 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.536117+0000", 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.782e-05 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.537710+0000", 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001593061 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.537758+0000", 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8137999999999999e-05 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:3919 3.9 e30/21 3:906e061f:::rbd_data.11614fc4d54f.0000000000000041:head v 30'7, mlcod=25'5)", 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.203847+0000", 2024-09-11T07:06:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.711885619, 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025166630000000001, 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203847+0000", 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203847+0000", 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203848+0000", 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4e-07 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203954+0000", 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106536 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.203989+0000", 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4539999999999998e-05 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.204011+0000", 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.27e-05 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.204097+0000", 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5618000000000006e-05 2024-09-11T07:06:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.204120+0000", 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2976000000000002e-05 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.206319+0000", 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021993529999999998 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.206363+0000", 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3999999999999999e-05 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.0 epoch 33/21 rep_tid 136 entries 33'88 (0'0) error 3:00d3d0eb:::rbd_data.116153756644.0000000000000033:head by client.4449.0:8937 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 33'86)", 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.9125707789999993, 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026246419999999999, 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:06:23.987 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003163+0000", 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1009999999999999e-06 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003175+0000", 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2041999999999999e-05 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003197+0000", 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2286e-05 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003213+0000", 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6160000000000001e-05 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003315+0000", 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102329 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.005786+0000", 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024707240000000001 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.990 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:8976 3.9 e33/21 3:96232816:::rbd_data.116153756644.0000000000000043:head v 33'22, mlcod=33'20)", 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.021190+0000", 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.8945422539999992, 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023778330000000002, 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021190+0000", 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021190+0000", 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021191+0000", 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3039999999999999e-06 2024-09-11T07:06:23.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021199+0000", 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6799999999999993e-06 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021211+0000", 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2208000000000001e-05 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021219+0000", 2024-09-11T07:06:23.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8499999999999994e-06 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021318+0000", 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9077e-05 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.021337+0000", 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9174e-05 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.023526+0000", 2024-09-11T07:06:23.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021883670000000001 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.023568+0000", 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2172999999999998e-05 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:10198 3.0 e34/21 3:0497d956:::rbd_data.11612823e096.000000000000002a:head v 34'96, mlcod=33'94)", 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.884481+0000", 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0312508269999991, 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0019149029999999999, 2024-09-11T07:06:23.995 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884481+0000", 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884481+0000", 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884482+0000", 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4699999999999998e-07 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884537+0000", 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5723000000000002e-05 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884550+0000", 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2604e-05 2024-09-11T07:06:23.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884560+0000", 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7499999999999998e-06 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884654+0000", 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4252000000000005e-05 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:23.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.884676+0000", 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2052000000000002e-05 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.886357+0000", 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001681201 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.886396+0000", 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9073999999999999e-05 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:23.999 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:14563 3.4 e37/21 3:22c3ced6:::rbd_data.116120e0a896.000000000000011a:head v 37'45, mlcod=37'43)", 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:18.758343+0000", 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.15738962, 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0020331490000000002, 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758343+0000", 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758343+0000", 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758344+0000", 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6029999999999999e-06 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758377+0000", 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2546999999999999e-05 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758402+0000", 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5040000000000001e-05 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758414+0000", 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1630999999999999e-05 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758538+0000", 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000124888 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.758604+0000", 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5380000000000001e-05 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.760332+0000", 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0017281900000000001 2024-09-11T07:06:24.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.760376+0000", 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3869999999999998e-05 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:17025 3.0 e37/21 3:075df309:::rbd_data.116120e0a896.000000000000002c:head v 37'115, mlcod=37'113)", 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:18.985994+0000", 2024-09-11T07:06:24.004 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.9297387380000002, 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0018807229999999999, 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.985994+0000", 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.985994+0000", 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.985995+0000", 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.986271+0000", 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000276452 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.986288+0000", 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7234000000000001e-05 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.986296+0000", 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9070000000000007e-06 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.986358+0000", 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1587999999999994e-05 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.986377+0000", 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8841000000000001e-05 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.987808+0000", 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0014313920000000001 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:18.987874+0000", 2024-09-11T07:06:24.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6146e-05 2024-09-11T07:06:24.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.009 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:24.011 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:24.012 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:06:24.012 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:24.006+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:24.088 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone10 from 0xec92766 (overlap 0x17a0452) to 0x25cd3b 2024-09-11T07:06:24.111 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:24.112+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:24.191 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:24.191 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:24.206 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:24.212 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:24.210+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:24.239 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #9, image image_client.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent10 2024-09-11T07:06:24.242 INFO:teuthology.orchestra.run.smithi079.stdout:1527 punch from 0x154ee8a to 0x1559cb6, (0xae2c bytes) 2024-09-11T07:06:24.273 INFO:teuthology.orchestra.run.smithi079.stdout:1528 trunc from 0xec92766 to 0xc14b1e 2024-09-11T07:06:24.313 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:24.310+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:24.373 INFO:teuthology.orchestra.run.smithi079.stdout:1529 writesame 0xb90e160 thru 0xb91b3ff data_size 0x50(0xd2a0 bytes) 2024-09-11T07:06:24.374 INFO:teuthology.orchestra.run.smithi079.stdout:1530 read 0xa3c92a4 thru 0xa3d8736 (0xf493 bytes) 2024-09-11T07:06:24.374 INFO:teuthology.orchestra.run.smithi079.stdout:1531 trunc from 0xb91b400 to 0xaff378b 2024-09-11T07:06:24.383 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:24.383 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:24.384 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:24.384 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:24.384 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:24.396 INFO:teuthology.orchestra.run.smithi079.stdout:1533 trunc from 0xaff378b to 0x21a67f5 2024-09-11T07:06:24.406 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:24.414 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:24.410+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:24.416 INFO:teuthology.orchestra.run.smithi079.stdout:1534 write 0x37c6d3b thru 0x37ca22c (0x34f2 bytes) 2024-09-11T07:06:24.429 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:24.429 INFO:teuthology.orchestra.run.smithi079.stdout:1537 punch from 0x26d9d3d to 0x26e21a8, (0x846b bytes) 2024-09-11T07:06:24.429 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:24.429 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:24.444 INFO:teuthology.orchestra.run.smithi079.stdout:1541 trunc from 0x37ca22d to 0xdafe140 2024-09-11T07:06:24.451 INFO:teuthology.orchestra.run.smithi079.stdout:1542 write 0x9876acb thru 0x987d830 (0x6d66 bytes) 2024-09-11T07:06:24.464 INFO:teuthology.orchestra.run.smithi079.stdout:1543 write 0x58b24d2 thru 0x58c0543 (0xe072 bytes) 2024-09-11T07:06:24.476 INFO:teuthology.orchestra.run.smithi079.stdout:1544 read 0xcbc749 thru 0xcc80ea (0xb9a2 bytes) 2024-09-11T07:06:24.480 INFO:teuthology.orchestra.run.smithi079.stdout:1545 flatten 2024-09-11T07:06:24.515 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:24.516+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:24.581 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:24.581 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:24.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:24.582 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:24.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.582 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6914 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4472832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.582 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:24.582 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.905154445999999, 2024-09-11T07:06:24.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030418942000000001, 2024-09-11T07:06:24.582 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.582 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.582 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6914 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4799999999999998e-07 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675891+0000", 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5150000000000001e-06 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675898+0000", 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9040000000000003e-06 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675903+0000", 2024-09-11T07:06:24.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6180000000000003e-06 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706154+0000", 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030250969999999999 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706235+0000", 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0343e-05 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706307+0000", 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1944000000000001e-05 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6915 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.905131706000001, 2024-09-11T07:06:24.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030587597000000001, 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6915 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676263+0000", 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035270599999999999 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676268+0000", 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0860000000000001e-06 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676280+0000", 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1863e-05 2024-09-11T07:06:24.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676288+0000", 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5599999999999996e-06 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706353+0000", 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030065614000000001 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706438+0000", 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5041000000000001e-05 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706498+0000", 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9726999999999999e-05 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6916 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5226496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676301+0000", 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.904741238, 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030333954, 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6916 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676301+0000", 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676301+0000", 2024-09-11T07:06:24.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676302+0000", 2024-09-11T07:06:24.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6000000000000003e-07 2024-09-11T07:06:24.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676304+0000", 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6460000000000002e-06 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676312+0000", 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2919999999999998e-06 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676317+0000", 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4029999999999998e-06 2024-09-11T07:06:24.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706528+0000", 2024-09-11T07:06:24.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030211407999999999 2024-09-11T07:06:24.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706573+0000", 2024-09-11T07:06:24.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5037999999999998e-05 2024-09-11T07:06:24.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706635+0000", 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1507000000000006e-05 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6917 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5341184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.598 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.904717491, 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030468918000000001, 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6917 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.599 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0500000000000003e-07 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676328+0000", 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3980000000000002e-06 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676335+0000", 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2649999999999999e-06 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676340+0000", 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4809999999999997e-06 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706664+0000", 2024-09-11T07:06:24.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030323033999999999 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706731+0000", 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7639999999999996e-05 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706794+0000", 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2495000000000004e-05 2024-09-11T07:06:24.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6918 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5455872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.904694430999999, 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594758999999999, 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.604 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6918 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-07 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676350+0000", 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0940000000000002e-06 2024-09-11T07:06:24.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676357+0000", 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5699999999999998e-06 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676362+0000", 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706819+0000", 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456987000000001 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706885+0000", 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6054000000000001e-05 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706943+0000", 2024-09-11T07:06:24.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7556000000000003e-05 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6919 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.904672679000001, 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030730071000000001, 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.609 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6919 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676595+0000", 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225577 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676599+0000", 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3540000000000002e-06 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676611+0000", 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1037e-05 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676618+0000", 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4050000000000003e-06 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706966+0000", 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030348373000000001 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707032+0000", 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5736999999999998e-05 2024-09-11T07:06:24.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707100+0000", 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7588000000000004e-05 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6920 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6209536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:24.614 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.904412090999999, 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030647992999999998, 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6920 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676631+0000", 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999999e-07 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676633+0000", 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.729e-06 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676641+0000", 2024-09-11T07:06:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7659999999999998e-06 2024-09-11T07:06:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676647+0000", 2024-09-11T07:06:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7930000000000003e-06 2024-09-11T07:06:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707128+0000", 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030481028 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707211+0000", 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2792000000000003e-05 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707278+0000", 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7288999999999999e-05 2024-09-11T07:06:24.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6921 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6324224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.904386662, 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030787063999999999, 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.620 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6921 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7700000000000004e-07 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676660+0000", 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.997e-06 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676667+0000", 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2910000000000002e-06 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676673+0000", 2024-09-11T07:06:24.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6010000000000002e-06 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707305+0000", 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030632029000000002 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707380+0000", 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5265999999999994e-05 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707443+0000", 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2303000000000003e-05 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6922 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6438912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.904361135, 2024-09-11T07:06:24.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031018718000000001, 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6922 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676852+0000", 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000171371 2024-09-11T07:06:24.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676857+0000", 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6380000000000003e-06 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676867+0000", 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0268000000000001e-05 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676875+0000", 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5320000000000001e-06 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707469+0000", 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030593615000000001 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707632+0000", 2024-09-11T07:06:24.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016336399999999999 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707700+0000", 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7929999999999995e-05 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6923 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6553600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.630 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.904154906, 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030968105999999999, 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6923 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.631 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676888+0000", 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7000000000000005e-07 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676895+0000", 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1110000000000002e-06 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676902+0000", 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2030000000000003e-06 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676908+0000", 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6200000000000004e-06 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707728+0000", 2024-09-11T07:06:24.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030820163000000001 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707797+0000", 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8737000000000003e-05 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707855+0000", 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8702000000000001e-05 2024-09-11T07:06:24.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6924 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7192576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.904125575, 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031099157999999998, 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.636 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6924 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4000000000000001e-07 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676921+0000", 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6899999999999998e-06 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676928+0000", 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8260000000000004e-06 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676933+0000", 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3109999999999996e-06 2024-09-11T07:06:24.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707879+0000", 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030946265000000001 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707946+0000", 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6365000000000006e-05 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708016+0000", 2024-09-11T07:06:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0061000000000006e-05 2024-09-11T07:06:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6925 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.90409972, 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.03121956, 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.642 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6925 2024-09-11T07:06:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676996+0000", 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3483000000000003e-05 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677000+0000", 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1840000000000001e-06 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677009+0000", 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2390000000000008e-06 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677016+0000", 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0600000000000002e-06 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708042+0000", 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031025569999999999 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708106+0000", 2024-09-11T07:06:24.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3723e-05 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708162+0000", 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6301000000000002e-05 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.647 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7045 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5472256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.899088163, 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456286999999999, 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7045 2024-09-11T07:06:24.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:24.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682107+0000", 2024-09-11T07:06:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015256800000000001 2024-09-11T07:06:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682111+0000", 2024-09-11T07:06:24.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0450000000000002e-06 2024-09-11T07:06:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682120+0000", 2024-09-11T07:06:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6569999999999992e-06 2024-09-11T07:06:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682127+0000", 2024-09-11T07:06:24.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6239999999999996e-06 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712254+0000", 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030127068 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712333+0000", 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8788999999999994e-05 2024-09-11T07:06:24.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712410+0000", 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7535999999999998e-05 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7046 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5586944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.653 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.898903576, 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030486447, 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7046 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.654 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5400000000000001e-07 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682142+0000", 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7429999999999998e-06 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682149+0000", 2024-09-11T07:06:24.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3209999999999999e-06 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682155+0000", 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7620000000000001e-06 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712454+0000", 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030298814 2024-09-11T07:06:24.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712563+0000", 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010932 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712625+0000", 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1933000000000005e-05 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7047 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.898879525, 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030677043000000001, 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.659 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7047 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682532+0000", 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036941099999999999 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682537+0000", 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2469999999999999e-06 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682547+0000", 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9000000000000001e-06 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682554+0000", 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2060000000000001e-06 2024-09-11T07:06:24.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712666+0000", 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030111422999999998 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712761+0000", 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5212999999999998e-05 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712840+0000", 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8642999999999999e-05 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7048 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6340608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:24.664 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.898474353999999, 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494950999999999, 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7048 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:24.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7299999999999996e-07 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682571+0000", 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7760000000000002e-06 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682577+0000", 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0209999999999996e-06 2024-09-11T07:06:24.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682584+0000", 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8630000000000002e-06 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712904+0000", 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030320347000000001 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712987+0000", 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2367000000000006e-05 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713063+0000", 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6003999999999999e-05 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7049 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6455296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.898449703000001, 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030670962999999999, 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.670 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7049 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:24.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7199999999999999e-07 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682596+0000", 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5189999999999999e-06 2024-09-11T07:06:24.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682602+0000", 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7240000000000003e-06 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682607+0000", 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2410000000000003e-06 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713102+0000", 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494841000000002 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713189+0000", 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6697e-05 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713263+0000", 2024-09-11T07:06:24.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4468999999999995e-05 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7050 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6569984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.898426142, 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030850200000000001, 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.675 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7050 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682617+0000", 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682619+0000", 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2450000000000001e-06 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682627+0000", 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0520000000000002e-06 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682632+0000", 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2750000000000003e-06 2024-09-11T07:06:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713310+0000", 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030678305999999999 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713391+0000", 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0164e-05 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713466+0000", 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5703000000000003e-05 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7051 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6684672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.898402616, 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030997008, 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7051 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682684+0000", 2024-09-11T07:06:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4625e-05 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682695+0000", 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0575e-05 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682703+0000", 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1389999999999995e-06 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682709+0000", 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713498+0000", 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030789092000000001 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713571+0000", 2024-09-11T07:06:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2554999999999999e-05 2024-09-11T07:06:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713637+0000", 2024-09-11T07:06:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5950000000000004e-05 2024-09-11T07:06:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7052 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.898323429, 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031135348, 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7052 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683050+0000", 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033088699999999998 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683054+0000", 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.651e-06 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683066+0000", 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1372000000000001e-05 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683074+0000", 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5939999999999994e-06 2024-09-11T07:06:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713669+0000", 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594982 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713786+0000", 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116937 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713854+0000", 2024-09-11T07:06:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7924999999999998e-05 2024-09-11T07:06:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:24.694 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:24.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:24.697 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:24.694+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:24.797 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:24.794+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:24.803 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:24.803 INFO:teuthology.orchestra.run.smithi079.stdout:1549 read 0x40c9a53 thru 0x40d2c1b (0x91c9 bytes) 2024-09-11T07:06:24.817 INFO:teuthology.orchestra.run.smithi079.stdout:1550 trunc from 0xdafe140 to 0x591a0e5 2024-09-11T07:06:24.835 INFO:teuthology.orchestra.run.smithi079.stdout:1551 clone 12 order 18 su 2048 sc 6 2024-09-11T07:06:24.847 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:24.847 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:24.847 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:24.847 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:24.860 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:24.903 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:24.902+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:24.999 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:24.994+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:25.031 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:25.031 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:25.031 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:25.031 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:25.031 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:25.046 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:25.099 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:25.100+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:25.190 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:25.201 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:25.198+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:25.219 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:25.219 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:25.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:25.219 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:25.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.220 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.220 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:25.220 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.92976152300000003, 2024-09-11T07:06:25.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:06:25.220 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.220 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.220 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.220 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:06:25.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:06:25.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.92968943999999998, 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.225 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:06:25.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:25.229 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.92963394700000002, 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:25.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:06:25.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:06:25.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:06:25.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:06:25.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:06:25.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:06:25.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:06:25.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:06:25.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:06:25.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:06:25.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:06:25.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:06:25.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72776197899999995, 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.235 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:06:25.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72769938899999997, 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.240 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:06:25.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72764233300000003, 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.244 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.245 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.245 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.245 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.245 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.245 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:06:25.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.245 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:06:25.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:06:25.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:06:25.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:06:25.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:06:25.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:06:25.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:06:25.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:06:25.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72758621599999995, 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.250 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:25.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:25.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:06:25.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.254 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.727464954, 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:06:25.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.256 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:25.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:25.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:06:25.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:06:25.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:06:25.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:06:25.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:06:25.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72736068499999995, 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.261 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:06:25.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:06:25.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:06:25.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:06:25.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72725514599999996, 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:25.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:25.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:06:25.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:06:25.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:06:25.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:06:25.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:06:25.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.271 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72718798299999998, 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:06:25.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:06:25.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:06:25.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:06:25.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.274 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72708877699999996, 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:06:25.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72700181799999997, 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.281 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:06:25.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:06:25.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:06:25.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:25.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:06:25.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:06:25.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:06:25.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:06:25.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72694154099999997, 2024-09-11T07:06:25.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:25.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:06:25.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72678783599999996, 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.291 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:25.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:06:25.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:06:25.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:06:25.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72670066, 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.296 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.300 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72663675699999997, 2024-09-11T07:06:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:06:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.301 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:06:25.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:06:25.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:06:25.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:06:25.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:06:25.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.306 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.306 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.306 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:25.307 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72657691400000002, 2024-09-11T07:06:25.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:06:25.307 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.307 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.307 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.308 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:06:25.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.308 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:25.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:06:25.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:06:25.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:06:25.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:06:25.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:06:25.314 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.314 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.314 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.314 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.314 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:25.314 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72649883199999998, 2024-09-11T07:06:25.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:06:25.315 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.315 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.315 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.315 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.315 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.315 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.316 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:06:25.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.316 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:25.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:25.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:06:25.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.320 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:25.321 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:25.321 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.72644106200000003, 2024-09-11T07:06:25.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:06:25.321 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:25.321 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:25.321 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:25.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:25.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:25.321 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:25.322 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:06:25.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.322 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:25.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:25.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:25.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:25.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:25.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:25.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:25.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:06:25.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:06:25.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:25.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:06:25.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:06:25.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:25.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:06:25.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:06:25.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:25.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:06:25.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:06:25.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:25.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:06:25.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:06:25.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:25.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:06:25.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:06:25.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:25.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:25.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:25.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:06:25.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:06:25.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.330 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:25.330 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:25.330 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:25.334 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:25.335 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:25.330+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:25.335 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #10, image image_client.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent11 2024-09-11T07:06:25.335 INFO:teuthology.orchestra.run.smithi079.stdout:1552 writesame 0x99cf535 thru 0x99d1ea3 data_size 0x1(0x296f bytes) 2024-09-11T07:06:25.336 INFO:teuthology.orchestra.run.smithi079.stdout:1553 write 0x5a99594 thru 0x5aa8459 (0xeec6 bytes) 2024-09-11T07:06:25.336 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:25.336 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:25.336 INFO:teuthology.orchestra.run.smithi079.stdout:1557 write 0xdcdd3a thru 0xddceac (0xf173 bytes) 2024-09-11T07:06:25.336 INFO:teuthology.orchestra.run.smithi079.stdout:1558 read 0x33896bd thru 0x33952b9 (0xbbfd bytes) 2024-09-11T07:06:25.336 INFO:teuthology.orchestra.run.smithi079.stdout:1559 write 0x5fb1f8e thru 0x5fb7a3a (0x5aad bytes) 2024-09-11T07:06:25.336 INFO:teuthology.orchestra.run.smithi079.stdout:1562 read 0x4c1aa4b thru 0x4c23def (0x93a5 bytes) 2024-09-11T07:06:25.337 INFO:teuthology.orchestra.run.smithi079.stdout:1563 trunc from 0x99d1ea4 to 0x6f759e4 2024-09-11T07:06:25.347 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:25.356 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:25.356 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:25.359 INFO:teuthology.orchestra.run.smithi079.stdout:1569 write 0xa192537 thru 0xa193bbe (0x1688 bytes) 2024-09-11T07:06:25.369 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:25.369 INFO:teuthology.orchestra.run.smithi079.stdout:1571 write 0x314121b thru 0x3143d08 (0x2aee bytes) 2024-09-11T07:06:25.376 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:25.376 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:25.381 INFO:teuthology.orchestra.run.smithi079.stdout:1573 read 0x3bbcd4d thru 0x3bcadae (0xe062 bytes) 2024-09-11T07:06:25.381 INFO:teuthology.orchestra.run.smithi079.stdout:1576 write 0x3a4be0b thru 0x3a4cff8 (0x11ee bytes) 2024-09-11T07:06:25.390 INFO:teuthology.orchestra.run.smithi079.stdout:1578 trunc from 0xa193bbf to 0x8c3d3c1 2024-09-11T07:06:25.396 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:25.396 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:25.410 INFO:teuthology.orchestra.run.smithi079.stdout:1579 writesame 0x90c6fbb thru 0x90d5cb6 data_size 0x3a(0xecfc bytes) 2024-09-11T07:06:25.410 INFO:teuthology.orchestra.run.smithi079.stdout:1580 write 0x8a0ac24 thru 0x8a0b655 (0xa32 bytes) 2024-09-11T07:06:25.415 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:25.415 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:1581 clone 13 order 21 su 131072 sc 14 2024-09-11T07:06:25.432 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:25.433 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:25.433 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:25.432+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:25.450 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:25.450 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:25.469 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:25.469 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:25.487 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:25.488 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:25.513 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:25.513 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:25.522 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:06:25.523 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:06:25.523 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T07:06:25.523 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 0.000000 2024-09-11T07:06:25.524 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 0 2024-09-11T07:06:25.527 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:25.547 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:25.548+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:25.634 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:25.630+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:25.649 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:25.650 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:25.664 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:25.752 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:25.750+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:25.829 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:25.829 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:25.836 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:25.834+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:25.842 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:25.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:25.936+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:25.957 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.6 primary-affinity to 0 (802) 2024-09-11T07:06:26.012 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:06:26.013 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:26.013 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:26.027 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:26.071 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:26.072+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:26.140 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:26.140+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:26.147 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:26.147 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:26.162 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:26.241 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:26.240+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:26.278 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:26.278 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:26.293 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:26.344 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:26.338+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:26.409 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:26.410 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:26.423 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:26.468 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:26.466+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:26.545 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:26.542+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:26.592 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:26.592 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:26.607 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:26.646 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:26.643+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:26.748 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:26.742+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:26.772 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:26.773 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:26.786 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:26.847 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:26.846+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:26.918 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:26.918 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:26.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:26.949 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:26.946+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:26.949 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:06:27.014 INFO:teuthology.orchestra.run.smithi079.stdout:leaving image image_client.0-clone12 intact 2024-09-11T07:06:27.049 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:27.047+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:27.064 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:27.065 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:27.081 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:27.150 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:27.146+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:27.164 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #11, image image_client.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent12 2024-09-11T07:06:27.252 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:27.252 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:27.252 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:27.250+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:27.266 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:27.353 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:27.350+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:27.387 INFO:teuthology.orchestra.run.smithi079.stdout:1582 write 0xba724df thru 0xba800e3 (0xdc05 bytes) 2024-09-11T07:06:27.394 INFO:teuthology.orchestra.run.smithi079.stdout:1584 read 0x91b2905 thru 0x91ba37f (0x7a7b bytes) 2024-09-11T07:06:27.394 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:27.394 INFO:teuthology.orchestra.run.smithi079.stdout:1586 writesame 0xb77a2fd thru 0xb78a1d3 data_size 0x1(0xfed7 bytes) 2024-09-11T07:06:27.430 INFO:teuthology.orchestra.run.smithi079.stdout:1587 writesame 0x519c502 thru 0x51aba35 data_size 0x6(0xf534 bytes) 2024-09-11T07:06:27.443 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:27.443 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:27.453 INFO:teuthology.orchestra.run.smithi079.stdout:1588 read 0x704f457 thru 0x705bb19 (0xc6c3 bytes) 2024-09-11T07:06:27.453 INFO:teuthology.orchestra.run.smithi079.stdout:1589 read 0x6d5cb8 thru 0x6db6c9 (0x5a12 bytes) 2024-09-11T07:06:27.453 INFO:teuthology.orchestra.run.smithi079.stdout:1590 read 0x1e012d7 thru 0x1e08893 (0x75bd bytes) 2024-09-11T07:06:27.453 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:27.455 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:27.450+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:27.461 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:27.466 INFO:teuthology.orchestra.run.smithi079.stdout:1593 trunc from 0xba800e4 to 0x29601cf 2024-09-11T07:06:27.505 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:27.534 INFO:teuthology.orchestra.run.smithi079.stdout:1594 write 0x1894369 thru 0x18a34fd (0xf195 bytes) 2024-09-11T07:06:27.556 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:27.555+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:27.563 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:27.564 INFO:teuthology.orchestra.run.smithi079.stdout:1599 trunc from 0x29601cf to 0x1e83a0a 2024-09-11T07:06:27.601 INFO:teuthology.orchestra.run.smithi079.stdout:1601 writesame 0x6014ba1 thru 0x6014d4b data_size 0x1(0x1ab bytes) 2024-09-11T07:06:27.602 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:27.602 INFO:teuthology.orchestra.run.smithi079.stdout:1605 punch from 0x25d4729 to 0x25dd9e8, (0x92bf bytes) 2024-09-11T07:06:27.602 INFO:teuthology.orchestra.run.smithi079.stdout:1607 punch from 0x308d121 to 0x3096e92, (0x9d71 bytes) 2024-09-11T07:06:27.602 INFO:teuthology.orchestra.run.smithi079.stdout:1608 punch from 0x48dbc32 to 0x48e16f3, (0x5ac1 bytes) 2024-09-11T07:06:27.602 INFO:teuthology.orchestra.run.smithi079.stdout:1609 read 0x3f3727 thru 0x400df9 (0xd6d3 bytes) 2024-09-11T07:06:27.603 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:27.603 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:27.610 INFO:teuthology.orchestra.run.smithi079.stdout:1610 trunc from 0x6014d4c to 0xaa4b392 2024-09-11T07:06:27.620 INFO:teuthology.orchestra.run.smithi079.stdout:1611 write 0x8a6e8cd thru 0x8a7147b (0x2baf bytes) 2024-09-11T07:06:27.624 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:27.626 INFO:teuthology.orchestra.run.smithi079.stdout:1612 write 0x5350d3e thru 0x535a4b7 (0x977a bytes) 2024-09-11T07:06:27.631 INFO:teuthology.orchestra.run.smithi079.stdout:1613 read 0x85a2121 thru 0x85a2cbe (0xb9e bytes) 2024-09-11T07:06:27.647 INFO:teuthology.orchestra.run.smithi079.stdout:1614 writesame 0xe485e6b thru 0xe488b99 data_size 0x1(0x2d2f bytes) 2024-09-11T07:06:27.647 INFO:teuthology.orchestra.run.smithi079.stdout:1615 read 0xad02f6d thru 0xad129d9 (0xfa6d bytes) 2024-09-11T07:06:27.647 INFO:teuthology.orchestra.run.smithi079.stdout:1616 write 0x4231999 thru 0x423537f (0x39e7 bytes) 2024-09-11T07:06:27.651 INFO:teuthology.orchestra.run.smithi079.stdout:1617 write 0x16fa535 thru 0x16ffc12 (0x56de bytes) 2024-09-11T07:06:27.655 INFO:teuthology.orchestra.run.smithi079.stdout:1618 read 0xa8461d0 thru 0xa853133 (0xcf64 bytes) 2024-09-11T07:06:27.655 INFO:teuthology.orchestra.run.smithi079.stdout:1619 read 0x571930c thru 0x5723adc (0xa7d1 bytes) 2024-09-11T07:06:27.656 INFO:teuthology.orchestra.run.smithi079.stdout:1620 flatten 2024-09-11T07:06:27.656 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:27.655+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:27.666 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:27.666 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:27.690 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:27.690 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:27.710 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:27.711 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:27.732 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:27.733 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:27.754 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:27.755 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:27.757 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:27.755+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:27.774 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26446 3.0 3:031d7ddd:::rbd_header.116133a8c376:head [watch reconnect cookie 140190886679664 gen 1] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.510746+0000", 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.264056949, 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033021625999999998, 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26446 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510746+0000", 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510746+0000", 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510746+0000", 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.58e-07 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510749+0000", 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4029999999999999e-06 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510759+0000", 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2839999999999995e-06 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510765+0000", 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9710000000000001e-06 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538517+0000", 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.027752142 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538566+0000", 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9243999999999998e-05 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.543767+0000", 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0052011239999999997 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.779 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26519 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 38912~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.510848+0000", 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2639545500000002, 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028830589, 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26519 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.780 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510848+0000", 2024-09-11T07:06:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510848+0000", 2024-09-11T07:06:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510849+0000", 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2099999999999997e-07 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510851+0000", 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5380000000000001e-06 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510860+0000", 2024-09-11T07:06:27.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5499999999999995e-06 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510866+0000", 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0700000000000003e-06 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.539493+0000", 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028627264999999999 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.539578+0000", 2024-09-11T07:06:27.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4643999999999998e-05 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.539679+0000", 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000101001 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26520 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 51200~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.510874+0000", 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2639289439999999, 2024-09-11T07:06:27.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.028998233000000002, 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26520 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510874+0000", 2024-09-11T07:06:27.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510874+0000", 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510874+0000", 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6499999999999999e-07 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510877+0000", 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3020000000000002e-06 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510885+0000", 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9849999999999995e-06 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510891+0000", 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6659999999999996e-06 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.539703+0000", 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.02881218 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.539779+0000", 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5321000000000006e-05 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.539872+0000", 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3214000000000006e-05 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.788 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26521 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 63488~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.510898+0000", 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2639042800000002, 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.02922141, 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.789 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26521 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510898+0000", 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510898+0000", 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510899+0000", 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.27e-07 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510901+0000", 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5320000000000001e-06 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510909+0000", 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4259999999999997e-06 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510914+0000", 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7559999999999996e-06 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.539926+0000", 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029011761 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540020+0000", 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4197999999999995e-05 2024-09-11T07:06:27.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540120+0000", 2024-09-11T07:06:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9309999999999996e-05 2024-09-11T07:06:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.793 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26522 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 75776~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.510922+0000", 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.263880941, 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029329345999999999, 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26522 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510922+0000", 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510922+0000", 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510922+0000", 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9699999999999996e-07 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510929+0000", 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6880000000000002e-06 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510937+0000", 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6990000000000003e-06 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510943+0000", 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0000000000000002e-06 2024-09-11T07:06:27.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540152+0000", 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029209161000000001 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540195+0000", 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3535000000000002e-05 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540251+0000", 2024-09-11T07:06:27.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5766000000000001e-05 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26523 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 88064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.510953+0000", 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2638493569999998, 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029434979999999999, 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.798 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26523 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510953+0000", 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510953+0000", 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510954+0000", 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9399999999999995e-07 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510956+0000", 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4219999999999999e-06 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510965+0000", 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1209999999999996e-06 2024-09-11T07:06:27.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510971+0000", 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1399999999999997e-06 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540287+0000", 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029315847999999999 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540332+0000", 2024-09-11T07:06:27.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4555999999999998e-05 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540388+0000", 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6399e-05 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26524 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.510979+0000", 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2638237430000001, 2024-09-11T07:06:27.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029528513999999999, 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26524 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510979+0000", 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510979+0000", 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510979+0000", 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.58e-07 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510982+0000", 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5940000000000001e-06 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510991+0000", 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9020000000000005e-06 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.510997+0000", 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8850000000000004e-06 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540415+0000", 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029418242000000001 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540457+0000", 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1727000000000002e-05 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540507+0000", 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0705999999999999e-05 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.806 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26525 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511004+0000", 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2637982679999999, 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029672258999999999, 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26525 2024-09-11T07:06:27.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511004+0000", 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511004+0000", 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511005+0000", 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5999999999999999e-07 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511007+0000", 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4420000000000001e-06 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511016+0000", 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6810000000000004e-06 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511040+0000", 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.438e-05 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540542+0000", 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029501553 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540619+0000", 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7453999999999994e-05 2024-09-11T07:06:27.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540677+0000", 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7289e-05 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26526 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511050+0000", 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2637528690000002, 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029814831999999999, 2024-09-11T07:06:27.811 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26526 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511050+0000", 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511050+0000", 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511050+0000", 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7100000000000002e-07 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511053+0000", 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8499999999999998e-06 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511066+0000", 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3084999999999999e-05 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511073+0000", 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6329999999999999e-06 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540704+0000", 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029631528000000001 2024-09-11T07:06:27.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540776+0000", 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1286999999999997e-05 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540865+0000", 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8877999999999998e-05 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26527 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511081+0000", 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2637212679999998, 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029969573999999999, 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26527 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511081+0000", 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511081+0000", 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511082+0000", 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7e-07 2024-09-11T07:06:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511085+0000", 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1080000000000001e-06 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511093+0000", 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7749999999999993e-06 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511109+0000", 2024-09-11T07:06:27.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6696000000000001e-05 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540894+0000", 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029784418 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.540968+0000", 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3883999999999999e-05 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541051+0000", 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3222999999999999e-05 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26528 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511119+0000", 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2636834850000001, 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030076539999999999, 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.820 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26528 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511119+0000", 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511119+0000", 2024-09-11T07:06:27.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511120+0000", 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6700000000000003e-07 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511122+0000", 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7300000000000001e-06 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511130+0000", 2024-09-11T07:06:27.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9440000000000005e-06 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511137+0000", 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8369999999999999e-06 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541080+0000", 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.029942521 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541127+0000", 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7259000000000003e-05 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541196+0000", 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8682000000000004e-05 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26529 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.824 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511145+0000", 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2636573869999999, 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030207590999999999, 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26529 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511145+0000", 2024-09-11T07:06:27.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511145+0000", 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511146+0000", 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0100000000000005e-07 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511148+0000", 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7010000000000001e-06 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511156+0000", 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.447e-06 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511170+0000", 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4070000000000001e-05 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541225+0000", 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030054672000000001 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541269+0000", 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4279000000000001e-05 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541353+0000", 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3920999999999998e-05 2024-09-11T07:06:27.828 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26530 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511179+0000", 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.263623967, 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030364889999999999, 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.829 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26530 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511179+0000", 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511179+0000", 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511179+0000", 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8899999999999999e-07 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511182+0000", 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8200000000000001e-06 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511190+0000", 2024-09-11T07:06:27.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0150000000000003e-06 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511198+0000", 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6399999999999997e-06 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541382+0000", 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030184328 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541458+0000", 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5965999999999997e-05 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541544+0000", 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5531999999999994e-05 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26531 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.833 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511205+0000", 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.263597152, 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030522976, 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26531 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511205+0000", 2024-09-11T07:06:27.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511205+0000", 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511206+0000", 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4099999999999999e-07 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511208+0000", 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3760000000000002e-06 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511217+0000", 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7469999999999994e-06 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511223+0000", 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.716e-06 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541572+0000", 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030348868000000001 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541646+0000", 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4196999999999995e-05 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541728+0000", 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2531e-05 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.837 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26532 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511231+0000", 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2635719459999999, 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030632197, 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.838 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26532 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511231+0000", 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511231+0000", 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511231+0000", 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1600000000000001e-07 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511234+0000", 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5670000000000002e-06 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511243+0000", 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7849999999999997e-06 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511249+0000", 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3130000000000004e-06 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541758+0000", 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030509461000000002 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541810+0000", 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1508000000000002e-05 2024-09-11T07:06:27.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541863+0000", 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3047000000000002e-05 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26533 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511257+0000", 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2635459139999998, 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030752603, 2024-09-11T07:06:27.842 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26533 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511257+0000", 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511257+0000", 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511257+0000", 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7700000000000005e-07 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511260+0000", 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3970000000000001e-06 2024-09-11T07:06:27.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511268+0000", 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3350000000000007e-06 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511274+0000", 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6350000000000003e-06 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541889+0000", 2024-09-11T07:06:27.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030615608999999998 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.541951+0000", 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1682999999999999e-05 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542009+0000", 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8467000000000001e-05 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26534 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511281+0000", 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2635210940000001, 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031010469999999998, 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26534 2024-09-11T07:06:27.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511281+0000", 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511281+0000", 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511282+0000", 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9900000000000001e-07 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511290+0000", 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1820000000000006e-06 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511299+0000", 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2650000000000002e-06 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511305+0000", 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7440000000000004e-06 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542096+0000", 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030791276999999999 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542175+0000", 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8685999999999998e-05 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542292+0000", 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116817 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26535 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511314+0000", 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.263489034, 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031115278, 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26535 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511314+0000", 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511314+0000", 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511314+0000", 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2e-07 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511317+0000", 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4559999999999999e-06 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511324+0000", 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1670000000000002e-06 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511329+0000", 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2050000000000001e-06 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542317+0000", 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030988460999999998 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542363+0000", 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5377000000000003e-05 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542429+0000", 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6092000000000004e-05 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.855 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26536 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511337+0000", 2024-09-11T07:06:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.263465734, 2024-09-11T07:06:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031274753000000002, 2024-09-11T07:06:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.856 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26536 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511337+0000", 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511337+0000", 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511337+0000", 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1699999999999998e-07 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511340+0000", 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.543e-06 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511347+0000", 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2559999999999996e-06 2024-09-11T07:06:27.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511353+0000", 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542462+0000", 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031108971999999999 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542506+0000", 2024-09-11T07:06:27.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3773000000000003e-05 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542612+0000", 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105812 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:26537 3.0 3:04da814b:::rbd_data.1161cd812748.0000000000000007:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.511361+0000", 2024-09-11T07:06:27.860 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.2634415059999999, 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031474092000000002, 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 26537 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511361+0000", 2024-09-11T07:06:27.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511361+0000", 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511362+0000", 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2300000000000001e-07 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:27.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511371+0000", 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8330000000000006e-06 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511381+0000", 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1330000000000005e-06 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.511386+0000", 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9329999999999998e-06 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:27.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542692+0000", 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031305789000000001 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542741+0000", 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9017999999999997e-05 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.542835+0000", 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3863000000000006e-05 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.864 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:27.865 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:27.865 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:27.865 INFO:teuthology.orchestra.run.smithi079.stdout:1621 trunc from 0xe488b9a to 0x3e7d31f 2024-09-11T07:06:27.865 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:27.866 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:27.867 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:27.867 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:27.867 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:27.868 INFO:teuthology.orchestra.run.smithi079.stdout:1622 write 0xe9ed90e thru 0xe9fc7c3 (0xeeb6 bytes) 2024-09-11T07:06:27.868 INFO:teuthology.orchestra.run.smithi079.stdout:1624 punch from 0xe309783 to 0xe30f156, (0x59d3 bytes) 2024-09-11T07:06:27.868 INFO:teuthology.orchestra.run.smithi079.stdout:1625 read 0x9dd6c5e thru 0x9dd8502 (0x18a5 bytes) 2024-09-11T07:06:27.868 INFO:teuthology.orchestra.run.smithi079.stdout:1627 read 0x8fb001e thru 0x8fb52a4 (0x5287 bytes) 2024-09-11T07:06:27.868 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:27.869 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:27.869 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:27.870 INFO:teuthology.orchestra.run.smithi079.stdout:1630 trunc from 0xe9fc7c4 to 0xd283910 2024-09-11T07:06:27.870 INFO:teuthology.orchestra.run.smithi079.stdout:1632 read 0x6789e41 thru 0x6795a39 (0xbbf9 bytes) 2024-09-11T07:06:27.870 INFO:teuthology.orchestra.run.smithi079.stdout:1633 write 0x4883625 thru 0x4886bd3 (0x35af bytes) 2024-09-11T07:06:27.873 INFO:teuthology.orchestra.run.smithi079.stdout:1635 read 0x398becf thru 0x398eda7 (0x2ed9 bytes) 2024-09-11T07:06:27.873 INFO:teuthology.orchestra.run.smithi079.stdout:1636 trunc from 0xd283910 to 0xe485fb2 2024-09-11T07:06:27.879 INFO:teuthology.orchestra.run.smithi079.stdout:1637 trunc from 0xe485fb2 to 0x2396018 2024-09-11T07:06:27.879 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:27.879+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:27.901 INFO:teuthology.orchestra.run.smithi079.stdout:1638 punch from 0xf2eaa6 to 0xf3891e, (0x9e78 bytes) 2024-09-11T07:06:27.923 INFO:teuthology.orchestra.run.smithi079.stdout:1639 write 0x8fae3df thru 0x8fb89d2 (0xa5f4 bytes) 2024-09-11T07:06:27.927 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:27.927 INFO:teuthology.orchestra.run.smithi079.stdout:1644 punch from 0x5f04bc7 to 0x5f0c9c0, (0x7df9 bytes) 2024-09-11T07:06:27.927 INFO:teuthology.orchestra.run.smithi079.stdout:1645 write 0x1ef7e3f thru 0x1efe399 (0x655b bytes) 2024-09-11T07:06:27.930 INFO:teuthology.orchestra.run.smithi079.stdout:1646 read 0x42103d7 thru 0x42147ff (0x4429 bytes) 2024-09-11T07:06:27.930 INFO:teuthology.orchestra.run.smithi079.stdout:1647 trunc from 0x8fb89d3 to 0x8d757de 2024-09-11T07:06:27.943 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:27.943 INFO:teuthology.orchestra.run.smithi079.stdout:1649 write 0x426fc89 thru 0x42776cf (0x7a47 bytes) 2024-09-11T07:06:27.948 INFO:teuthology.orchestra.run.smithi079.stdout:1650 writesame 0x303e88c thru 0x3041833 data_size 0x3d(0x2fa8 bytes) 2024-09-11T07:06:27.957 INFO:teuthology.orchestra.run.smithi079.stdout:1651 trunc from 0x8d757de to 0xd18ee7e 2024-09-11T07:06:27.968 INFO:teuthology.orchestra.run.smithi079.stdout:1652 punch from 0xb4244ec to 0xb42f753, (0xb267 bytes) 2024-09-11T07:06:27.971 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:27.966+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:27.978 INFO:teuthology.orchestra.run.smithi079.stdout:1653 write 0xde0e3a4 thru 0xde178d8 (0x9535 bytes) 2024-09-11T07:06:27.984 INFO:teuthology.orchestra.run.smithi079.stdout:1655 writesame 0x6569576 thru 0x6579137 data_size 0x19(0xfbc2 bytes) 2024-09-11T07:06:27.991 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.003 INFO:teuthology.orchestra.run.smithi079.stdout:1657 write 0xdffde9c thru 0xe0014a0 (0x3605 bytes) 2024-09-11T07:06:28.011 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:28.012 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:28.012 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:28.012 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:28.017 INFO:teuthology.orchestra.run.smithi079.stdout:1658 trunc from 0xe0014a1 to 0x8d4ea30 2024-09-11T07:06:28.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:28.041 INFO:teuthology.orchestra.run.smithi079.stdout:1659 punch from 0x24a405d to 0x24ab0e9, (0x708c bytes) 2024-09-11T07:06:28.041 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.041 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.057 INFO:teuthology.orchestra.run.smithi079.stdout:1664 writesame 0xade7522 thru 0xadef07b data_size 0x1(0x7b5a bytes) 2024-09-11T07:06:28.057 INFO:teuthology.orchestra.run.smithi079.stdout:1665 writesame 0x14f22d8 thru 0x14fccfa data_size 0x1f(0xaa23 bytes) 2024-09-11T07:06:28.063 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.063 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.063 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.063 INFO:teuthology.orchestra.run.smithi079.stdout:1669 trunc from 0xadef07c to 0xb46631b 2024-09-11T07:06:28.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:28.071+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:28.075 INFO:teuthology.orchestra.run.smithi079.stdout:1672 read 0x379d3e2 thru 0x379f685 (0x22a4 bytes) 2024-09-11T07:06:28.075 INFO:teuthology.orchestra.run.smithi079.stdout:1673 read 0x7543c4d thru 0x755243d (0xe7f1 bytes) 2024-09-11T07:06:28.076 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.076 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.076 INFO:teuthology.orchestra.run.smithi079.stdout:1676 punch from 0x1b8501b to 0x1b91f5e, (0xcf43 bytes) 2024-09-11T07:06:28.076 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.076 INFO:teuthology.orchestra.run.smithi079.stdout:1678 read 0x5077531 thru 0x507d647 (0x6117 bytes) 2024-09-11T07:06:28.076 INFO:teuthology.orchestra.run.smithi079.stdout:1679 write 0xa040e11 thru 0xa0454a4 (0x4694 bytes) 2024-09-11T07:06:28.081 INFO:teuthology.orchestra.run.smithi079.stdout:1680 read 0x49440e9 thru 0x49531af (0xf0c7 bytes) 2024-09-11T07:06:28.081 INFO:teuthology.orchestra.run.smithi079.stdout:1681 writesame 0x15fc985 thru 0x16051c0 data_size 0x2(0x883c bytes) 2024-09-11T07:06:28.107 INFO:teuthology.orchestra.run.smithi079.stdout:1682 trunc from 0xb46631b to 0x100b1b6 2024-09-11T07:06:28.140 INFO:teuthology.orchestra.run.smithi079.stdout:1687 punch from 0x1970fe to 0x19eaa6, (0x79a8 bytes) 2024-09-11T07:06:28.152 INFO:teuthology.orchestra.run.smithi079.stdout:1688 trunc from 0x100b1b6 to 0x8bb446c 2024-09-11T07:06:28.164 INFO:teuthology.orchestra.run.smithi079.stdout:1689 read 0x2b8ccd6 thru 0x2b98f53 (0xc27e bytes) 2024-09-11T07:06:28.164 INFO:teuthology.orchestra.run.smithi079.stdout:1690 write 0x698772e thru 0x698f788 (0x805b bytes) 2024-09-11T07:06:28.173 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:28.170+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:28.174 INFO:teuthology.orchestra.run.smithi079.stdout:1691 trunc from 0x8bb446c to 0x6075782 2024-09-11T07:06:28.176 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:28.176 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:28.176 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:28.176 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:28.176 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:28.189 INFO:teuthology.orchestra.run.smithi079.stdout:1692 read 0x3916d94 thru 0x3918379 (0x15e6 bytes) 2024-09-11T07:06:28.190 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.190 INFO:teuthology.orchestra.run.smithi079.stdout:1694 punch from 0x52be1f8 to 0x52c3d81, (0x5b89 bytes) 2024-09-11T07:06:28.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:28.201 INFO:teuthology.orchestra.run.smithi079.stdout:1695 write 0x6596bc9 thru 0x65a465b (0xda93 bytes) 2024-09-11T07:06:28.222 INFO:teuthology.orchestra.run.smithi079.stdout:1696 trunc from 0x65a465c to 0xecde80c 2024-09-11T07:06:28.234 INFO:teuthology.orchestra.run.smithi079.stdout:1698 read 0x52d3b51 thru 0x52d6f92 (0x3442 bytes) 2024-09-11T07:06:28.234 INFO:teuthology.orchestra.run.smithi079.stdout:1699 read 0xe43025 thru 0xe45dac (0x2d88 bytes) 2024-09-11T07:06:28.234 INFO:teuthology.orchestra.run.smithi079.stdout:1700 read 0x37c9181 thru 0x37d84f5 (0xf375 bytes) 2024-09-11T07:06:28.234 INFO:teuthology.orchestra.run.smithi079.stdout:1701 write 0xc0a4e59 thru 0xc0ac66c (0x7814 bytes) 2024-09-11T07:06:28.240 INFO:teuthology.orchestra.run.smithi079.stdout:1703 write 0x34651c7 thru 0x346b127 (0x5f61 bytes) 2024-09-11T07:06:28.245 INFO:teuthology.orchestra.run.smithi079.stdout:1704 writesame 0x390aefd thru 0x3917d33 data_size 0x1(0xce37 bytes) 2024-09-11T07:06:28.274 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:28.270+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:28.324 INFO:teuthology.orchestra.run.smithi079.stdout:1707 trunc from 0xecde80c to 0x86ad09b 2024-09-11T07:06:28.335 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1263 3.0 e26/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 26'25, mlcod=26'22)", 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.445017448000002, 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002862819, 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889250+0000", 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4e-07 2024-09-11T07:06:28.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889259+0000", 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3129999999999999e-06 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889289+0000", 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0975000000000001e-05 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889302+0000", 2024-09-11T07:06:28.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2699e-05 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889815+0000", 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051256399999999997 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889850+0000", 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5583000000000001e-05 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892013+0000", 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021629449999999999 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892112+0000", 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8800000000000003e-05 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1267 3.0 e26/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 26'26, mlcod=26'22)", 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:28.340 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.444443859, 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045762700000000003, 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:28.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889824+0000", 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-06 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889834+0000", 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9480000000000003e-06 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889852+0000", 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8017e-05 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889863+0000", 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0992000000000001e-05 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890364+0000", 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050119400000000005 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890395+0000", 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.112e-05 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894342+0000", 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039468189999999998 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894399+0000", 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6929999999999999e-05 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.344 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1494 3.0 e27/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 27'43, mlcod=26'39)", 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.952687791999999, 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002949344, 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381580+0000", 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8400000000000002e-07 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381590+0000", 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0163000000000001e-05 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381618+0000", 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7705999999999999e-05 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381634+0000", 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6362999999999999e-05 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382022+0000", 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038785099999999998 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382076+0000", 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4440000000000001e-05 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384415+0000", 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002338578 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384528+0000", 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011325899999999999 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1530 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'44, mlcod=27'42)", 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.872201763, 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031748789999999998, 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462067+0000", 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4839999999999998e-06 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462088+0000", 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0539000000000001e-05 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462135+0000", 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7102999999999999e-05 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462157+0000", 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2399999999999999e-05 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462289+0000", 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000131509 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462357+0000", 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8085999999999998e-05 2024-09-11T07:06:28.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465119+0000", 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002762029 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465240+0000", 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000120729 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1533 3.0 e27/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 27'45, mlcod=27'42)", 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.870988820000001, 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004605179, 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463279+0000", 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4619999999999999e-06 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463290+0000", 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1092e-05 2024-09-11T07:06:28.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463310+0000", 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9647999999999999e-05 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463326+0000", 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5614e-05 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463402+0000", 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6174000000000006e-05 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463431+0000", 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8875999999999999e-05 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467839+0000", 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044084079999999999 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467883+0000", 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3905000000000001e-05 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1537 3.0 e27/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 27'46, mlcod=27'42)", 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 21.870116726999999, 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037617390000000001, 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.358 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464151+0000", 2024-09-11T07:06:28.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.232e-06 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464161+0000", 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3479999999999993e-06 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464182+0000", 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1141999999999998e-05 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464193+0000", 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.163e-05 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464273+0000", 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9396999999999999e-05 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464300+0000", 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6811000000000001e-05 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467890+0000", 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003590626 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467912+0000", 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1552999999999998e-05 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.362 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.0 epoch 33/21 rep_tid 136 entries 33'88 (0'0) error 3:00d3d0eb:::rbd_data.116153756644.0000000000000033:head by client.4449.0:8937 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 33'86)", 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.331105167, 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026246419999999999, 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003163+0000", 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1009999999999999e-06 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003175+0000", 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2041999999999999e-05 2024-09-11T07:06:28.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003197+0000", 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2286e-05 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003213+0000", 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6160000000000001e-05 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003315+0000", 2024-09-11T07:06:28.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102329 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.005786+0000", 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024707240000000001 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.0 epoch 41/21 rep_tid 255 entries 41'153 (0'0) error 3:031d7ddd:::rbd_header.116133a8c376:head by client.4449.0:26446 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 41'151)", 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.538852+0000", 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.7954150929999999, 2024-09-11T07:06:28.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004679028, 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538852+0000", 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538852+0000", 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538853+0000", 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.136e-06 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538864+0000", 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0995999999999999e-05 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538891+0000", 2024-09-11T07:06:28.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6806999999999999e-05 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538908+0000", 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7435000000000002e-05 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.539010+0000", 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010235599999999999 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.543531+0000", 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045202979999999999 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31767 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'170, mlcod=42'165)", 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.297202+0000", 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.0370646109999999, 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0030288889999999999, 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.370 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297202+0000", 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297202+0000", 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297203+0000", 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0580000000000001e-06 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297210+0000", 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5860000000000001e-06 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297222+0000", 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-05 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297230+0000", 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8220000000000007e-06 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297473+0000", 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0002433 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297529+0000", 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5371999999999998e-05 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.300125+0000", 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002596147 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.300231+0000", 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106104 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31768 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'171, mlcod=42'167)", 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.299062+0000", 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.035204405, 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026496430000000001, 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299062+0000", 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299062+0000", 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299064+0000", 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6270000000000001e-06 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299079+0000", 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4725e-05 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299107+0000", 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7937999999999999e-05 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299125+0000", 2024-09-11T07:06:28.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8725000000000001e-05 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299245+0000", 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119543 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299298+0000", 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3211999999999998e-05 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.301600+0000", 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023024389999999999 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.301712+0000", 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000111434 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31769 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'172, mlcod=42'167)", 2024-09-11T07:06:28.379 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.299880+0000", 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.0343868719999998, 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048372689999999999, 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299880+0000", 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299880+0000", 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299881+0000", 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.514e-06 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299894+0000", 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2914999999999999e-05 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299920+0000", 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5857999999999999e-05 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299937+0000", 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7308000000000001e-05 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.300343+0000", 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040516199999999998 2024-09-11T07:06:28.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.300402+0000", 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9741999999999998e-05 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.304670+0000", 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042681330000000003 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.304717+0000", 2024-09-11T07:06:28.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6637000000000001e-05 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31776 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'173, mlcod=42'171)", 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.310826+0000", 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.0234404229999998, 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026004330000000001, 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.384 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310826+0000", 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310826+0000", 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310828+0000", 2024-09-11T07:06:28.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9230000000000001e-06 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310844+0000", 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5849e-05 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310875+0000", 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1140999999999999e-05 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310894+0000", 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8431e-05 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310972+0000", 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8203999999999999e-05 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310994+0000", 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1939000000000001e-05 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313330+0000", 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023358160000000001 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313427+0000", 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.713e-05 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.388 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31777 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'174, mlcod=42'171)", 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.312065+0000", 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.022201506, 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003304637, 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312065+0000", 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312065+0000", 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312067+0000", 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.37e-06 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312077+0000", 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0556e-05 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312100+0000", 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2775000000000001e-05 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312112+0000", 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1909000000000001e-05 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312281+0000", 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169445 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312320+0000", 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8603000000000003e-05 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315267+0000", 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029469180000000002 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315370+0000", 2024-09-11T07:06:28.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010306099999999999 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31778 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'175, mlcod=42'171)", 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.312975+0000", 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.0212920169999999, 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044884249999999999, 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312975+0000", 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312975+0000", 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312976+0000", 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7269999999999999e-06 2024-09-11T07:06:28.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312991+0000", 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4124999999999999e-05 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313018+0000", 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7554000000000001e-05 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313064+0000", 2024-09-11T07:06:28.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5966e-05 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313502+0000", 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043774100000000001 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313565+0000", 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3325999999999996e-05 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.317405+0000", 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0038399789999999999 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.317463+0000", 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8007000000000002e-05 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31779 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'176, mlcod=42'171)", 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.313884+0000", 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.0203822379999998, 2024-09-11T07:06:28.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054203960000000001, 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313884+0000", 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313884+0000", 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313886+0000", 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0360000000000001e-06 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313906+0000", 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9462000000000001e-05 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313938+0000", 2024-09-11T07:06:28.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1610999999999999e-05 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313956+0000", 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8284999999999999e-05 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314290+0000", 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033372099999999999 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314350+0000", 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0714999999999997e-05 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319249+0000", 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048988779999999997 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319305+0000", 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5687999999999999e-05 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31780 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'177, mlcod=42'171)", 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.314720+0000", 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.019546514, 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046319170000000002, 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314720+0000", 2024-09-11T07:06:28.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314720+0000", 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314722+0000", 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314733+0000", 2024-09-11T07:06:28.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1652e-05 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314753+0000", 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9758e-05 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314772+0000", 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8649000000000001e-05 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315487+0000", 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00071526700000000001 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315547+0000", 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0565e-05 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319309+0000", 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037611229999999999 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319352+0000", 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3581000000000002e-05 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31781 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'178, mlcod=42'171)", 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.315773+0000", 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.0184941699999999, 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041983630000000001, 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.406 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315773+0000", 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315773+0000", 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315774+0000", 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315787+0000", 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2629000000000001e-05 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315808+0000", 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1155e-05 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315822+0000", 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4178999999999999e-05 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.316704+0000", 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00088207200000000002 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.316745+0000", 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0896000000000003e-05 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319916+0000", 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031712189999999999 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319971+0000", 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4867000000000002e-05 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31821 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'190, mlcod=42'187)", 2024-09-11T07:06:28.410 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.365685+0000", 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.9685821130000001, 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042627560000000004, 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365685+0000", 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365685+0000", 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365685+0000", 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1900000000000003e-07 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365690+0000", 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8359999999999999e-06 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365699+0000", 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0319999999999992e-06 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365705+0000", 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9819999999999996e-06 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365748+0000", 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3136000000000002e-05 2024-09-11T07:06:28.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365765+0000", 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6464999999999999e-05 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.369919+0000", 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041548649999999998 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.369947+0000", 2024-09-11T07:06:28.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7920999999999999e-05 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31828 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'193, mlcod=42'189)", 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.374765+0000", 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.9595018120000001, 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0034327609999999999, 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374765+0000", 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374765+0000", 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374766+0000", 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:06:28.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374770+0000", 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5090000000000004e-06 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374779+0000", 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8910000000000001e-06 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374785+0000", 2024-09-11T07:06:28.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5420000000000002e-06 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374858+0000", 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2193000000000005e-05 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374873+0000", 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5401999999999999e-05 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.378168+0000", 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00329467 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.378198+0000", 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9929000000000001e-05 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31829 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'194, mlcod=42'189)", 2024-09-11T07:06:28.419 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.375858+0000", 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 2.9584089489999998, 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028826609999999999, 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375858+0000", 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375858+0000", 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375858+0000", 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0500000000000003e-07 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375863+0000", 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2309999999999998e-06 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375873+0000", 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0331e-05 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375878+0000", 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8269999999999997e-06 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375928+0000", 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9818999999999999e-05 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375947+0000", 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9592000000000001e-05 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.378698+0000", 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027508530000000002 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.378740+0000", 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2403e-05 2024-09-11T07:06:28.423 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.424 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.424 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:28.425 INFO:teuthology.orchestra.run.smithi079.stdout:1708 write 0x2c01085 thru 0x2c07aae (0x6a2a bytes) 2024-09-11T07:06:28.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:28.427 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.427 INFO:teuthology.orchestra.run.smithi079.stdout:1710 write 0x1eb5de2 thru 0x1ec2acb (0xccea bytes) 2024-09-11T07:06:28.427 INFO:teuthology.orchestra.run.smithi079.stdout:1712 read 0x84978d7 thru 0x84a28ce (0xaff8 bytes) 2024-09-11T07:06:28.427 INFO:teuthology.orchestra.run.smithi079.stdout:1714 punch from 0x6b7fa9c to 0x6b84ebe, (0x5422 bytes) 2024-09-11T07:06:28.427 INFO:teuthology.orchestra.run.smithi079.stdout:1715 punch from 0x56b6a76 to 0x56c5bf1, (0xf17b bytes) 2024-09-11T07:06:28.427 INFO:teuthology.orchestra.run.smithi079.stdout:1717 writesame 0xe7275ab thru 0xe729819 data_size 0x1(0x226f bytes) 2024-09-11T07:06:28.427 INFO:teuthology.orchestra.run.smithi079.stdout:1718 punch from 0xa4ab120 to 0xa4ad50d, (0x23ed bytes) 2024-09-11T07:06:28.427 INFO:teuthology.orchestra.run.smithi079.stdout:1719 punch from 0xbf80627 to 0xbf8fefd, (0xf8d6 bytes) 2024-09-11T07:06:28.427 INFO:teuthology.orchestra.run.smithi079.stdout:1720 read 0x1fb7d22 thru 0x1fbfa9e (0x7d7d bytes) 2024-09-11T07:06:28.428 INFO:teuthology.orchestra.run.smithi079.stdout:1721 write 0x9adc3e9 thru 0x9ae4f36 (0x8b4e bytes) 2024-09-11T07:06:28.428 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:28.423+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:28.428 INFO:teuthology.orchestra.run.smithi079.stdout:truncating to largest ever: 0xedb785a 2024-09-11T07:06:28.428 INFO:teuthology.orchestra.run.smithi079.stdout:1722 trunc from 0xe72981a to 0xedb785a 2024-09-11T07:06:28.462 INFO:teuthology.orchestra.run.smithi079.stdout:1723 trunc from 0xedb785a to 0x3bbae20 2024-09-11T07:06:28.502 INFO:teuthology.orchestra.run.smithi079.stdout:1725 trunc from 0x3bbae20 to 0xebb6307 2024-09-11T07:06:28.513 INFO:teuthology.orchestra.run.smithi079.stdout:1727 write 0x75520eb thru 0x75544d5 (0x23eb bytes) 2024-09-11T07:06:28.518 INFO:teuthology.orchestra.run.smithi079.stdout:1728 writesame 0x96b179c thru 0x96bddd3 data_size 0x4(0xc638 bytes) 2024-09-11T07:06:28.526 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:28.522+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:28.528 INFO:teuthology.orchestra.run.smithi079.stdout:1729 write 0x96e3869 thru 0x96e468a (0xe22 bytes) 2024-09-11T07:06:28.533 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.533 INFO:teuthology.orchestra.run.smithi079.stdout:1733 read 0x2ec20fa thru 0x2ec7fac (0x5eb3 bytes) 2024-09-11T07:06:28.533 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:28.543 INFO:teuthology.orchestra.run.smithi079.stdout:1737 trunc from 0xebb6307 to 0x83cb89d 2024-09-11T07:06:28.564 INFO:teuthology.orchestra.run.smithi079.stdout:1738 clone 14 order 21 su 1048576 sc 13 2024-09-11T07:06:28.566 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:28.566 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:28.566 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:28.566 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:28.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:28.627 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:28.622+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:28.727 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:28.726+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:28.742 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:28.743 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:28.743 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:28.743 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:28.743 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:28.756 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:28.828 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:28.827+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:28.882 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6914 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4472832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.205662059000002, 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030418942000000001, 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6914 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4799999999999998e-07 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675891+0000", 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5150000000000001e-06 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675898+0000", 2024-09-11T07:06:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9040000000000003e-06 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675903+0000", 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6180000000000003e-06 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706154+0000", 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030250969999999999 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706235+0000", 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0343e-05 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706307+0000", 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1944000000000001e-05 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6915 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.205639318999999, 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030587597000000001, 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6915 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676263+0000", 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035270599999999999 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676268+0000", 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0860000000000001e-06 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676280+0000", 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1863e-05 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676288+0000", 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5599999999999996e-06 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706353+0000", 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030065614000000001 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706438+0000", 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5041000000000001e-05 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706498+0000", 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9726999999999999e-05 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6917 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5341184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.205225104, 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030468918000000001, 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6917 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0500000000000003e-07 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676328+0000", 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3980000000000002e-06 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676335+0000", 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2649999999999999e-06 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676340+0000", 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4809999999999997e-06 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706664+0000", 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030323033999999999 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706731+0000", 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7639999999999996e-05 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706794+0000", 2024-09-11T07:06:28.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2495000000000004e-05 2024-09-11T07:06:28.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.896 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.896 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6918 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5455872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.897 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:28.897 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.205202044, 2024-09-11T07:06:28.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594758999999999, 2024-09-11T07:06:28.897 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.897 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.897 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.897 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.897 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6918 2024-09-11T07:06:28.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.898 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:28.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-07 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676350+0000", 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0940000000000002e-06 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676357+0000", 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5699999999999998e-06 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676362+0000", 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706819+0000", 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456987000000001 2024-09-11T07:06:28.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706885+0000", 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6054000000000001e-05 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706943+0000", 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7556000000000003e-05 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6919 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.205180292000001, 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030730071000000001, 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6919 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:28.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676595+0000", 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225577 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676599+0000", 2024-09-11T07:06:28.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3540000000000002e-06 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676611+0000", 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1037e-05 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676618+0000", 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4050000000000003e-06 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706966+0000", 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030348373000000001 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707032+0000", 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5736999999999998e-05 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707100+0000", 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7588000000000004e-05 2024-09-11T07:06:28.906 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6920 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6209536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.204919704000002, 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030647992999999998, 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.907 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6920 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:28.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676631+0000", 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999999e-07 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676633+0000", 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.729e-06 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676641+0000", 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7659999999999998e-06 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676647+0000", 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7930000000000003e-06 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707128+0000", 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030481028 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707211+0000", 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2792000000000003e-05 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707278+0000", 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7288999999999999e-05 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.911 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6921 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6324224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.204894275000001, 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030787063999999999, 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6921 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.912 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7700000000000004e-07 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676660+0000", 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.997e-06 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676667+0000", 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2910000000000002e-06 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676673+0000", 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6010000000000002e-06 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707305+0000", 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030632029000000002 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707380+0000", 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5265999999999994e-05 2024-09-11T07:06:28.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707443+0000", 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2303000000000003e-05 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6922 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6438912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.204868747999999, 2024-09-11T07:06:28.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031018718000000001, 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6922 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:28.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676852+0000", 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000171371 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676857+0000", 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6380000000000003e-06 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676867+0000", 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0268000000000001e-05 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676875+0000", 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5320000000000001e-06 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707469+0000", 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030593615000000001 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707632+0000", 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016336399999999999 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707700+0000", 2024-09-11T07:06:28.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7929999999999995e-05 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6923 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6553600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.204662518999999, 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030968105999999999, 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.921 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6923 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:28.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676888+0000", 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7000000000000005e-07 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676895+0000", 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1110000000000002e-06 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676902+0000", 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2030000000000003e-06 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676908+0000", 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6200000000000004e-06 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707728+0000", 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030820163000000001 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707797+0000", 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8737000000000003e-05 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707855+0000", 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8702000000000001e-05 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6924 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7192576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.204633187999999, 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031099157999999998, 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6924 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.926 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4000000000000001e-07 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676921+0000", 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6899999999999998e-06 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676928+0000", 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8260000000000004e-06 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676933+0000", 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3109999999999996e-06 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707879+0000", 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030946265000000001 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707946+0000", 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6365000000000006e-05 2024-09-11T07:06:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708016+0000", 2024-09-11T07:06:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0061000000000006e-05 2024-09-11T07:06:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6925 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.204607332999998, 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.03121956, 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6925 2024-09-11T07:06:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676996+0000", 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3483000000000003e-05 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677000+0000", 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1840000000000001e-06 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677009+0000", 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2390000000000008e-06 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677016+0000", 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0600000000000002e-06 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708042+0000", 2024-09-11T07:06:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031025569999999999 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708106+0000", 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3723e-05 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708162+0000", 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6301000000000002e-05 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7045 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5472256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.199595775999999, 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456286999999999, 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.936 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7045 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682107+0000", 2024-09-11T07:06:28.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015256800000000001 2024-09-11T07:06:28.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682111+0000", 2024-09-11T07:06:28.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0450000000000002e-06 2024-09-11T07:06:28.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682120+0000", 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6569999999999992e-06 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682127+0000", 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6239999999999996e-06 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712254+0000", 2024-09-11T07:06:28.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030127068 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712333+0000", 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8788999999999994e-05 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712410+0000", 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7535999999999998e-05 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7046 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5586944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.199411188999999, 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030486447, 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7046 2024-09-11T07:06:28.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.942 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:28.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:28.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5400000000000001e-07 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682142+0000", 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7429999999999998e-06 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682149+0000", 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3209999999999999e-06 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682155+0000", 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7620000000000001e-06 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712454+0000", 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030298814 2024-09-11T07:06:28.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712563+0000", 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010932 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712625+0000", 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1933000000000005e-05 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7047 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.199387137999999, 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030677043000000001, 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7047 2024-09-11T07:06:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.947 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:28.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:28.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682532+0000", 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036941099999999999 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682537+0000", 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2469999999999999e-06 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682547+0000", 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9000000000000001e-06 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682554+0000", 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2060000000000001e-06 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712666+0000", 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030111422999999998 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712761+0000", 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5212999999999998e-05 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712840+0000", 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8642999999999999e-05 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7048 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6340608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.198981967000002, 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494950999999999, 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7048 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.951 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7299999999999996e-07 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682571+0000", 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7760000000000002e-06 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682577+0000", 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0209999999999996e-06 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682584+0000", 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8630000000000002e-06 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712904+0000", 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030320347000000001 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712987+0000", 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2367000000000006e-05 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713063+0000", 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6003999999999999e-05 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7049 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6455296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.198957316000001, 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030670962999999999, 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7049 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7199999999999999e-07 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682596+0000", 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5189999999999999e-06 2024-09-11T07:06:28.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682602+0000", 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7240000000000003e-06 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682607+0000", 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2410000000000003e-06 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713102+0000", 2024-09-11T07:06:28.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494841000000002 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713189+0000", 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6697e-05 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713263+0000", 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4468999999999995e-05 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7050 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6569984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.198933754999999, 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030850200000000001, 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7050 2024-09-11T07:06:28.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682617+0000", 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682619+0000", 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2450000000000001e-06 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682627+0000", 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0520000000000002e-06 2024-09-11T07:06:28.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682632+0000", 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2750000000000003e-06 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713310+0000", 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030678305999999999 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713391+0000", 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0164e-05 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713466+0000", 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5703000000000003e-05 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7051 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6684672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.964 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.198910228999999, 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030997008, 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7051 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682684+0000", 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4625e-05 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682695+0000", 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0575e-05 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682703+0000", 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1389999999999995e-06 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682709+0000", 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-11T07:06:28.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713498+0000", 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030789092000000001 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713571+0000", 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2554999999999999e-05 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713637+0000", 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5950000000000004e-05 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7052 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.198831041999998, 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031135348, 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7052 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683050+0000", 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033088699999999998 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683054+0000", 2024-09-11T07:06:28.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.651e-06 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683066+0000", 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1372000000000001e-05 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683074+0000", 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5939999999999994e-06 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713669+0000", 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594982 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713786+0000", 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116937 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713854+0000", 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7924999999999998e-05 2024-09-11T07:06:28.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:33510 3.b 3:d16a5966:::rbd_object_map.116176c25662:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.50660146299999997, 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034759883999999998, 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:28.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 33510 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:28.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374951+0000", 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374966+0000", 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4623e-05 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:28.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374992+0000", 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-05 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375006+0000", 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3492999999999999e-05 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375078+0000", 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2125999999999994e-05 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375151+0000", 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3250000000000005e-05 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.408158+0000", 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033006967999999998 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409176+0000", 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001018288 2024-09-11T07:06:28.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409544+0000", 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000367201 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409629+0000", 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5280999999999999e-05 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409708+0000", 2024-09-11T07:06:28.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9383999999999998e-05 2024-09-11T07:06:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:28.980 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:28.980 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:28.981 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:06:28.982 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:28.978+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:28.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:29.083 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:29.078+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:29.109 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:29.109 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:29.109 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:29.124 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:29.211 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:29.210+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:29.215 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #12, image image_client.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent13 2024-09-11T07:06:29.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:29.283+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:29.289 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:29.289 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:29.289 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:29.289 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:29.289 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:29.310 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:29.385 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:29.383+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:29.474 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:29.474 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1855304310000001, 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.475 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:06:29.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:06:29.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:06:29.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.480 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1854583480000001, 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:29.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:06:29.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1854028550000004, 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:06:29.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9835308869999997, 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.491 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:29.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:06:29.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:29.496 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9834682969999999, 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:06:29.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9834112409999998, 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:06:29.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:06:29.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:06:29.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.506 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.983355124, 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.507 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:29.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.511 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9832338619999996, 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:06:29.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:06:29.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9831295930000001, 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.517 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.518 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:06:29.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.518 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:06:29.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.522 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9830240540000004, 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.523 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:29.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:29.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:06:29.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:06:29.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:06:29.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9829568909999997, 2024-09-11T07:06:29.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:06:29.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.533 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.534 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:29.534 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9828576849999999, 2024-09-11T07:06:29.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:06:29.534 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.534 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.534 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.534 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:06:29.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.982770726, 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.539 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:06:29.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:06:29.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:06:29.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:06:29.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:06:29.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.544 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9827104489999998, 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:06:29.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.982556744, 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.550 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:06:29.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.982469568, 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:29.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.559 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9824056649999999, 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:06:29.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:06:29.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9823458220000001, 2024-09-11T07:06:29.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:06:29.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9822677400000002, 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:06:29.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:06:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:06:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:06:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:06:29.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:06:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:06:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:06:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:06:29.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.9822099699999995, 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:06:29.576 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:29.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:06:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:06:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:06:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:06:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:29.582 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:29.582 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:29.584 INFO:teuthology.orchestra.run.smithi079.stdout:1739 writesame 0x887ef8c thru 0x888be3a data_size 0x3(0xceaf bytes) 2024-09-11T07:06:29.584 INFO:teuthology.orchestra.run.smithi079.stdout:1740 write 0xa650fe thru 0xa74c63 (0xfb66 bytes) 2024-09-11T07:06:29.584 INFO:teuthology.orchestra.run.smithi079.stdout:1741 punch from 0x1bf28b1 to 0x1bfd182, (0xa8d1 bytes) 2024-09-11T07:06:29.584 INFO:teuthology.orchestra.run.smithi079.stdout:1743 read 0x1a27c59 thru 0x1a2f1cc (0x7574 bytes) 2024-09-11T07:06:29.584 INFO:teuthology.orchestra.run.smithi079.stdout:1744 write 0x86292dd thru 0x862946b (0x18f bytes) 2024-09-11T07:06:29.584 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:29.583+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:29.585 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:29.592 INFO:teuthology.orchestra.run.smithi079.stdout:1747 write 0x8d2ba87 thru 0x8d2bae1 (0x5b bytes) 2024-09-11T07:06:29.599 INFO:teuthology.orchestra.run.smithi079.stdout:1748 punch from 0x19a7326 to 0x19a90f2, (0x1dcc bytes) 2024-09-11T07:06:29.599 INFO:teuthology.orchestra.run.smithi079.stdout:1749 write 0x3cfc619 thru 0x3d04955 (0x833d bytes) 2024-09-11T07:06:29.626 INFO:teuthology.orchestra.run.smithi079.stdout:1750 write 0xcd048a3 thru 0xcd12d4d (0xe4ab bytes) 2024-09-11T07:06:29.644 INFO:teuthology.orchestra.run.smithi079.stdout:1751 trunc from 0xcd12d4e to 0x78d2300 2024-09-11T07:06:29.675 INFO:teuthology.orchestra.run.smithi079.stdout:1755 read 0x721ab39 thru 0x72201ac (0x5674 bytes) 2024-09-11T07:06:29.676 INFO:teuthology.orchestra.run.smithi079.stdout:1757 punch from 0x6642372 to 0x664f55f, (0xd1ed bytes) 2024-09-11T07:06:29.685 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:29.682+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:29.699 INFO:teuthology.orchestra.run.smithi079.stdout:1758 writesame 0xe27db2d thru 0xe2882cf data_size 0x5(0xa7a3 bytes) 2024-09-11T07:06:29.699 INFO:teuthology.orchestra.run.smithi079.stdout:1759 write 0xb7ef3aa thru 0xb7f666c (0x72c3 bytes) 2024-09-11T07:06:29.705 INFO:teuthology.orchestra.run.smithi079.stdout:1760 write 0x7e9743b thru 0x7ea7288 (0xfe4e bytes) 2024-09-11T07:06:29.708 INFO:teuthology.orchestra.run.smithi079.stdout:1763 writesame 0x7badd15 thru 0x7bb541b data_size 0x7(0x7707 bytes) 2024-09-11T07:06:29.713 INFO:teuthology.orchestra.run.smithi079.stdout:1764 write 0xae1b87f thru 0xae26a80 (0xb202 bytes) 2024-09-11T07:06:29.719 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:29.719 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:29.719 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:29.719 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:29.734 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:29.739 INFO:teuthology.orchestra.run.smithi079.stdout:1765 trunc from 0xe2882d0 to 0x6fe3bf4 2024-09-11T07:06:29.785 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:29.783+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:29.797 INFO:teuthology.orchestra.run.smithi079.stdout:1766 write 0x71f14ec thru 0x71f3541 (0x2056 bytes) 2024-09-11T07:06:29.803 INFO:teuthology.orchestra.run.smithi079.stdout:1767 read 0x9943e6 thru 0x9a102a (0xcc45 bytes) 2024-09-11T07:06:29.804 INFO:teuthology.orchestra.run.smithi079.stdout:1768 punch from 0xae738a to 0xaf617f, (0xedf5 bytes) 2024-09-11T07:06:29.804 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:29.804 INFO:teuthology.orchestra.run.smithi079.stdout:1770 punch from 0x4c3ca4a to 0x4c4c09f, (0xf655 bytes) 2024-09-11T07:06:29.805 INFO:teuthology.orchestra.run.smithi079.stdout:1773 write 0x4a7207a thru 0x4a76257 (0x41de bytes) 2024-09-11T07:06:29.807 INFO:teuthology.orchestra.run.smithi079.stdout:1774 read 0x4e62841 thru 0x4e67f59 (0x5719 bytes) 2024-09-11T07:06:29.837 INFO:teuthology.orchestra.run.smithi079.stdout:1776 write 0xdf31731 thru 0xdf3c3a9 (0xac79 bytes) 2024-09-11T07:06:29.843 INFO:teuthology.orchestra.run.smithi079.stdout:1777 punch from 0x5c60f44 to 0x5c6b1d3, (0xa28f bytes) 2024-09-11T07:06:29.843 INFO:teuthology.orchestra.run.smithi079.stdout:1778 read 0x420a34d thru 0x4216466 (0xc11a bytes) 2024-09-11T07:06:29.843 INFO:teuthology.orchestra.run.smithi079.stdout:1779 trunc from 0xdf3c3aa to 0xe193591 2024-09-11T07:06:29.855 INFO:teuthology.orchestra.run.smithi079.stdout:1780 writesame 0x26b4047 thru 0x26b6937 data_size 0x1(0x28f1 bytes) 2024-09-11T07:06:29.873 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:29.874 INFO:teuthology.orchestra.run.smithi079.stdout:1781 punch from 0x9ddf30f to 0x9de63dc, (0x70cd bytes) 2024-09-11T07:06:29.891 INFO:teuthology.orchestra.run.smithi079.stdout:1783 trunc from 0xe193591 to 0x73b8273 2024-09-11T07:06:29.891 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:29.891+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:29.912 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:29.913 INFO:teuthology.orchestra.run.smithi079.stdout:1785 punch from 0x2de7e19 to 0x2deb596, (0x377d bytes) 2024-09-11T07:06:29.914 INFO:teuthology.orchestra.run.smithi079.stdout:1786 punch from 0x22aeea4 to 0x22b93f4, (0xa550 bytes) 2024-09-11T07:06:29.914 INFO:teuthology.orchestra.run.smithi079.stdout:1787 read 0x154557a thru 0x154a07d (0x4b04 bytes) 2024-09-11T07:06:29.916 INFO:teuthology.orchestra.run.smithi079.stdout:1788 trunc from 0x73b8273 to 0x8696a7b 2024-09-11T07:06:29.927 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:29.944 INFO:teuthology.orchestra.run.smithi079.stdout:1790 write 0xcfe3f36 thru 0xcff02b0 (0xc37b bytes) 2024-09-11T07:06:29.949 INFO:teuthology.orchestra.run.smithi079.stdout:1792 read 0x5c8839e thru 0x5c940ea (0xbd4d bytes) 2024-09-11T07:06:29.949 INFO:teuthology.orchestra.run.smithi079.stdout:1793 writesame 0xc701513 thru 0xc706f19 data_size 0x1(0x5a07 bytes) 2024-09-11T07:06:29.975 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:29.975 INFO:teuthology.orchestra.run.smithi079.stdout:1795 write 0xc938c4f thru 0xc938e98 (0x24a bytes) 2024-09-11T07:06:29.981 INFO:teuthology.orchestra.run.smithi079.stdout:1796 write 0x9c5027a thru 0x9c547f4 (0x457b bytes) 2024-09-11T07:06:29.986 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:29.982+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:29.990 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:06:29.992 INFO:teuthology.orchestra.run.smithi079.stdout:1798 trunc from 0xcff02b1 to 0xae63240 2024-09-11T07:06:30.011 INFO:teuthology.orchestra.run.smithi079.stdout:1800 punch from 0x32bf78a to 0x32ceed1, (0xf747 bytes) 2024-09-11T07:06:30.011 INFO:teuthology.orchestra.run.smithi079.stdout:1801 clone 15 order 24 su 524288 sc 2 2024-09-11T07:06:30.030 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:30.031 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:30.047 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:30.047 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:30.054 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:30.054 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:30.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:30.054 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:30.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.054 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.054 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:30.054 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7442766719999998, 2024-09-11T07:06:30.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:06:30.054 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:06:30.058 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7442091180000006, 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:06:30.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:06:30.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7441282810000001, 2024-09-11T07:06:30.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:06:30.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7440849350000001, 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:06:30.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7440148099999995, 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.072 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:06:30.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7439466859999992, 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:06:30.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:06:30.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:06:30.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:06:30.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:06:30.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:30.081 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7439062199999995, 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:30.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:06:30.085 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7438681789999997, 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.086 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7438292089999994, 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.090 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:06:30.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:06:30.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7437883349999996, 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:06:30.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7434605619999992, 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.099 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:06:30.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:06:30.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7433940519999993, 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.104 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:06:30.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7433263330000006, 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7432813950000003, 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:06:30.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:06:30.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:06:30.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7424817699999995, 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:30.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:06:30.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.121 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7424474280000002, 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:06:30.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7420847530000003, 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:30.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.130 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7408217280000002, 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:06:30.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7407892290000007, 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:30.139 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.8041838019999998, 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:30.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:06:30.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:06:30.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:30.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:30.145 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:30.146 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:30.147 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:30.147 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:30.148 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:30.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:30.148 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:30.149 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:30.149 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:30.149 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:30.149 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:30.150 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:30.150 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:30.143+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:30.158 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:30.159 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:30.247 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:30.247+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:30.321 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:30.321 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:30.335 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:30.349 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:30.347+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:30.450 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:30.446+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:30.452 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:30.452 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:30.466 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:30.551 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:30.547+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:30.632 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:30.632 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:30.645 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:30.692 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:30.690+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:30.753 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:30.751+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:30.769 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:30.769 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:30.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:30.853 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:30.851+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:30.949 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:30.949 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:30.955 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:30.950+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:30.963 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:30.981 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:06:30.982 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:06:30.982 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-09-11T07:06:30.982 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T07:06:30.982 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T07:06:30.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-09-11T07:06:31.056 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:31.054+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:31.117 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:31.118 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "" 2024-09-11T07:06:31.118 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:31.118 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone14 from 0xae63240 (overlap 0x6fe3bf4) to 0x21911fc 2024-09-11T07:06:31.145 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:31.145 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:31.157 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:31.154+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:31.164 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:31.258 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:31.255+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:31.261 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #13, image image_client.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent14 2024-09-11T07:06:31.295 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:31.296 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:31.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:31.403 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:31.403+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:31.462 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:31.458+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:31.477 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:31.477 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:31.494 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:31.523 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:31.549 INFO:teuthology.orchestra.run.smithi079.stdout:1803 write 0xe5647af thru 0xe571359 (0xcbab bytes) 2024-09-11T07:06:31.556 INFO:teuthology.orchestra.run.smithi079.stdout:1805 write 0xa6a39d3 thru 0xa6a8338 (0x4966 bytes) 2024-09-11T07:06:31.563 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:31.559+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:31.564 INFO:teuthology.orchestra.run.smithi079.stdout:1806 read 0xd4dde78 thru 0xd4dfbcd (0x1d56 bytes) 2024-09-11T07:06:31.564 INFO:teuthology.orchestra.run.smithi079.stdout:1807 read 0xbb55503 thru 0xbb5ea58 (0x9556 bytes) 2024-09-11T07:06:31.565 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:31.565 INFO:teuthology.orchestra.run.smithi079.stdout:1809 write 0x44dc421 thru 0x44eb5bc (0xf19c bytes) 2024-09-11T07:06:31.576 INFO:teuthology.orchestra.run.smithi079.stdout:1811 punch from 0x8bf5eef to 0x8c02bcd, (0xccde bytes) 2024-09-11T07:06:31.576 INFO:teuthology.orchestra.run.smithi079.stdout:1813 punch from 0x9ab994e to 0x9abf38d, (0x5a3f bytes) 2024-09-11T07:06:31.576 INFO:teuthology.orchestra.run.smithi079.stdout:1814 writesame 0x565aeeb thru 0x5664db4 data_size 0x4b(0x9eca bytes) 2024-09-11T07:06:31.623 INFO:teuthology.orchestra.run.smithi079.stdout:1815 read 0xd49e0a4 thru 0xd49ff67 (0x1ec4 bytes) 2024-09-11T07:06:31.623 INFO:teuthology.orchestra.run.smithi079.stdout:1816 write 0x355eee7 thru 0x3560773 (0x188d bytes) 2024-09-11T07:06:31.661 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:31.664 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:31.666 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:31.663+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:31.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:31.689 INFO:teuthology.orchestra.run.smithi079.stdout:1820 write 0x1cfd415 thru 0x1d040b1 (0x6c9d bytes) 2024-09-11T07:06:31.767 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:31.763+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:31.797 INFO:teuthology.orchestra.run.smithi079.stdout:1821 trunc from 0xe57135a to 0x1b32752 2024-09-11T07:06:31.840 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:31.840 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:31.859 INFO:teuthology.orchestra.run.smithi079.stdout:1822 write 0xcc7ea10 thru 0xcc8e56d (0xfb5e bytes) 2024-09-11T07:06:31.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:31.867 INFO:teuthology.orchestra.run.smithi079.stdout:1823 clone 16 order 19 su 131072 sc 4 2024-09-11T07:06:31.868 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:31.866+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:31.969 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:31.967+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:31.988 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:31.988 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:32.004 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:32.017 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:06:32.069 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:32.066+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:32.146 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone15 from 0xcc8e56e (overlap 0x1b32752) to 0x187a363 2024-09-11T07:06:32.170 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:32.167+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:32.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:32.180 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:32.180 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:32.200 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:32.287 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:32.287+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:32.303 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #14, image image_client.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent15 2024-09-11T07:06:32.369 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:32.369 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:32.371 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:32.371+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:32.385 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:32.390 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:32.391 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:32.403 INFO:teuthology.orchestra.run.smithi079.stdout:1824 trunc from 0xcc8e56e to 0x181bf5 2024-09-11T07:06:32.408 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:32.409 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:32.431 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:32.431 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:32.449 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:32.449 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:32.454 INFO:teuthology.orchestra.run.smithi079.stdout:1825 writesame 0x46985a0 thru 0x46a7e20 data_size 0x1(0xf881 bytes) 2024-09-11T07:06:32.467 INFO:teuthology.orchestra.run.smithi079.stdout:1826 write 0x6a9423d thru 0x6a9bd9d (0x7b61 bytes) 2024-09-11T07:06:32.471 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:32.471 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:32.472 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:32.469+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:32.473 INFO:teuthology.orchestra.run.smithi079.stdout:1827 trunc from 0x6a9bd9e to 0x72f2382 2024-09-11T07:06:32.483 INFO:teuthology.orchestra.run.smithi079.stdout:1828 read 0x47b7878 thru 0x47c713c (0xf8c5 bytes) 2024-09-11T07:06:32.484 INFO:teuthology.orchestra.run.smithi079.stdout:1829 read 0xe7d46a thru 0xe8a905 (0xd49c bytes) 2024-09-11T07:06:32.504 INFO:teuthology.orchestra.run.smithi079.stdout:1830 writesame 0xdd16fb3 thru 0xdd1a9f0 data_size 0x47(0x3a3e bytes) 2024-09-11T07:06:32.504 INFO:teuthology.orchestra.run.smithi079.stdout:1831 read 0x84dffe5 thru 0x84ea04f (0xa06b bytes) 2024-09-11T07:06:32.504 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:32.504 INFO:teuthology.orchestra.run.smithi079.stdout:1834 clone 17 order 19 su 65536 sc 3 2024-09-11T07:06:32.507 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:32.507 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:32.541 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:32.541 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:32.541 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:32.541 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:32.541 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:32.541 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:32.542 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:32.559 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:32.569 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:32.570 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:32.588 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:32.587+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:32.674 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:32.669+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:32.687 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:32.687 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:32.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:32.687 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:32.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.687 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1263 3.0 e26/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 26'25, mlcod=26'22)", 2024-09-11T07:06:32.687 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.798124127000001, 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002862819, 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889249+0000", 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889250+0000", 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4e-07 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889259+0000", 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3129999999999999e-06 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889289+0000", 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0975000000000001e-05 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889302+0000", 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2699e-05 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889815+0000", 2024-09-11T07:06:32.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00051256399999999997 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889850+0000", 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5583000000000001e-05 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892013+0000", 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021629449999999999 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.892112+0000", 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8800000000000003e-05 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1267 3.0 e26/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 26'26, mlcod=26'22)", 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.797550537999999, 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045762700000000003, 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889823+0000", 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889824+0000", 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-06 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889834+0000", 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9480000000000003e-06 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889852+0000", 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8017e-05 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.889863+0000", 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0992000000000001e-05 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890364+0000", 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00050119400000000005 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.890395+0000", 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.112e-05 2024-09-11T07:06:32.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894342+0000", 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0039468189999999998 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:05.894399+0000", 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6929999999999999e-05 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1494 3.0 e27/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 27'43, mlcod=26'39)", 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.305794470999999, 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002949344, 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381579+0000", 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381580+0000", 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8400000000000002e-07 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381590+0000", 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0163000000000001e-05 2024-09-11T07:06:32.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381618+0000", 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7705999999999999e-05 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.381634+0000", 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6362999999999999e-05 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382022+0000", 2024-09-11T07:06:32.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00038785099999999998 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.382076+0000", 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4440000000000001e-05 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384415+0000", 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002338578 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.384528+0000", 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00011325899999999999 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1530 3.0 e27/21 3:017af0c1:::rbd_data.11611d63ad3f.0000000000000000:head v 27'44, mlcod=27'42)", 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.225308441999999, 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031748789999999998, 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462065+0000", 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462067+0000", 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4839999999999998e-06 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462088+0000", 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0539000000000001e-05 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462135+0000", 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7102999999999999e-05 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462157+0000", 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2399999999999999e-05 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462289+0000", 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000131509 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.462357+0000", 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8085999999999998e-05 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465119+0000", 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002762029 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.465240+0000", 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000120729 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1533 3.0 e27/21 3:07ee55fa:::rbd_data.11611d63ad3f.0000000000000003:head v 27'45, mlcod=27'42)", 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.224095499000001, 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004605179, 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463278+0000", 2024-09-11T07:06:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463279+0000", 2024-09-11T07:06:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4619999999999999e-06 2024-09-11T07:06:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463290+0000", 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1092e-05 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463310+0000", 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9647999999999999e-05 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463326+0000", 2024-09-11T07:06:32.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5614e-05 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463402+0000", 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6174000000000006e-05 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.463431+0000", 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8875999999999999e-05 2024-09-11T07:06:32.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467839+0000", 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044084079999999999 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467883+0000", 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3905000000000001e-05 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:1537 3.0 e27/21 3:036a1077:::rbd_data.11611d63ad3f.0000000000000007:head v 27'46, mlcod=27'42)", 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.223223405999999, 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037617390000000001, 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464150+0000", 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464151+0000", 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.232e-06 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464161+0000", 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.3479999999999993e-06 2024-09-11T07:06:32.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464182+0000", 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1141999999999998e-05 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464193+0000", 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.163e-05 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464273+0000", 2024-09-11T07:06:32.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9396999999999999e-05 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.464300+0000", 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6811000000000001e-05 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467890+0000", 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003590626 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:06.467912+0000", 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1552999999999998e-05 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.0 epoch 33/21 rep_tid 136 entries 33'88 (0'0) error 3:00d3d0eb:::rbd_data.116153756644.0000000000000033:head by client.4449.0:8937 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 33'86)", 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.684211846, 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026246419999999999, 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.715 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003162+0000", 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003163+0000", 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1009999999999999e-06 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003175+0000", 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2041999999999999e-05 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003197+0000", 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2286e-05 2024-09-11T07:06:32.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003213+0000", 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6160000000000001e-05 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.003315+0000", 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000102329 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:14.005786+0000", 2024-09-11T07:06:32.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0024707240000000001 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.0 epoch 41/21 rep_tid 255 entries 41'153 (0'0) error 3:031d7ddd:::rbd_header.116133a8c376:head by client.4449.0:26446 0.000000 0 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 41'151)", 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:24.538852+0000", 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.1485217720000005, 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004679028, 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538852+0000", 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538852+0000", 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538853+0000", 2024-09-11T07:06:32.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.136e-06 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538864+0000", 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0995999999999999e-05 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538891+0000", 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6806999999999999e-05 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.538908+0000", 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7435000000000002e-05 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.539010+0000", 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010235599999999999 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:24.543531+0000", 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0045202979999999999 2024-09-11T07:06:32.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31767 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'170, mlcod=42'165)", 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.297202+0000", 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.3901712899999996, 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0030288889999999999, 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297202+0000", 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297202+0000", 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297203+0000", 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0580000000000001e-06 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297210+0000", 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5860000000000001e-06 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297222+0000", 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2500000000000001e-05 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297230+0000", 2024-09-11T07:06:32.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8220000000000007e-06 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297473+0000", 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0002433 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.297529+0000", 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5371999999999998e-05 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.300125+0000", 2024-09-11T07:06:32.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.002596147 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.300231+0000", 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106104 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31768 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'171, mlcod=42'167)", 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.299062+0000", 2024-09-11T07:06:32.727 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.3883110839999997, 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026496430000000001, 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299062+0000", 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299062+0000", 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299064+0000", 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6270000000000001e-06 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299079+0000", 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4725e-05 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299107+0000", 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7937999999999999e-05 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299125+0000", 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8725000000000001e-05 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299245+0000", 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119543 2024-09-11T07:06:32.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299298+0000", 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3211999999999998e-05 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.301600+0000", 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023024389999999999 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.301712+0000", 2024-09-11T07:06:32.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000111434 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31769 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'172, mlcod=42'167)", 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.299880+0000", 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.3874935510000004, 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048372689999999999, 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.732 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299880+0000", 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299880+0000", 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299881+0000", 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.514e-06 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299894+0000", 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2914999999999999e-05 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299920+0000", 2024-09-11T07:06:32.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5857999999999999e-05 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.299937+0000", 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7308000000000001e-05 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.300343+0000", 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00040516199999999998 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.300402+0000", 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9741999999999998e-05 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.304670+0000", 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042681330000000003 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.304717+0000", 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6637000000000001e-05 2024-09-11T07:06:32.736 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31776 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'173, mlcod=42'171)", 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.310826+0000", 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.376547102, 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0026004330000000001, 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310826+0000", 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310826+0000", 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310828+0000", 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9230000000000001e-06 2024-09-11T07:06:32.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310844+0000", 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5849e-05 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310875+0000", 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1140999999999999e-05 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310894+0000", 2024-09-11T07:06:32.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8431e-05 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310972+0000", 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8203999999999999e-05 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.310994+0000", 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1939000000000001e-05 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313330+0000", 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0023358160000000001 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313427+0000", 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.713e-05 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31777 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'174, mlcod=42'171)", 2024-09-11T07:06:32.741 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.312065+0000", 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.3753081849999997, 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.003304637, 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312065+0000", 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312065+0000", 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312067+0000", 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.37e-06 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312077+0000", 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0556e-05 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312100+0000", 2024-09-11T07:06:32.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2775000000000001e-05 2024-09-11T07:06:32.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312112+0000", 2024-09-11T07:06:32.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1909000000000001e-05 2024-09-11T07:06:32.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312281+0000", 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169445 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312320+0000", 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8603000000000003e-05 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315267+0000", 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0029469180000000002 2024-09-11T07:06:32.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315370+0000", 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010306099999999999 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31778 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'175, mlcod=42'171)", 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.312975+0000", 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.3743986960000001, 2024-09-11T07:06:32.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0044884249999999999, 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312975+0000", 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312975+0000", 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312976+0000", 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7269999999999999e-06 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.312991+0000", 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4124999999999999e-05 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313018+0000", 2024-09-11T07:06:32.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7554000000000001e-05 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313064+0000", 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5966e-05 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313502+0000", 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043774100000000001 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313565+0000", 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3325999999999996e-05 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.317405+0000", 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0038399789999999999 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.317463+0000", 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8007000000000002e-05 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.750 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31779 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'176, mlcod=42'171)", 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.313884+0000", 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.3734889169999995, 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0054203960000000001, 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313884+0000", 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313884+0000", 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313886+0000", 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0360000000000001e-06 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313906+0000", 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9462000000000001e-05 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313938+0000", 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1610999999999999e-05 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.313956+0000", 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8284999999999999e-05 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314290+0000", 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033372099999999999 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314350+0000", 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0714999999999997e-05 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319249+0000", 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0048988779999999997 2024-09-11T07:06:32.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319305+0000", 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5687999999999999e-05 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31780 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'177, mlcod=42'171)", 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.314720+0000", 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.3726531929999997, 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0046319170000000002, 2024-09-11T07:06:32.755 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314720+0000", 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314720+0000", 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314722+0000", 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.322e-06 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314733+0000", 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1652e-05 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314753+0000", 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9758e-05 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.314772+0000", 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8649000000000001e-05 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315487+0000", 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00071526700000000001 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315547+0000", 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0565e-05 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319309+0000", 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037611229999999999 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319352+0000", 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3581000000000002e-05 2024-09-11T07:06:32.759 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31781 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'178, mlcod=42'171)", 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.315773+0000", 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.371600849, 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041983630000000001, 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315773+0000", 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315773+0000", 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315774+0000", 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:06:32.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315787+0000", 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2629000000000001e-05 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315808+0000", 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1155e-05 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.315822+0000", 2024-09-11T07:06:32.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4178999999999999e-05 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.316704+0000", 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00088207200000000002 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.316745+0000", 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0896000000000003e-05 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319916+0000", 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0031712189999999999 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.319971+0000", 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4867000000000002e-05 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31821 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'190, mlcod=42'187)", 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.365685+0000", 2024-09-11T07:06:32.764 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.3216887919999998, 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0042627560000000004, 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365685+0000", 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365685+0000", 2024-09-11T07:06:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365685+0000", 2024-09-11T07:06:32.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1900000000000003e-07 2024-09-11T07:06:32.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365690+0000", 2024-09-11T07:06:32.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8359999999999999e-06 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365699+0000", 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0319999999999992e-06 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365705+0000", 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9819999999999996e-06 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365748+0000", 2024-09-11T07:06:32.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3136000000000002e-05 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.365765+0000", 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6464999999999999e-05 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.369919+0000", 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0041548649999999998 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.369947+0000", 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7920999999999999e-05 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31828 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'193, mlcod=42'189)", 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.374765+0000", 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.3126084909999998, 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0034327609999999999, 2024-09-11T07:06:32.769 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374765+0000", 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374765+0000", 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374766+0000", 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374770+0000", 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5090000000000004e-06 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374779+0000", 2024-09-11T07:06:32.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8910000000000001e-06 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374785+0000", 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5420000000000002e-06 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374858+0000", 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2193000000000005e-05 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.374873+0000", 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5401999999999999e-05 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.378168+0000", 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00329467 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.378198+0000", 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9929000000000001e-05 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.773 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:31829 3.0 e42/21 3:069ee44c:::rbd_object_map.11618165a00d:head v 42'194, mlcod=42'189)", 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:25.375858+0000", 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.3115156280000004, 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0028826609999999999, 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375858+0000", 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375858+0000", 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375858+0000", 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0500000000000003e-07 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:32.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375863+0000", 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2309999999999998e-06 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375873+0000", 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0331e-05 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375878+0000", 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8269999999999997e-06 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375928+0000", 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9818999999999999e-05 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.375947+0000", 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9592000000000001e-05 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.378698+0000", 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0027508530000000002 2024-09-11T07:06:32.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:32.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:32.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:32.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:25.378740+0000", 2024-09-11T07:06:32.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.2403e-05 2024-09-11T07:06:32.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.778 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:32.778 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:32.778 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:32.780 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:32.780 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:32.777+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:32.881 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:32.881+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:32.907 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:32.907 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:32.908 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:32.908 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:32.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:32.982 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:32.977+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:33.024 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:06:33.049 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:33.049 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:33.050 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:33.050 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:33.064 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:33.083 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:33.081+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:33.173 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone16 from 0xdd1a9f1 (overlap 0x181bf5) to 0x134990 2024-09-11T07:06:33.184 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:33.183+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:33.236 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:33.236 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:33.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:33.236 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:33.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.236 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6914 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4472832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.236 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:33.236 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.558302384000001, 2024-09-11T07:06:33.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030418942000000001, 2024-09-11T07:06:33.236 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6914 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4799999999999998e-07 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675891+0000", 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5150000000000001e-06 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675898+0000", 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9040000000000003e-06 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675903+0000", 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6180000000000003e-06 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706154+0000", 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030250969999999999 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706235+0000", 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0343e-05 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706307+0000", 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1944000000000001e-05 2024-09-11T07:06:33.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6915 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.558279643999999, 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030587597000000001, 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6915 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676263+0000", 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035270599999999999 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676268+0000", 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0860000000000001e-06 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676280+0000", 2024-09-11T07:06:33.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1863e-05 2024-09-11T07:06:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676288+0000", 2024-09-11T07:06:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5599999999999996e-06 2024-09-11T07:06:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706353+0000", 2024-09-11T07:06:33.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030065614000000001 2024-09-11T07:06:33.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706438+0000", 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5041000000000001e-05 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706498+0000", 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9726999999999999e-05 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.246 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6917 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5341184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.557865429, 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030468918000000001, 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6917 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:33.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0500000000000003e-07 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676328+0000", 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3980000000000002e-06 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676335+0000", 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2649999999999999e-06 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676340+0000", 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4809999999999997e-06 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706664+0000", 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030323033999999999 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706731+0000", 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7639999999999996e-05 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706794+0000", 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2495000000000004e-05 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.251 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6918 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5455872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.557842368999999, 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594758999999999, 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6918 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.252 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-07 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676350+0000", 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0940000000000002e-06 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676357+0000", 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5699999999999998e-06 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676362+0000", 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706819+0000", 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456987000000001 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706885+0000", 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6054000000000001e-05 2024-09-11T07:06:33.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706943+0000", 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7556000000000003e-05 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6919 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.557820617000001, 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030730071000000001, 2024-09-11T07:06:33.256 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6919 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676595+0000", 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225577 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676599+0000", 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3540000000000002e-06 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676611+0000", 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1037e-05 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676618+0000", 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4050000000000003e-06 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706966+0000", 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030348373000000001 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707032+0000", 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5736999999999998e-05 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707100+0000", 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7588000000000004e-05 2024-09-11T07:06:33.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6920 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6209536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.557560029000001, 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030647992999999998, 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6920 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676631+0000", 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999999e-07 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676633+0000", 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.729e-06 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676641+0000", 2024-09-11T07:06:33.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7659999999999998e-06 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676647+0000", 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7930000000000003e-06 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707128+0000", 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030481028 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707211+0000", 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2792000000000003e-05 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707278+0000", 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7288999999999999e-05 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6921 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6324224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:33.265 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.5575346, 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030787063999999999, 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6921 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7700000000000004e-07 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676660+0000", 2024-09-11T07:06:33.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.997e-06 2024-09-11T07:06:33.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676667+0000", 2024-09-11T07:06:33.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2910000000000002e-06 2024-09-11T07:06:33.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676673+0000", 2024-09-11T07:06:33.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6010000000000002e-06 2024-09-11T07:06:33.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707305+0000", 2024-09-11T07:06:33.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030632029000000002 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707380+0000", 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5265999999999994e-05 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707443+0000", 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2303000000000003e-05 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6922 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6438912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.557509072999999, 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031018718000000001, 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.271 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6922 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:33.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676852+0000", 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000171371 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676857+0000", 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6380000000000003e-06 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676867+0000", 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0268000000000001e-05 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676875+0000", 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5320000000000001e-06 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707469+0000", 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030593615000000001 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707632+0000", 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016336399999999999 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707700+0000", 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7929999999999995e-05 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6923 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6553600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.557302843999999, 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030968105999999999, 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6923 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.276 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676888+0000", 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7000000000000005e-07 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676895+0000", 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1110000000000002e-06 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676902+0000", 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2030000000000003e-06 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676908+0000", 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6200000000000004e-06 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707728+0000", 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030820163000000001 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707797+0000", 2024-09-11T07:06:33.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8737000000000003e-05 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707855+0000", 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8702000000000001e-05 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6924 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7192576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:33.280 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.557273512999998, 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031099157999999998, 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6924 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4000000000000001e-07 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676921+0000", 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6899999999999998e-06 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676928+0000", 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8260000000000004e-06 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676933+0000", 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3109999999999996e-06 2024-09-11T07:06:33.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707879+0000", 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030946265000000001 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707946+0000", 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6365000000000006e-05 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708016+0000", 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0061000000000006e-05 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6925 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.557247658000001, 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.03121956, 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.285 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6925 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676996+0000", 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3483000000000003e-05 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677000+0000", 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1840000000000001e-06 2024-09-11T07:06:33.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677009+0000", 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2390000000000008e-06 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677016+0000", 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0600000000000002e-06 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708042+0000", 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031025569999999999 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708106+0000", 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3723e-05 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708162+0000", 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6301000000000002e-05 2024-09-11T07:06:33.289 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7045 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5472256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.552236100999998, 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456286999999999, 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.290 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7045 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682107+0000", 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015256800000000001 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682111+0000", 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0450000000000002e-06 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682120+0000", 2024-09-11T07:06:33.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6569999999999992e-06 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682127+0000", 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6239999999999996e-06 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712254+0000", 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030127068 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712333+0000", 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8788999999999994e-05 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712410+0000", 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7535999999999998e-05 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.294 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7046 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5586944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.552051513999999, 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030486447, 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7046 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.295 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:33.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5400000000000001e-07 2024-09-11T07:06:33.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682142+0000", 2024-09-11T07:06:33.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7429999999999998e-06 2024-09-11T07:06:33.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682149+0000", 2024-09-11T07:06:33.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3209999999999999e-06 2024-09-11T07:06:33.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682155+0000", 2024-09-11T07:06:33.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7620000000000001e-06 2024-09-11T07:06:33.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712454+0000", 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030298814 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712563+0000", 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010932 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712625+0000", 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1933000000000005e-05 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7047 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.552027463000002, 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030677043000000001, 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.302 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7047 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682532+0000", 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036941099999999999 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682537+0000", 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2469999999999999e-06 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682547+0000", 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9000000000000001e-06 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682554+0000", 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2060000000000001e-06 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712666+0000", 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030111422999999998 2024-09-11T07:06:33.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712761+0000", 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5212999999999998e-05 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712840+0000", 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8642999999999999e-05 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7048 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6340608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.551622292000001, 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494950999999999, 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7048 2024-09-11T07:06:33.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7299999999999996e-07 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682571+0000", 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7760000000000002e-06 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682577+0000", 2024-09-11T07:06:33.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0209999999999996e-06 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682584+0000", 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8630000000000002e-06 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712904+0000", 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030320347000000001 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712987+0000", 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2367000000000006e-05 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713063+0000", 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6003999999999999e-05 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7049 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6455296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.311 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.551597641000001, 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030670962999999999, 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7049 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7199999999999999e-07 2024-09-11T07:06:33.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682596+0000", 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5189999999999999e-06 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682602+0000", 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7240000000000003e-06 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682607+0000", 2024-09-11T07:06:33.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2410000000000003e-06 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713102+0000", 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494841000000002 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713189+0000", 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6697e-05 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713263+0000", 2024-09-11T07:06:33.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4468999999999995e-05 2024-09-11T07:06:33.316 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.316 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.316 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.316 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7050 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6569984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.316 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.551574080000002, 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030850200000000001, 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7050 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682617+0000", 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:06:33.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682619+0000", 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2450000000000001e-06 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682627+0000", 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0520000000000002e-06 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682632+0000", 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2750000000000003e-06 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713310+0000", 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030678305999999999 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713391+0000", 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0164e-05 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713466+0000", 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5703000000000003e-05 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7051 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6684672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.551550553999999, 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030997008, 2024-09-11T07:06:33.321 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7051 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:33.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682684+0000", 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4625e-05 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682695+0000", 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0575e-05 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682703+0000", 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1389999999999995e-06 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682709+0000", 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713498+0000", 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030789092000000001 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713571+0000", 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2554999999999999e-05 2024-09-11T07:06:33.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713637+0000", 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5950000000000004e-05 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7052 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.551471367000001, 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031135348, 2024-09-11T07:06:33.326 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7052 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683050+0000", 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033088699999999998 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683054+0000", 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.651e-06 2024-09-11T07:06:33.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683066+0000", 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1372000000000001e-05 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683074+0000", 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5939999999999994e-06 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713669+0000", 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594982 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713786+0000", 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116937 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713854+0000", 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7924999999999998e-05 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.330 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:33510 3.b 3:d16a5966:::rbd_object_map.116176c25662:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.8592417880000003, 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034759883999999998, 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 33510 2024-09-11T07:06:33.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:33.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374951+0000", 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374966+0000", 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4623e-05 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374992+0000", 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-05 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375006+0000", 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3492999999999999e-05 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375078+0000", 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2125999999999994e-05 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375151+0000", 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3250000000000005e-05 2024-09-11T07:06:33.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.408158+0000", 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033006967999999998 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409176+0000", 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001018288 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409544+0000", 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000367201 2024-09-11T07:06:33.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409629+0000", 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5280999999999999e-05 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409708+0000", 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9383999999999998e-05 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:33.337 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:33.337 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:33.338 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:33.339 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:33.333+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:33.364 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #15, image image_client.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent16 2024-09-11T07:06:33.439 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:33.435+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:33.470 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:33.470 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:33.470 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:33.470 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:33.484 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:33.535 INFO:teuthology.orchestra.run.smithi079.stdout:1835 trunc from 0xdd1a9f1 to 0xb85540e 2024-09-11T07:06:33.539 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:33.537+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:33.564 INFO:teuthology.orchestra.run.smithi079.stdout:1836 write 0xb50f484 thru 0xb51dff2 (0xeb6f bytes) 2024-09-11T07:06:33.574 INFO:teuthology.orchestra.run.smithi079.stdout:1837 read 0x9ba3ea2 thru 0x9bab8cd (0x7a2c bytes) 2024-09-11T07:06:33.574 INFO:teuthology.orchestra.run.smithi079.stdout:1838 read 0x1d55bcf thru 0x1d62cca (0xd0fc bytes) 2024-09-11T07:06:33.574 INFO:teuthology.orchestra.run.smithi079.stdout:1839 read 0x693d7e3 thru 0x694c99f (0xf1bd bytes) 2024-09-11T07:06:33.574 INFO:teuthology.orchestra.run.smithi079.stdout:1840 read 0x14d911 thru 0x155aed (0x81dd bytes) 2024-09-11T07:06:33.576 INFO:teuthology.orchestra.run.smithi079.stdout:1841 writesame 0x6e28d85 thru 0x6e2bd26 data_size 0x1a(0x2fa2 bytes) 2024-09-11T07:06:33.607 INFO:teuthology.orchestra.run.smithi079.stdout:1843 trunc from 0xb85540e to 0x246ea3b 2024-09-11T07:06:33.610 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:33.610 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:33.610 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:33.610 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:33.610 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:33.626 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:33.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:33.639+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:33.641 INFO:teuthology.orchestra.run.smithi079.stdout:1844 read 0x7ee3c thru 0x8d2fb (0xe4c0 bytes) 2024-09-11T07:06:33.643 INFO:teuthology.orchestra.run.smithi079.stdout:1845 read 0x1ad19ba thru 0x1ae10ed (0xf734 bytes) 2024-09-11T07:06:33.667 INFO:teuthology.orchestra.run.smithi079.stdout:1846 trunc from 0x246ea3b to 0xbe28fcf 2024-09-11T07:06:33.691 INFO:teuthology.orchestra.run.smithi079.stdout:1848 writesame 0xc76b155 thru 0xc77464a data_size 0x17(0x94f6 bytes) 2024-09-11T07:06:33.691 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:33.691 INFO:teuthology.orchestra.run.smithi079.stdout:1850 read 0x50605da thru 0x506ecb5 (0xe6dc bytes) 2024-09-11T07:06:33.691 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:33.691 INFO:teuthology.orchestra.run.smithi079.stdout:1852 write 0x102b0ef thru 0x102e1f3 (0x3105 bytes) 2024-09-11T07:06:33.701 INFO:teuthology.orchestra.run.smithi079.stdout:1854 write 0x3e0591e thru 0x3e11095 (0xb778 bytes) 2024-09-11T07:06:33.728 INFO:teuthology.orchestra.run.smithi079.stdout:1855 write 0xda3af49 thru 0xda3efc2 (0x407a bytes) 2024-09-11T07:06:33.737 INFO:teuthology.orchestra.run.smithi079.stdout:1857 writesame 0xada7d4 thru 0xadae08 data_size 0x1(0x635 bytes) 2024-09-11T07:06:33.742 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:33.739+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:33.746 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:33.781 INFO:teuthology.orchestra.run.smithi079.stdout:1862 trunc from 0xda3efc3 to 0x4caf42 2024-09-11T07:06:33.796 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.5079925620000001, 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:06:33.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.5079204789999991, 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:06:33.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.803 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:33.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:33.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.5078649859999995, 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.807 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:33.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:06:33.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3059930180000006, 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.812 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:33.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:06:33.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3059304279999999, 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:33.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:06:33.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.821 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3058733720000006, 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:06:33.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3058172550000009, 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:06:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:06:33.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:06:33.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3056959930000005, 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:06:33.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:06:33.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3055917239999992, 2024-09-11T07:06:33.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:06:33.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:06:33.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.839 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3054861849999995, 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:06:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:06:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:06:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:06:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3054190220000006, 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:06:33.844 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:06:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:06:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:06:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:06:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3053198160000008, 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:06:33.849 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:06:33.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:06:33.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.305232857, 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.854 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:06:33.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3051725800000007, 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.858 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:06:33.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.862 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.305018875, 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:06:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3049316990000008, 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:33.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:06:33.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.871 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3048677959999999, 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:06:33.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:06:33.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3048079529999992, 2024-09-11T07:06:33.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:06:33.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.880 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3047298709999993, 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.881 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3046721009999995, 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:33.885 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:33.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:33.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:06:33.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:33.889 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:33.891 INFO:teuthology.orchestra.run.smithi079.stdout:1863 writesame 0x30a22fc thru 0x30a9080 data_size 0x17(0x6d85 bytes) 2024-09-11T07:06:33.891 INFO:teuthology.orchestra.run.smithi079.stdout:1865 writesame 0xd48e27b thru 0xd48f5e9 data_size 0x1(0x136f bytes) 2024-09-11T07:06:33.891 INFO:teuthology.orchestra.run.smithi079.stdout:1866 clone 18 order 19 su 65536 sc 4 2024-09-11T07:06:33.891 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:33.892 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:33.885+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:33.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:33.991+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:34.069 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:34.069 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:34.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:36125 3.1d 3:ba5ebbeb:::rbd_header.1161fe1d7848:head [call rbd.get_access_timestamp in=23b out=8b,call rbd.get_modify_timestamp in=23b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e50)", 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:34.069796+0000", 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00031197400000000002, 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036058800000000001, 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 36125 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:34.069796+0000", 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:34.069796+0000", 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:34.069798+0000", 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1160000000000002e-06 2024-09-11T07:06:34.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:34.069809+0000", 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0832999999999999e-05 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:34.069838+0000", 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9215000000000001e-05 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:34.069855+0000", 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6626e-05 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:34.069926+0000", 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1367999999999998e-05 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:34.070034+0000", 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000108158 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.074 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.074 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-11T07:06:34.074 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-09-11T07:06:34.074 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:34.084 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:34.092 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:34.091+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:34.193 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:34.189+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:34.198 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone17 from 0xd48f5ea (overlap 0x4caf42) to 0x1eac80 2024-09-11T07:06:34.212 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:34.213 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:34.228 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:34.316 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:34.313+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:34.396 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:34.393+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:34.397 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085972652000001, 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.398 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:06:34.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.403 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085905098, 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.404 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:06:34.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:06:34.408 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085824261000001, 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.409 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:06:34.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085780915000001, 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:06:34.414 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:06:34.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.08571079, 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.420 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:34.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:06:34.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:06:34.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085642666, 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.425 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:06:34.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:06:34.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:06:34.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.430 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.0856022, 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.432 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.432 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.432 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:06:34.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.432 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:34.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:06:34.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.436 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.437 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:34.437 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085564159, 2024-09-11T07:06:34.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:06:34.437 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.437 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.437 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.437 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.437 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.437 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.437 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:06:34.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:06:34.442 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.442 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.442 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.442 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.442 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:34.442 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085525189, 2024-09-11T07:06:34.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:06:34.442 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:34.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:06:34.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:06:34.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.447 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085484315, 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:06:34.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:06:34.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:06:34.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:06:34.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:06:34.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:06:34.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085156542, 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.453 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:06:34.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:34.458 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085090032, 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:34.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:34.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:06:34.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:06:34.463 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.085022313, 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.464 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:06:34.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:06:34.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.084977374999999, 2024-09-11T07:06:34.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:34.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.08417775, 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:06:34.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:06:34.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:06:34.479 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.084143407999999, 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.480 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:06:34.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:34.485 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.083780732999999, 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:06:34.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.082517707999999, 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:06:34.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:06:34.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.082485209, 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.496 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:06:34.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 6.1458797819999997, 2024-09-11T07:06:34.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:06:34.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:06:34.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:06:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:34.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:34.508 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:34.510 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #16, image image_client.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent17 2024-09-11T07:06:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:1867 read 0x6d54afe thru 0x6d58547 (0x3a4a bytes) 2024-09-11T07:06:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:1868 read 0x48ee1f8 thru 0x48f4ad1 (0x68da bytes) 2024-09-11T07:06:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:1871 writesame 0x17bb4c3 thru 0x17c8404 data_size 0x4a(0xcf42 bytes) 2024-09-11T07:06:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:34.512 INFO:teuthology.orchestra.run.smithi079.stdout:1874 read 0x74e7196 thru 0x74f594c (0xe7b7 bytes) 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:1875 write 0x82c6a14 thru 0x82c88a1 (0x1e8e bytes) 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:1876 trunc from 0xd48f5ea to 0x9a29b80 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:1877 punch from 0x7f97ac to 0x805220, (0xba74 bytes) 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:1880 punch from 0x4a02190 to 0x4a05674, (0x34e4 bytes) 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:1881 punch from 0x108cebf to 0x1094e27, (0x7f68 bytes) 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:1883 trunc from 0x9a29b80 to 0xb57f959 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:1886 read 0x149f9ce thru 0x14a932f (0x9962 bytes) 2024-09-11T07:06:34.513 INFO:teuthology.orchestra.run.smithi079.stdout:1887 write 0x7f117a8 thru 0x7f1d2ab (0xbb04 bytes) 2024-09-11T07:06:34.514 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:34.507+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:1889 punch from 0x27eee4e to 0x27f4b24, (0x5cd6 bytes) 2024-09-11T07:06:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:1890 punch from 0x62788d0 to 0x6283b9b, (0xb2cb bytes) 2024-09-11T07:06:34.514 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:34.536 INFO:teuthology.orchestra.run.smithi079.stdout:1894 trunc from 0xb57f959 to 0x1963712 2024-09-11T07:06:34.571 INFO:teuthology.orchestra.run.smithi079.stdout:1895 read 0x19395e1 thru 0x19435db (0x9ffb bytes) 2024-09-11T07:06:34.589 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:34.610 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:34.605+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:34.614 INFO:teuthology.orchestra.run.smithi079.stdout:1896 write 0xed4abe4 thru 0xed50faa (0x63c7 bytes) 2024-09-11T07:06:34.620 INFO:teuthology.orchestra.run.smithi079.stdout:1897 read 0x34c4fa3 thru 0x34d26b0 (0xd70e bytes) 2024-09-11T07:06:34.620 INFO:teuthology.orchestra.run.smithi079.stdout:1898 write 0x31dcffc thru 0x31e367c (0x6681 bytes) 2024-09-11T07:06:34.633 INFO:teuthology.orchestra.run.smithi079.stdout:1899 trunc from 0xed50fab to 0xc6e87c7 2024-09-11T07:06:34.652 INFO:teuthology.orchestra.run.smithi079.stdout:1900 punch from 0x8b56c3a to 0x8b57155, (0x51b bytes) 2024-09-11T07:06:34.652 INFO:teuthology.orchestra.run.smithi079.stdout:1902 write 0x2d49aa thru 0x2e105a (0xc6b1 bytes) 2024-09-11T07:06:34.660 INFO:teuthology.orchestra.run.smithi079.stdout:1903 punch from 0x8307132 to 0x83101cd, (0x909b bytes) 2024-09-11T07:06:34.660 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:34.660 INFO:teuthology.orchestra.run.smithi079.stdout:1905 clone 19 order 19 su 262144 sc 9 2024-09-11T07:06:34.689 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:34.689 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:34.689 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:34.702 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:34.711 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:34.711+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:34.736 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:34.737 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:34.751 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:34.751 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:34.767 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:34.767 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:34.783 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:34.783 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:34.801 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:34.802 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:34.812 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:34.809+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:34.819 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:34.819 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:34.839 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:34.859 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:34.860 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:34.866 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:34.866 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:34.880 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:34.924 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:34.921+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:35.014 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:35.009+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:35.046 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:06:35.047 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:35.048 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:35.064 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:35.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:35.111+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:35.184 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone18 from 0xc6e87c7 (overlap 0x1963712) to 0x144f8db 2024-09-11T07:06:35.215 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:35.213+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:35.238 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:35.239 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:35.253 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:35.340 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:35.337+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:35.381 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #17, image image_client.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent18 2024-09-11T07:06:35.397 INFO:teuthology.orchestra.run.smithi079.stdout:1907 write 0xc3535ec thru 0xc355d8c (0x27a1 bytes) 2024-09-11T07:06:35.409 INFO:teuthology.orchestra.run.smithi079.stdout:1908 write 0x12bba86 thru 0x12c8bee (0xd169 bytes) 2024-09-11T07:06:35.416 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:35.416 INFO:teuthology.orchestra.run.smithi079.stdout:1910 read 0xbcf2187 thru 0xbcf8421 (0x629b bytes) 2024-09-11T07:06:35.416 INFO:teuthology.orchestra.run.smithi079.stdout:1912 read 0x935fe17 thru 0x936f858 (0xfa42 bytes) 2024-09-11T07:06:35.416 INFO:teuthology.orchestra.run.smithi079.stdout:1913 read 0x5e18154 thru 0x5e264ad (0xe35a bytes) 2024-09-11T07:06:35.416 INFO:teuthology.orchestra.run.smithi079.stdout:1914 punch from 0x33d659b to 0x33dbc65, (0x56ca bytes) 2024-09-11T07:06:35.416 INFO:teuthology.orchestra.run.smithi079.stdout:1915 write 0x3600a62 thru 0x36010ec (0x68b bytes) 2024-09-11T07:06:35.417 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:35.415+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:35.421 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:35.421 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:35.421 INFO:teuthology.orchestra.run.smithi079.stdout:1917 writesame 0x4e17821 thru 0x4e2150c data_size 0x2c(0x9cec bytes) 2024-09-11T07:06:35.429 INFO:teuthology.orchestra.run.smithi079.stdout:1918 read 0x9695614 thru 0x969e986 (0x9373 bytes) 2024-09-11T07:06:35.429 INFO:teuthology.orchestra.run.smithi079.stdout:1919 read 0xc08c660 thru 0xc0917cb (0x516c bytes) 2024-09-11T07:06:35.429 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:35.429 INFO:teuthology.orchestra.run.smithi079.stdout:1921 writesame 0x4a1809c thru 0x4a230e4 data_size 0x31(0xb049 bytes) 2024-09-11T07:06:35.436 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:35.465 INFO:teuthology.orchestra.run.smithi079.stdout:1922 trunc from 0xc6e87c7 to 0x78c434 2024-09-11T07:06:35.519 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:35.515+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:35.542 INFO:teuthology.orchestra.run.smithi079.stdout:1923 write 0xb705f32 thru 0xb70c571 (0x6640 bytes) 2024-09-11T07:06:35.565 INFO:teuthology.orchestra.run.smithi079.stdout:1924 trunc from 0xb70c572 to 0x4a1dc62 2024-09-11T07:06:35.605 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:35.605 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:35.608 INFO:teuthology.orchestra.run.smithi079.stdout:1925 write 0x7143a60 thru 0x715074c (0xcced bytes) 2024-09-11T07:06:35.616 INFO:teuthology.orchestra.run.smithi079.stdout:1926 read 0x6a39ae4 thru 0x6a3bf18 (0x2435 bytes) 2024-09-11T07:06:35.616 INFO:teuthology.orchestra.run.smithi079.stdout:1927 punch from 0x548d501 to 0x5495dee, (0x88ed bytes) 2024-09-11T07:06:35.616 INFO:teuthology.orchestra.run.smithi079.stdout:1928 read 0x6d7547c thru 0x6d7ee23 (0x99a8 bytes) 2024-09-11T07:06:35.616 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:35.616 INFO:teuthology.orchestra.run.smithi079.stdout:1931 read 0x10048ac thru 0x100e16e (0x98c3 bytes) 2024-09-11T07:06:35.616 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:35.616 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:35.616 INFO:teuthology.orchestra.run.smithi079.stdout:1934 read 0x54073df thru 0x540be6e (0x4a90 bytes) 2024-09-11T07:06:35.619 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:35.617+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:35.620 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:35.629 INFO:teuthology.orchestra.run.smithi079.stdout:1935 writesame 0x7bc66d5 thru 0x7bca49a data_size 0x1(0x3dc6 bytes) 2024-09-11T07:06:35.629 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:35.630 INFO:teuthology.orchestra.run.smithi079.stdout:1938 write 0x43b28f2 thru 0x43b7bd4 (0x52e3 bytes) 2024-09-11T07:06:35.635 INFO:teuthology.orchestra.run.smithi079.stdout:1939 read 0x7ab349f thru 0x7abb478 (0x7fda bytes) 2024-09-11T07:06:35.661 INFO:teuthology.orchestra.run.smithi079.stdout:1940 write 0xeac7b38 thru 0xeacbaa9 (0x3f72 bytes) 2024-09-11T07:06:35.665 INFO:teuthology.orchestra.run.smithi079.stdout:1942 read 0x6afbc9d thru 0x6b00447 (0x47ab bytes) 2024-09-11T07:06:35.665 INFO:teuthology.orchestra.run.smithi079.stdout:1943 write 0x84525a0 thru 0x845b0b7 (0x8b18 bytes) 2024-09-11T07:06:35.671 INFO:teuthology.orchestra.run.smithi079.stdout:1944 write 0x539a3c thru 0x5460b9 (0xc67e bytes) 2024-09-11T07:06:35.676 INFO:teuthology.orchestra.run.smithi079.stdout:1945 trunc from 0xeacbaaa to 0xec670f6 2024-09-11T07:06:35.692 INFO:teuthology.orchestra.run.smithi079.stdout:1946 write 0x96f9343 thru 0x97058eb (0xc5a9 bytes) 2024-09-11T07:06:35.698 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:35.699 INFO:teuthology.orchestra.run.smithi079.stdout:1948 writesame 0x2e63389 thru 0x2e715aa data_size 0x23(0xe222 bytes) 2024-09-11T07:06:35.703 INFO:teuthology.orchestra.run.smithi079.stdout:1949 punch from 0x8276f6d to 0x82791f9, (0x228c bytes) 2024-09-11T07:06:35.721 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:35.717+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:35.735 INFO:teuthology.orchestra.run.smithi079.stdout:1950 trunc from 0xec670f6 to 0xe2498a 2024-09-11T07:06:35.757 INFO:teuthology.orchestra.run.smithi079.stdout:1951 read 0x57ca79 thru 0x582a38 (0x5fc0 bytes) 2024-09-11T07:06:35.758 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:35.759 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:35.759 INFO:teuthology.orchestra.run.smithi079.stdout:1952 trunc from 0xe2498a to 0xaf0f1f 2024-09-11T07:06:35.776 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:35.799 INFO:teuthology.orchestra.run.smithi079.stdout:1953 write 0x9f2f5d2 thru 0x9f3872c (0x915b bytes) 2024-09-11T07:06:35.806 INFO:teuthology.orchestra.run.smithi079.stdout:1954 punch from 0x78087fc to 0x780c361, (0x3b65 bytes) 2024-09-11T07:06:35.822 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:35.817+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:35.824 INFO:teuthology.orchestra.run.smithi079.stdout:1955 write 0xe727fae thru 0xe728a87 (0xada bytes) 2024-09-11T07:06:35.831 INFO:teuthology.orchestra.run.smithi079.stdout:1957 writesame 0xdf625d8 thru 0xdf6c631 data_size 0x19(0xa05a bytes) 2024-09-11T07:06:35.839 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:35.839 INFO:teuthology.orchestra.run.smithi079.stdout:1959 writesame 0x58825ca thru 0x5883c75 data_size 0x2(0x16ac bytes) 2024-09-11T07:06:35.861 INFO:teuthology.orchestra.run.smithi079.stdout:1961 trunc from 0xe728a88 to 0x416094a 2024-09-11T07:06:35.896 INFO:teuthology.orchestra.run.smithi079.stdout:1962 write 0x6478b9d thru 0x647b22f (0x2693 bytes) 2024-09-11T07:06:35.902 INFO:teuthology.orchestra.run.smithi079.stdout:1963 write 0x342f575 thru 0x3430eaf (0x193b bytes) 2024-09-11T07:06:35.923 INFO:teuthology.orchestra.run.smithi079.stdout:1964 write 0x90c8bd5 thru 0x90cc596 (0x39c2 bytes) 2024-09-11T07:06:35.923 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:35.923+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:35.930 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:35.930 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:35.930 INFO:teuthology.orchestra.run.smithi079.stdout:1965 writesame 0x39ca091 thru 0x39d586c data_size 0x52(0xb7dc bytes) 2024-09-11T07:06:35.947 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:35.954 INFO:teuthology.orchestra.run.smithi079.stdout:1966 write 0xc942a91 thru 0xc949f9d (0x750d bytes) 2024-09-11T07:06:35.960 INFO:teuthology.orchestra.run.smithi079.stdout:1967 write 0x7ee3944 thru 0x7ee5128 (0x17e5 bytes) 2024-09-11T07:06:35.976 INFO:teuthology.orchestra.run.smithi079.stdout:1969 trunc from 0xc949f9e to 0x65c776f 2024-09-11T07:06:35.998 INFO:teuthology.orchestra.run.smithi079.stdout:1970 trunc from 0x65c776f to 0x71ff534 2024-09-11T07:06:36.006 INFO:teuthology.orchestra.run.smithi079.stdout:1971 punch from 0x430ddd6 to 0x430f4ad, (0x16d7 bytes) 2024-09-11T07:06:36.018 INFO:teuthology.orchestra.run.smithi079.stdout:1972 write 0x97b3ebd thru 0x97b94eb (0x562f bytes) 2024-09-11T07:06:36.025 INFO:teuthology.orchestra.run.smithi079.stdout:1974 read 0x1b71bde thru 0x1b74569 (0x298c bytes) 2024-09-11T07:06:36.025 INFO:teuthology.orchestra.run.smithi079.stdout:1975 write 0x171004a thru 0x1718baa (0x8b61 bytes) 2024-09-11T07:06:36.025 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:36.023+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:36.030 INFO:teuthology.orchestra.run.smithi079.stdout:1976 punch from 0x6233b97 to 0x6237971, (0x3dda bytes) 2024-09-11T07:06:36.030 INFO:teuthology.orchestra.run.smithi079.stdout:1978 read 0x4f748bf thru 0x4f74f8b (0x6cd bytes) 2024-09-11T07:06:36.033 INFO:teuthology.orchestra.run.smithi079.stdout:1980 trunc from 0x97b94ec to 0xb3ba7ca 2024-09-11T07:06:36.034 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:06:36.047 INFO:teuthology.orchestra.run.smithi079.stdout:1982 write 0x23dfe74 thru 0x23eb5d2 (0xb75f bytes) 2024-09-11T07:06:36.055 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:36.055 INFO:teuthology.orchestra.run.smithi079.stdout:1984 read 0x530f0e thru 0x536e37 (0x5f2a bytes) 2024-09-11T07:06:36.056 INFO:teuthology.orchestra.run.smithi079.stdout:1985 punch from 0xa0fa73e to 0xa0fa8e3, (0x1a5 bytes) 2024-09-11T07:06:36.057 INFO:teuthology.orchestra.run.smithi079.stdout:1986 writesame 0x3e74502 thru 0x3e75565 data_size 0x2(0x1064 bytes) 2024-09-11T07:06:36.074 INFO:teuthology.orchestra.run.smithi079.stdout:1987 write 0xcfc12a3 thru 0xcfc13db (0x139 bytes) 2024-09-11T07:06:36.080 INFO:teuthology.orchestra.run.smithi079.stdout:1988 punch from 0x92494c3 to 0x9257185, (0xdcc2 bytes) 2024-09-11T07:06:36.081 INFO:teuthology.orchestra.run.smithi079.stdout:1989 trunc from 0xcfc13dc to 0xc4d70eb 2024-09-11T07:06:36.093 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:36.094 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:36.097 INFO:teuthology.orchestra.run.smithi079.stdout:1991 read 0x2971fa thru 0x2a6b1a (0xf921 bytes) 2024-09-11T07:06:36.098 INFO:teuthology.orchestra.run.smithi079.stdout:1993 punch from 0x8c86f7f to 0x8c92b9f, (0xbc20 bytes) 2024-09-11T07:06:36.098 INFO:teuthology.orchestra.run.smithi079.stdout:1994 write 0xb97a175 thru 0xb987111 (0xcf9d bytes) 2024-09-11T07:06:36.106 INFO:teuthology.orchestra.run.smithi079.stdout:1995 read 0x6239f35 thru 0x623ef09 (0x4fd5 bytes) 2024-09-11T07:06:36.106 INFO:teuthology.orchestra.run.smithi079.stdout:1996 punch from 0x8848096 to 0x8856ea0, (0xee0a bytes) 2024-09-11T07:06:36.106 INFO:teuthology.orchestra.run.smithi079.stdout:1997 punch from 0x76e6b37 to 0x76eff3a, (0x9403 bytes) 2024-09-11T07:06:36.106 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:36.107 INFO:teuthology.orchestra.run.smithi079.stdout:1999 clone 20 order 22 su 131072 sc 15 2024-09-11T07:06:36.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:36.136 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:06:36.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T07:06:36.152 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:36.151+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:36.226 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:36.223+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:36.269 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:36.270 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:36.285 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:36.327 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:36.325+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:36.427 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:36.421+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:36.442 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:36.442 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:36.456 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:36.528 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:36.525+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:36.572 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:36.572 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:36.586 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:36.629 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:36.625+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:36.712 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:36.712 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:36.727 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:36.730 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:36.725+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:36.831 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:36.825+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:36.843 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:36.843 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:36.858 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:36.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:36.932 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:36.929+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:36.981 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:36.981 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:36.997 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:37.032 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:37.029+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:37.045 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T07:06:37.050 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:37.050 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:37.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T07:06:37.070 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:37.071 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:37.091 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:37.091 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:37.109 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:37.109 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:37.129 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:37.129 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:37.129 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:37.129 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:37.130 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:37.130 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:37.134 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:37.131+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:37.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:37.153 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:37.153 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:37.189 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:37.190 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:37.212 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:37.212 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:37.221 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone19 from 0xc4d70eb (overlap 0x78c434) to 0x0 2024-09-11T07:06:37.236 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:37.235+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:37.289 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:37.289 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:37.289 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:37.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:37.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:37.347+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:37.421 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6914 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4472832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.746052122000002, 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030418942000000001, 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.422 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6914 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675888+0000", 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4799999999999998e-07 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675891+0000", 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5150000000000001e-06 2024-09-11T07:06:37.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675898+0000", 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9040000000000003e-06 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675903+0000", 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6180000000000003e-06 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706154+0000", 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030250969999999999 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706235+0000", 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0343e-05 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706307+0000", 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1944000000000001e-05 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6915 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.746029382, 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030587597000000001, 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6915 2024-09-11T07:06:37.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676263+0000", 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035270599999999999 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676268+0000", 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0860000000000001e-06 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676280+0000", 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1863e-05 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676288+0000", 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5599999999999996e-06 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706353+0000", 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030065614000000001 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706438+0000", 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5041000000000001e-05 2024-09-11T07:06:37.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706498+0000", 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9726999999999999e-05 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6917 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5341184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.745615167, 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030468918000000001, 2024-09-11T07:06:37.431 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6917 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0500000000000003e-07 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676328+0000", 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3980000000000002e-06 2024-09-11T07:06:37.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676335+0000", 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2649999999999999e-06 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676340+0000", 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4809999999999997e-06 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706664+0000", 2024-09-11T07:06:37.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030323033999999999 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706731+0000", 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7639999999999996e-05 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706794+0000", 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2495000000000004e-05 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.435 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6918 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5455872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.745592107, 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594758999999999, 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.436 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6918 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-07 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676350+0000", 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0940000000000002e-06 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676357+0000", 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5699999999999998e-06 2024-09-11T07:06:37.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676362+0000", 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706819+0000", 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456987000000001 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706885+0000", 2024-09-11T07:06:37.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6054000000000001e-05 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706943+0000", 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7556000000000003e-05 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6919 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:37.440 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.745570355000002, 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030730071000000001, 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6919 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:37.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676595+0000", 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225577 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676599+0000", 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3540000000000002e-06 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676611+0000", 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1037e-05 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676618+0000", 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4050000000000003e-06 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706966+0000", 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030348373000000001 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707032+0000", 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5736999999999998e-05 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707100+0000", 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7588000000000004e-05 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6920 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6209536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.745309766999998, 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030647992999999998, 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.445 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6920 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676631+0000", 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999999e-07 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676633+0000", 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.729e-06 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676641+0000", 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7659999999999998e-06 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676647+0000", 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7930000000000003e-06 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707128+0000", 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030481028 2024-09-11T07:06:37.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707211+0000", 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2792000000000003e-05 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707278+0000", 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7288999999999999e-05 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6921 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6324224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.745284338000001, 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030787063999999999, 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6921 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.450 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:37.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7700000000000004e-07 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676660+0000", 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.997e-06 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676667+0000", 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2910000000000002e-06 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676673+0000", 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6010000000000002e-06 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707305+0000", 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030632029000000002 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707380+0000", 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5265999999999994e-05 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707443+0000", 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2303000000000003e-05 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6922 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6438912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.745258810999999, 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031018718000000001, 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.454 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6922 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676852+0000", 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000171371 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676857+0000", 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6380000000000003e-06 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676867+0000", 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0268000000000001e-05 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676875+0000", 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5320000000000001e-06 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707469+0000", 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030593615000000001 2024-09-11T07:06:37.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707632+0000", 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016336399999999999 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707700+0000", 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7929999999999995e-05 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6923 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6553600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.745052582, 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030968105999999999, 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6923 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676888+0000", 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7000000000000005e-07 2024-09-11T07:06:37.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676895+0000", 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1110000000000002e-06 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676902+0000", 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2030000000000003e-06 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676908+0000", 2024-09-11T07:06:37.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6200000000000004e-06 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707728+0000", 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030820163000000001 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707797+0000", 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8737000000000003e-05 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707855+0000", 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8702000000000001e-05 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6924 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7192576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.745023250999999, 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031099157999999998, 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.463 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6924 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4000000000000001e-07 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676921+0000", 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6899999999999998e-06 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676928+0000", 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8260000000000004e-06 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676933+0000", 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3109999999999996e-06 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707879+0000", 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030946265000000001 2024-09-11T07:06:37.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707946+0000", 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6365000000000006e-05 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708016+0000", 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0061000000000006e-05 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6925 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.744997395999999, 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.03121956, 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6925 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.468 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676996+0000", 2024-09-11T07:06:37.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3483000000000003e-05 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677000+0000", 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1840000000000001e-06 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677009+0000", 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2390000000000008e-06 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677016+0000", 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0600000000000002e-06 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708042+0000", 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031025569999999999 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708106+0000", 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3723e-05 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708162+0000", 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6301000000000002e-05 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7045 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5472256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.739985838999999, 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456286999999999, 2024-09-11T07:06:37.472 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7045 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682107+0000", 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015256800000000001 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682111+0000", 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0450000000000002e-06 2024-09-11T07:06:37.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682120+0000", 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6569999999999992e-06 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682127+0000", 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6239999999999996e-06 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712254+0000", 2024-09-11T07:06:37.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030127068 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712333+0000", 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8788999999999994e-05 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712410+0000", 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7535999999999998e-05 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.476 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7046 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5586944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.739801251999999, 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030486447, 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.477 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7046 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5400000000000001e-07 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682142+0000", 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7429999999999998e-06 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682149+0000", 2024-09-11T07:06:37.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3209999999999999e-06 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682155+0000", 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7620000000000001e-06 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712454+0000", 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030298814 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712563+0000", 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010932 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712625+0000", 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1933000000000005e-05 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7047 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:37.481 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.739777200999999, 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030677043000000001, 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7047 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:37.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682532+0000", 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036941099999999999 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682537+0000", 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2469999999999999e-06 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682547+0000", 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9000000000000001e-06 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682554+0000", 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2060000000000001e-06 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712666+0000", 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030111422999999998 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712761+0000", 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5212999999999998e-05 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712840+0000", 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8642999999999999e-05 2024-09-11T07:06:37.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7048 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6340608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.739372029999998, 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494950999999999, 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7048 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7299999999999996e-07 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682571+0000", 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7760000000000002e-06 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682577+0000", 2024-09-11T07:06:37.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0209999999999996e-06 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682584+0000", 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8630000000000002e-06 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712904+0000", 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030320347000000001 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712987+0000", 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2367000000000006e-05 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713063+0000", 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6003999999999999e-05 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7049 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6455296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.490 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.739347379000002, 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030670962999999999, 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7049 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7199999999999999e-07 2024-09-11T07:06:37.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682596+0000", 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5189999999999999e-06 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682602+0000", 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7240000000000003e-06 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682607+0000", 2024-09-11T07:06:37.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2410000000000003e-06 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713102+0000", 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494841000000002 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713189+0000", 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6697e-05 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713263+0000", 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4468999999999995e-05 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7050 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6569984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.739323817999999, 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030850200000000001, 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7050 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682617+0000", 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682619+0000", 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2450000000000001e-06 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682627+0000", 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0520000000000002e-06 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682632+0000", 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2750000000000003e-06 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713310+0000", 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030678305999999999 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713391+0000", 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0164e-05 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713466+0000", 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5703000000000003e-05 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7051 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6684672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.739300291999999, 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030997008, 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.500 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7051 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682684+0000", 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4625e-05 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682695+0000", 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0575e-05 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682703+0000", 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1389999999999995e-06 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682709+0000", 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713498+0000", 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030789092000000001 2024-09-11T07:06:37.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713571+0000", 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2554999999999999e-05 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713637+0000", 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5950000000000004e-05 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7052 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 26.739221104999999, 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031135348, 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7052 2024-09-11T07:06:37.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683050+0000", 2024-09-11T07:06:37.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033088699999999998 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683054+0000", 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.651e-06 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683066+0000", 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1372000000000001e-05 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683074+0000", 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5939999999999994e-06 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713669+0000", 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594982 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713786+0000", 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116937 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713854+0000", 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7924999999999998e-05 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:33510 3.b 3:d16a5966:::rbd_object_map.116176c25662:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.0469915259999993, 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034759883999999998, 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:37.509 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 33510 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374951+0000", 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374966+0000", 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4623e-05 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374992+0000", 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-05 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375006+0000", 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3492999999999999e-05 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375078+0000", 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2125999999999994e-05 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375151+0000", 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3250000000000005e-05 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.408158+0000", 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033006967999999998 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409176+0000", 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001018288 2024-09-11T07:06:37.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409544+0000", 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000367201 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409629+0000", 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5280999999999999e-05 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409708+0000", 2024-09-11T07:06:37.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9383999999999998e-05 2024-09-11T07:06:37.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:37.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:37.515 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:37.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:37.517 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #18, image image_client.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent19 2024-09-11T07:06:37.517 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:37.515+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:37.610 INFO:teuthology.orchestra.run.smithi079.stdout:2000 writesame 0xe88e092 thru 0xe893cc0 data_size 0x1(0x5c2f bytes) 2024-09-11T07:06:37.617 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:37.615+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:37.618 INFO:teuthology.orchestra.run.smithi079.stdout:2001 writesame 0x4a8cd64 thru 0x4a95c32 data_size 0x1(0x8ecf bytes) 2024-09-11T07:06:37.650 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:37.650 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:37.651 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:37.664 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:37.670 INFO:teuthology.orchestra.run.smithi079.stdout:2003 write 0xff63c8 thru 0xfff7d2 (0x940b bytes) 2024-09-11T07:06:37.688 INFO:teuthology.orchestra.run.smithi079.stdout:2005 trunc from 0xe893cc1 to 0xb3e270c 2024-09-11T07:06:37.709 INFO:teuthology.orchestra.run.smithi079.stdout:2006 read 0x3229be3 thru 0x322f6b0 (0x5ace bytes) 2024-09-11T07:06:37.710 INFO:teuthology.orchestra.run.smithi079.stdout:2007 writesame 0x492251b thru 0x492fe49 data_size 0x3(0xd92f bytes) 2024-09-11T07:06:37.718 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:37.713+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:37.723 INFO:teuthology.orchestra.run.smithi079.stdout:2008 punch from 0x8592642 to 0x8592dde, (0x79c bytes) 2024-09-11T07:06:37.741 INFO:teuthology.orchestra.run.smithi079.stdout:2009 trunc from 0xb3e270c to 0x4a5c4ae 2024-09-11T07:06:37.783 INFO:teuthology.orchestra.run.smithi079.stdout:2010 write 0x703f6 thru 0x76535 (0x6140 bytes) 2024-09-11T07:06:37.796 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:37.796 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:37.796 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:37.797 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:37.797 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:37.811 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:37.818 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:37.815+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:37.822 INFO:teuthology.orchestra.run.smithi079.stdout:2012 writesame 0xc1b146b thru 0xc1b7be3 data_size 0x1(0x6779 bytes) 2024-09-11T07:06:37.822 INFO:teuthology.orchestra.run.smithi079.stdout:2013 punch from 0x47f82bd to 0x4806f34, (0xec77 bytes) 2024-09-11T07:06:37.834 INFO:teuthology.orchestra.run.smithi079.stdout:2014 write 0xdd38966 thru 0xdd3b43a (0x2ad5 bytes) 2024-09-11T07:06:37.841 INFO:teuthology.orchestra.run.smithi079.stdout:2015 writesame 0x38a9216 thru 0x38ae498 data_size 0x3(0x5283 bytes) 2024-09-11T07:06:37.847 INFO:teuthology.orchestra.run.smithi079.stdout:2016 read 0x8c76b49 thru 0x8c76f6e (0x426 bytes) 2024-09-11T07:06:37.856 INFO:teuthology.orchestra.run.smithi079.stdout:2017 trunc from 0xdd3b43b to 0xae3a51f 2024-09-11T07:06:37.873 INFO:teuthology.orchestra.run.smithi079.stdout:2020 clone 21 order 23 su 524288 sc 9 2024-09-11T07:06:37.919 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:37.913+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:37.977 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.68892228, 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:37.978 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:37.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.982 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.688850197000001, 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:37.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:06:37.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:06:37.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:37.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.688794703999999, 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:37.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:37.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.991 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.486922736, 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:37.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:06:37.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:06:37.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:37.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.486860146, 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:37.996 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:37.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:37.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.48680309, 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:06:38.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:06:38.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.486746973000001, 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.009 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.010 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:38.010 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.486625711, 2024-09-11T07:06:38.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:06:38.010 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.010 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.010 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.010 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:06:38.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:06:38.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:38.014 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.486521442000001, 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:38.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.018 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.486415902999999, 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:06:38.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:06:38.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.48634874, 2024-09-11T07:06:38.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:06:38.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.486249534000001, 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:06:38.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:06:38.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.486162575, 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.032 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.036 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.486102298, 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:06:38.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:06:38.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.485948593, 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.041 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:38.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.045 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.485861417000001, 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:06:38.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:06:38.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.485797514, 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.050 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:06:38.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.054 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.485737671000001, 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:06:38.058 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.485659589000001, 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:06:38.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:06:38.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.485601818999999, 2024-09-11T07:06:38.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:06:38.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.067 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.068 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.068 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:38.068 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:06:38.069 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T07:06:38.070 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:38.070 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:38.065+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:38.077 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T07:06:38.170 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:38.165+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:38.214 INFO:teuthology.orchestra.run.smithi079.stdout:leaving image image_client.0-clone20 intact 2024-09-11T07:06:38.248 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:38.248 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:38.248 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:38.248 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:38.262 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:38.271 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:38.271+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:38.372 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:38.369+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:38.431 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:38.432 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:38.432 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:38.432 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:38.432 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:38.446 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:38.452 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #19, image image_client.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent20 2024-09-11T07:06:38.454 INFO:teuthology.orchestra.run.smithi079.stdout:2021 read 0x7a8fc82 thru 0x7a90604 (0x983 bytes) 2024-09-11T07:06:38.454 INFO:teuthology.orchestra.run.smithi079.stdout:2022 read 0xa033b9f thru 0xa036a53 (0x2eb5 bytes) 2024-09-11T07:06:38.455 INFO:teuthology.orchestra.run.smithi079.stdout:2023 write 0x207c80c thru 0x207e128 (0x191d bytes) 2024-09-11T07:06:38.473 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:38.471+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:38.484 INFO:teuthology.orchestra.run.smithi079.stdout:2024 read 0xc9e564 thru 0xca7534 (0x8fd1 bytes) 2024-09-11T07:06:38.484 INFO:teuthology.orchestra.run.smithi079.stdout:2025 punch from 0x24a1f51 to 0x24a289d, (0x94c bytes) 2024-09-11T07:06:38.484 INFO:teuthology.orchestra.run.smithi079.stdout:2026 punch from 0x6cd28f2 to 0x6cd84ce, (0x5bdc bytes) 2024-09-11T07:06:38.484 INFO:teuthology.orchestra.run.smithi079.stdout:2029 read 0x74c5f79 thru 0x74ccaff (0x6b87 bytes) 2024-09-11T07:06:38.484 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:38.497 INFO:teuthology.orchestra.run.smithi079.stdout:2031 trunc from 0xae3a51f to 0x2b643a5 2024-09-11T07:06:38.558 INFO:teuthology.orchestra.run.smithi079.stdout:2032 writesame 0x2387261 thru 0x2394216 data_size 0xb(0xcfb6 bytes) 2024-09-11T07:06:38.574 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:38.571+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:38.582 INFO:teuthology.orchestra.run.smithi079.stdout:2033 write 0xa8d8910 thru 0xa8e2f0b (0xa5fc bytes) 2024-09-11T07:06:38.587 INFO:teuthology.orchestra.run.smithi079.stdout:2035 writesame 0x6f0fc59 thru 0x6f17f65 data_size 0x35(0x830d bytes) 2024-09-11T07:06:38.601 INFO:teuthology.orchestra.run.smithi079.stdout:2036 write 0xb4ca942 thru 0xb4d8e38 (0xe4f7 bytes) 2024-09-11T07:06:38.612 INFO:teuthology.orchestra.run.smithi079.stdout:2037 trunc from 0xb4d8e39 to 0x86ae716 2024-09-11T07:06:38.628 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.316550313, 2024-09-11T07:06:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:06:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.629 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:06:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:06:38.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:06:38.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:06:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:06:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:06:38.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.634 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.316482758999999, 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.635 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:06:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:06:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:06:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:06:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:06:38.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:06:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:06:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:06:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:06:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:06:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:06:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:06:38.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:06:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:06:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.316401922000001, 2024-09-11T07:06:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:06:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:06:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.316358575999999, 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.651 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:06:38.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:06:38.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.316288450999998, 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.656 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:06:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:06:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:06:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:06:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:06:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:06:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:06:38.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:06:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:06:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:06:38.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:06:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:06:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:06:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:06:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.316220327, 2024-09-11T07:06:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:06:38.664 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:06:38.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:06:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:06:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:06:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:06:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:06:38.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:06:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:06:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:06:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:06:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:06:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:06:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:06:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:06:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:06:38.672 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:38.673 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.316179860999998, 2024-09-11T07:06:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:06:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:06:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:38.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:06:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:06:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:06:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:06:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:06:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:06:38.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:06:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:06:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:06:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:06:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:06:38.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:06:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:06:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:06:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.681 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.316141819999999, 2024-09-11T07:06:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:06:38.682 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:06:38.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:06:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:06:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:06:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:06:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:06:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:06:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:06:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:06:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:06:38.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:06:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:06:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:06:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:06:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.691 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.691 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:38.691 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.31610285, 2024-09-11T07:06:38.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:06:38.691 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.691 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.692 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.692 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:06:38.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.693 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:38.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:38.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:38.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:06:38.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:06:38.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:06:38.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:06:38.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:06:38.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:06:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:06:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:06:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:06:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:06:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:06:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:06:38.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:06:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.701 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.316061976, 2024-09-11T07:06:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:06:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:06:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:06:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:06:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:06:38.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:06:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:06:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:06:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:06:38.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.315734203000002, 2024-09-11T07:06:38.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:06:38.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:06:38.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:06:38.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:06:38.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:38.714 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.315667693000002, 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:06:38.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:06:38.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:06:38.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.315599974000001, 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.719 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:06:38.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:38.723 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.315555035999999, 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:38.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.727 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.314755411, 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.728 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:06:38.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.314721069000001, 2024-09-11T07:06:38.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:06:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:06:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.733 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:06:38.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:06:38.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.314358393999999, 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:06:38.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.313095368999999, 2024-09-11T07:06:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:06:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:06:38.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:06:38.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.31306287, 2024-09-11T07:06:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:06:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.747 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:06:38.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:06:38.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:06:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:06:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:06:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:06:38.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 10.376457443, 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:38.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:38.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:06:38.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:38.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:06:38.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:06:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:06:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:38.758 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:38.758 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:38.761 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:38.761 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:38.757+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:38.762 INFO:teuthology.orchestra.run.smithi079.stdout:2038 read 0xd325d9 thru 0xd40f00 (0xe928 bytes) 2024-09-11T07:06:38.762 INFO:teuthology.orchestra.run.smithi079.stdout:2039 writesame 0xe31e2b7 thru 0xe32a865 data_size 0x3(0xc5af bytes) 2024-09-11T07:06:38.762 INFO:teuthology.orchestra.run.smithi079.stdout:2040 punch from 0x4ee4ceb to 0x4ee8cf1, (0x4006 bytes) 2024-09-11T07:06:38.762 INFO:teuthology.orchestra.run.smithi079.stdout:2041 read 0x63aa5d0 thru 0x63b36ab (0x90dc bytes) 2024-09-11T07:06:38.762 INFO:teuthology.orchestra.run.smithi079.stdout:2042 read 0x5d85322 thru 0x5d88e1a (0x3af9 bytes) 2024-09-11T07:06:38.762 INFO:teuthology.orchestra.run.smithi079.stdout:2043 trunc from 0xe32a866 to 0x630281e 2024-09-11T07:06:38.762 INFO:teuthology.orchestra.run.smithi079.stdout:2044 trunc from 0x630281e to 0x9fa5738 2024-09-11T07:06:38.762 INFO:teuthology.orchestra.run.smithi079.stdout:2046 write 0x804f781 thru 0x805c59f (0xce1f bytes) 2024-09-11T07:06:38.762 INFO:teuthology.orchestra.run.smithi079.stdout:2050 trunc from 0x9fa5738 to 0x8fb7ca8 2024-09-11T07:06:38.763 INFO:teuthology.orchestra.run.smithi079.stdout:2051 punch from 0x180c555 to 0x1812d69, (0x6814 bytes) 2024-09-11T07:06:38.763 INFO:teuthology.orchestra.run.smithi079.stdout:2052 read 0x459c370 thru 0x45a9f14 (0xdba5 bytes) 2024-09-11T07:06:38.763 INFO:teuthology.orchestra.run.smithi079.stdout:2053 write 0xab0fb89 thru 0xab1ce7b (0xd2f3 bytes) 2024-09-11T07:06:38.763 INFO:teuthology.orchestra.run.smithi079.stdout:2055 trunc from 0xab1ce7c to 0xa60aad8 2024-09-11T07:06:38.763 INFO:teuthology.orchestra.run.smithi079.stdout:2056 read 0xf6ffa9 thru 0xf718db (0x1933 bytes) 2024-09-11T07:06:38.763 INFO:teuthology.orchestra.run.smithi079.stdout:2057 writesame 0x292bf3a thru 0x293280c data_size 0x5(0x68d3 bytes) 2024-09-11T07:06:38.763 INFO:teuthology.orchestra.run.smithi079.stdout:2058 punch from 0x4a63505 to 0x4a6ee3e, (0xb939 bytes) 2024-09-11T07:06:38.773 INFO:teuthology.orchestra.run.smithi079.stdout:2059 trunc from 0xa60aad8 to 0x5d86302 2024-09-11T07:06:38.806 INFO:teuthology.orchestra.run.smithi079.stdout:2063 trunc from 0x5d86302 to 0x3bad529 2024-09-11T07:06:38.845 INFO:teuthology.orchestra.run.smithi079.stdout:2064 trunc from 0x3bad529 to 0x8c03ec0 2024-09-11T07:06:38.856 INFO:teuthology.orchestra.run.smithi079.stdout:2065 read 0x512fb9f thru 0x5135ecc (0x632e bytes) 2024-09-11T07:06:38.856 INFO:teuthology.orchestra.run.smithi079.stdout:2066 read 0x506e348 thru 0x507b6e9 (0xd3a2 bytes) 2024-09-11T07:06:38.861 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:38.857+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:38.882 INFO:teuthology.orchestra.run.smithi079.stdout:2067 write 0xeba2d7b thru 0xeba5623 (0x28a9 bytes) 2024-09-11T07:06:38.915 INFO:teuthology.orchestra.run.smithi079.stdout:2068 trunc from 0xeba5624 to 0x44681a6 2024-09-11T07:06:38.942 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:38.942 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:38.942 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:38.942 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:38.957 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:38.958 INFO:teuthology.orchestra.run.smithi079.stdout:2069 writesame 0x5b1c006 thru 0x5b27725 data_size 0x50(0xb720 bytes) 2024-09-11T07:06:38.981 INFO:teuthology.orchestra.run.smithi079.stdout:2070 write 0x9fd7cb5 thru 0x9fdfc10 (0x7f5c bytes) 2024-09-11T07:06:38.997 INFO:teuthology.orchestra.run.smithi079.stdout:2071 trunc from 0x9fdfc11 to 0xd4b11dc 2024-09-11T07:06:39.000 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:38.997+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:39.009 INFO:teuthology.orchestra.run.smithi079.stdout:2072 write 0x651c01e thru 0x6521d5c (0x5d3f bytes) 2024-09-11T07:06:39.029 INFO:teuthology.orchestra.run.smithi079.stdout:2073 write 0xdd7e67b thru 0xdd8485a (0x61e0 bytes) 2024-09-11T07:06:39.048 INFO:teuthology.orchestra.run.smithi079.stdout:2074 write 0xe9ed1a6 thru 0xe9f5f06 (0x8d61 bytes) 2024-09-11T07:06:39.054 INFO:teuthology.orchestra.run.smithi079.stdout:2075 read 0x5ab70b5 thru 0x5ac6f8a (0xfed6 bytes) 2024-09-11T07:06:39.054 INFO:teuthology.orchestra.run.smithi079.stdout:2076 write 0xaf11feb thru 0xaf128c4 (0x8da bytes) 2024-09-11T07:06:39.059 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:39.059 INFO:teuthology.orchestra.run.smithi079.stdout:2078 read 0x9d6b95f thru 0x9d6f781 (0x3e23 bytes) 2024-09-11T07:06:39.060 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:39.062 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:39.057+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:39.069 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:06:39.071 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T07:06:39.077 INFO:teuthology.orchestra.run.smithi079.stdout:2080 trunc from 0xe9f5f07 to 0x83d383c 2024-09-11T07:06:39.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T07:06:39.101 INFO:teuthology.orchestra.run.smithi079.stdout:2082 writesame 0x723e34c thru 0x7247a5e data_size 0x5(0x9713 bytes) 2024-09-11T07:06:39.113 INFO:teuthology.orchestra.run.smithi079.stdout:2083 trunc from 0x83d383c to 0x6350819 2024-09-11T07:06:39.134 INFO:teuthology.orchestra.run.smithi079.stdout:2084 write 0x8823aa3 thru 0x88303a3 (0xc901 bytes) 2024-09-11T07:06:39.139 INFO:teuthology.orchestra.run.smithi079.stdout:2085 clone 22 order 24 su 65536 sc 13 2024-09-11T07:06:39.143 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:39.144 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:39.158 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:39.163 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:39.163+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:39.238 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:39.264 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:39.261+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:39.324 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:39.324 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:39.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:39.324 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:39.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.324 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.324 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:39.324 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.999225289999998, 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:06:39.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:06:39.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:06:39.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.330 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9997 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 180224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.696610319000001, 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010421191999999999, 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.331 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9997 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:39.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624848+0000", 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624854+0000", 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2330000000000003e-06 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624873+0000", 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8770000000000002e-05 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624887+0000", 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.437e-05 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.634868+0000", 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0099809489999999994 2024-09-11T07:06:39.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635065+0000", 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196622 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635268+0000", 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020319500000000001 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.335 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10000 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.696549860000001, 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010963796, 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10000 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.336 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624909+0000", 2024-09-11T07:06:39.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.68e-06 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624915+0000", 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.003e-06 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624939+0000", 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4386999999999999e-05 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624953+0000", 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.419e-05 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635384+0000", 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010430356 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635653+0000", 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026916499999999998 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635871+0000", 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021801500000000001 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10002 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.696483843999999, 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011381399, 2024-09-11T07:06:39.340 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10002 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624974+0000", 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2640000000000001e-06 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624994+0000", 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9826e-05 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625015+0000", 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0724e-05 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625031+0000", 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6089000000000001e-05 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635948+0000", 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010917349 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636143+0000", 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019470199999999999 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636355+0000", 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021144499999999999 2024-09-11T07:06:39.344 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10004 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.696358924999998, 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011952765000000001, 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.345 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10004 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:39.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625099+0000", 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625118+0000", 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625135+0000", 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7669999999999999e-05 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625150+0000", 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4504e-05 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636471+0000", 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011321278000000001 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636726+0000", 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025507200000000001 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637051+0000", 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032463099999999998 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.696286194999999, 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:06:39.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:06:39.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.696223078999999, 2024-09-11T07:06:39.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:06:39.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:06:39.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:06:39.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:06:39.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:06:39.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.696148086000001, 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.359 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:06:39.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.696083529999999, 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:06:39.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:06:39.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.696028300999998, 2024-09-11T07:06:39.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:06:39.372 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.695974404000001, 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.373 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:06:39.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:06:39.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.377 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.695913905000001, 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.378 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:06:39.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.695857891999999, 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.695778538999999, 2024-09-11T07:06:39.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:39.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:06:39.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.695722236000002, 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.392 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.396 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.695649797000002, 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:06:39.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.695593677000002, 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.401 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:06:39.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.405 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.695520211000002, 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.406 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:06:39.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:06:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:06:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:06:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:06:39.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.695441817999999, 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:06:39.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:06:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:06:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:06:39.415 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.78626580400000001, 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:06:39.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:06:39.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:39.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:06:39.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:06:39.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.420 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:39.420 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:39.420 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:39.421 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:39.421 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:39.422 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:39.422 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:39.423 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:39.423 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:39.423 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:39.424 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:39.419+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:39.424 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:39.424 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:39.444 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:39.444 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:39.464 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:39.465 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:39.484 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:39.485 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:39.503 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:39.503 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:39.564 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:39.563+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:39.593 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:39.593 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:39.607 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:39.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:39.619+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:39.723 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:39.717+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:39.724 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:39.724 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:39.739 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:39.824 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:39.821+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:39.903 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:39.904 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:39.918 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:39.960 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:39.957+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:40.026 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:40.021+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:40.051 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:40.051 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:40.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:40.069 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T07:06:40.100 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-11T07:06:40.127 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:40.121+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:40.188 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:40.188 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:40.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:40.248 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:40.247+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:40.273 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone21 from 0x88303a4 (overlap 0x2b643a5) to 0x1a08efc 2024-09-11T07:06:40.329 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:40.325+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:40.331 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:40.331 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:40.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:40.435 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:40.435+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:40.512 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:40.513 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:40.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:40.529 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:40.525+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:40.598 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #20, image image_client.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent21 2024-09-11T07:06:40.631 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:40.625+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:40.709 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:40.709 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:40.725 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:40.768 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:40.767+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:40.832 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:40.831+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:40.887 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:40.887 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:40.903 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:40.940 INFO:teuthology.orchestra.run.smithi079.stdout:2087 write 0x2ad39f0 thru 0x2add1c1 (0x97d2 bytes) 2024-09-11T07:06:40.940 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:40.939+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:40.978 INFO:teuthology.orchestra.run.smithi079.stdout:2088 read 0x7c43b55 thru 0x7c4a346 (0x67f2 bytes) 2024-09-11T07:06:40.982 INFO:teuthology.orchestra.run.smithi079.stdout:2089 trunc from 0x88303a4 to 0x57c649a 2024-09-11T07:06:41.036 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:41.029+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:41.080 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.4 to 1 (10000) 2024-09-11T07:06:41.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:06:41.103 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:41.103 INFO:teuthology.orchestra.run.smithi079.stdout:2091 write 0x40f05f4 thru 0x40f22c3 (0x1cd0 bytes) 2024-09-11T07:06:41.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T07:06:41.119 INFO:teuthology.orchestra.run.smithi079.stdout:2092 write 0x9563656 thru 0x9570057 (0xca02 bytes) 2024-09-11T07:06:41.119 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:41.120 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:41.121 INFO:teuthology.orchestra.run.smithi079.stdout:2093 read 0x42e22f2 thru 0x42eb495 (0x91a4 bytes) 2024-09-11T07:06:41.134 INFO:teuthology.orchestra.run.smithi079.stdout:2095 write 0xd01fdfd thru 0xd02a01d (0xa221 bytes) 2024-09-11T07:06:41.135 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:41.130+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:41.142 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:41.147 INFO:teuthology.orchestra.run.smithi079.stdout:2096 trunc from 0xd02a01e to 0x7ea502d 2024-09-11T07:06:41.176 INFO:teuthology.orchestra.run.smithi079.stdout:2097 trunc from 0x7ea502d to 0x44ef392 2024-09-11T07:06:41.190 INFO:teuthology.orchestra.run.smithi079.stdout:2099 write 0x1487e46 thru 0x1492ef9 (0xb0b4 bytes) 2024-09-11T07:06:41.203 INFO:teuthology.orchestra.run.smithi079.stdout:2100 writesame 0x56934c5 thru 0x569a64b data_size 0x1(0x7187 bytes) 2024-09-11T07:06:41.213 INFO:teuthology.orchestra.run.smithi079.stdout:2101 trunc from 0x569a64c to 0x75841a 2024-09-11T07:06:41.236 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:41.233+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:41.245 INFO:teuthology.orchestra.run.smithi079.stdout:2102 trunc from 0x75841a to 0xba796b8 2024-09-11T07:06:41.253 INFO:teuthology.orchestra.run.smithi079.stdout:2103 writesame 0x80fe40f thru 0x810351e data_size 0x8(0x5110 bytes) 2024-09-11T07:06:41.258 INFO:teuthology.orchestra.run.smithi079.stdout:2104 read 0x122b16f thru 0x1239e09 (0xec9b bytes) 2024-09-11T07:06:41.258 INFO:teuthology.orchestra.run.smithi079.stdout:2105 read 0x87a51cf thru 0x87ad532 (0x8364 bytes) 2024-09-11T07:06:41.260 INFO:teuthology.orchestra.run.smithi079.stdout:2107 trunc from 0xba796b8 to 0xa82d545 2024-09-11T07:06:41.275 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:41.285 INFO:teuthology.orchestra.run.smithi079.stdout:2111 write 0xb450921 thru 0xb45f558 (0xec38 bytes) 2024-09-11T07:06:41.287 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:41.287 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:41.288 INFO:teuthology.orchestra.run.smithi079.stdout:2113 read 0x8ab08b0 thru 0x8ab998f (0x90e0 bytes) 2024-09-11T07:06:41.299 INFO:teuthology.orchestra.run.smithi079.stdout:2114 writesame 0xc7e3b7a thru 0xc7f3360 data_size 0x1(0xf7e7 bytes) 2024-09-11T07:06:41.302 INFO:teuthology.orchestra.run.smithi079.stdout:2115 punch from 0x184b3b to 0x193830, (0xecf5 bytes) 2024-09-11T07:06:41.302 INFO:teuthology.orchestra.run.smithi079.stdout:2116 write 0x56fbb82 thru 0x5705590 (0x9a0f bytes) 2024-09-11T07:06:41.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:41.306 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:41.306 INFO:teuthology.orchestra.run.smithi079.stdout:2118 write 0x9d70ed8 thru 0x9d750d8 (0x4201 bytes) 2024-09-11T07:06:41.309 INFO:teuthology.orchestra.run.smithi079.stdout:2120 punch from 0x7e69c69 to 0x7e6e7a0, (0x4b37 bytes) 2024-09-11T07:06:41.323 INFO:teuthology.orchestra.run.smithi079.stdout:2121 trunc from 0xc7f3361 to 0x33eebe1 2024-09-11T07:06:41.337 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:41.334+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:41.338 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:41.341 INFO:teuthology.orchestra.run.smithi079.stdout:2126 trunc from 0x33eebe1 to 0x8d67fc 2024-09-11T07:06:41.356 INFO:teuthology.orchestra.run.smithi079.stdout:2127 read 0x7b236d thru 0x7be19b (0xbe2f bytes) 2024-09-11T07:06:41.372 INFO:teuthology.orchestra.run.smithi079.stdout:2128 write 0x6f07f5e thru 0x6f08dbb (0xe5e bytes) 2024-09-11T07:06:41.374 INFO:teuthology.orchestra.run.smithi079.stdout:2130 writesame 0x6b2707 thru 0x6b2b26 data_size 0x8(0x420 bytes) 2024-09-11T07:06:41.377 INFO:teuthology.orchestra.run.smithi079.stdout:2131 read 0x2a55887 thru 0x2a6450b (0xec85 bytes) 2024-09-11T07:06:41.390 INFO:teuthology.orchestra.run.smithi079.stdout:2132 writesame 0xa09d124 thru 0xa0a21e4 data_size 0x3(0x50c1 bytes) 2024-09-11T07:06:41.409 INFO:teuthology.orchestra.run.smithi079.stdout:2133 write 0xdc09f00 thru 0xdc12f11 (0x9012 bytes) 2024-09-11T07:06:41.417 INFO:teuthology.orchestra.run.smithi079.stdout:2134 read 0x819d9f6 thru 0x81a4ab5 (0x70c0 bytes) 2024-09-11T07:06:41.423 INFO:teuthology.orchestra.run.smithi079.stdout:2136 trunc from 0xdc12f12 to 0x9f567c2 2024-09-11T07:06:41.436 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:41.436 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:41.438 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:41.434+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:41.455 INFO:teuthology.orchestra.run.smithi079.stdout:2137 trunc from 0x9f567c2 to 0x2110322 2024-09-11T07:06:41.459 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:41.469 INFO:teuthology.orchestra.run.smithi079.stdout:2138 read 0x1c59c60 thru 0x1c5fdff (0x61a0 bytes) 2024-09-11T07:06:41.471 INFO:teuthology.orchestra.run.smithi079.stdout:2139 write 0xd98c53 thru 0xda87ea (0xfb98 bytes) 2024-09-11T07:06:41.493 INFO:teuthology.orchestra.run.smithi079.stdout:2140 write 0xa5ab240 thru 0xa5b117e (0x5f3f bytes) 2024-09-11T07:06:41.497 INFO:teuthology.orchestra.run.smithi079.stdout:2141 punch from 0x60d5c4e to 0x60dee72, (0x9224 bytes) 2024-09-11T07:06:41.497 INFO:teuthology.orchestra.run.smithi079.stdout:2142 read 0x5756234 thru 0x57572fd (0x10ca bytes) 2024-09-11T07:06:41.497 INFO:teuthology.orchestra.run.smithi079.stdout:2143 write 0x544a2b0 thru 0x5452064 (0x7db5 bytes) 2024-09-11T07:06:41.501 INFO:teuthology.orchestra.run.smithi079.stdout:2144 punch from 0x1eb159a to 0x1ebc6f9, (0xb15f bytes) 2024-09-11T07:06:41.504 INFO:teuthology.orchestra.run.smithi079.stdout:2145 trunc from 0xa5b117f to 0x7849829 2024-09-11T07:06:41.517 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:41.518 INFO:teuthology.orchestra.run.smithi079.stdout:2148 read 0x433321c thru 0x433556b (0x2350 bytes) 2024-09-11T07:06:41.518 INFO:teuthology.orchestra.run.smithi079.stdout:2150 punch from 0x37652b9 to 0x37707fe, (0xb545 bytes) 2024-09-11T07:06:41.518 INFO:teuthology.orchestra.run.smithi079.stdout:2151 read 0x5c58a39 thru 0x5c5bfa1 (0x3569 bytes) 2024-09-11T07:06:41.518 INFO:teuthology.orchestra.run.smithi079.stdout:2152 clone 23 order 22 su 524288 sc 5 2024-09-11T07:06:41.522 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:41.568 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:41.566+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:41.584 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:41.585 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:41.598 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:41.640 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:41.637+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:41.647 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:41.647 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:41.663 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:41.664 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:41.679 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:41.679 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:41.694 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:41.695 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:41.714 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:41.715 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:41.741 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:41.738+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:41.750 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:41.750 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:41.773 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:41.774 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:41.774 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:41.774 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:41.774 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:41.783 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:41.783 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:41.788 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:41.803 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:41.803 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:41.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:41.862+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:41.913 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6915 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 4587520~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.236288515999998, 2024-09-11T07:06:41.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030587597000000001, 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6915 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:41.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675911+0000", 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676263+0000", 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035270599999999999 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676268+0000", 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0860000000000001e-06 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676280+0000", 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1863e-05 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676288+0000", 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5599999999999996e-06 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706353+0000", 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030065614000000001 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706438+0000", 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5041000000000001e-05 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706498+0000", 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9726999999999999e-05 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6917 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5341184~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.235874300999999, 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030468918000000001, 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.918 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6917 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676325+0000", 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0500000000000003e-07 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676328+0000", 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3980000000000002e-06 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676335+0000", 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2649999999999999e-06 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676340+0000", 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4809999999999997e-06 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706664+0000", 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030323033999999999 2024-09-11T07:06:41.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706731+0000", 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7639999999999996e-05 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706794+0000", 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2495000000000004e-05 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6918 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5455872~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.235851240999999, 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594758999999999, 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6918 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.923 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676348+0000", 2024-09-11T07:06:41.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6199999999999998e-07 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676350+0000", 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0940000000000002e-06 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676357+0000", 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5699999999999998e-06 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676362+0000", 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0359999999999997e-06 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706819+0000", 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456987000000001 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706885+0000", 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6054000000000001e-05 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706943+0000", 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7556000000000003e-05 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6919 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.235829489, 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030730071000000001, 2024-09-11T07:06:41.927 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6919 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676370+0000", 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676595+0000", 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000225577 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676599+0000", 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3540000000000002e-06 2024-09-11T07:06:41.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676611+0000", 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1037e-05 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676618+0000", 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4050000000000003e-06 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.706966+0000", 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030348373000000001 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707032+0000", 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5736999999999998e-05 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707100+0000", 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7588000000000004e-05 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6920 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6209536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.235568901000001, 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030647992999999998, 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.932 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6920 2024-09-11T07:06:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:41.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676630+0000", 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676631+0000", 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9599999999999999e-07 2024-09-11T07:06:41.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676633+0000", 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.729e-06 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676641+0000", 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7659999999999998e-06 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676647+0000", 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7930000000000003e-06 2024-09-11T07:06:41.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707128+0000", 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030481028 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707211+0000", 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2792000000000003e-05 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707278+0000", 2024-09-11T07:06:41.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7288999999999999e-05 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6921 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6324224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.235543472, 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030787063999999999, 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6921 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676656+0000", 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7700000000000004e-07 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676660+0000", 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.997e-06 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676667+0000", 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2910000000000002e-06 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676673+0000", 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6010000000000002e-06 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707305+0000", 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030632029000000002 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707380+0000", 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5265999999999994e-05 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707443+0000", 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2303000000000003e-05 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6922 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6438912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.235517945000002, 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031018718000000001, 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6922 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.945 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676681+0000", 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676852+0000", 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000171371 2024-09-11T07:06:41.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676857+0000", 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6380000000000003e-06 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676867+0000", 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0268000000000001e-05 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676875+0000", 2024-09-11T07:06:41.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5320000000000001e-06 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707469+0000", 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030593615000000001 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707632+0000", 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00016336399999999999 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707700+0000", 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7929999999999995e-05 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6923 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6553600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.235311715999998, 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030968105999999999, 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.949 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6923 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676887+0000", 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676888+0000", 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7000000000000005e-07 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676895+0000", 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1110000000000002e-06 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676902+0000", 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2030000000000003e-06 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676908+0000", 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6200000000000004e-06 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707728+0000", 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030820163000000001 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707797+0000", 2024-09-11T07:06:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8737000000000003e-05 2024-09-11T07:06:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707855+0000", 2024-09-11T07:06:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8702000000000001e-05 2024-09-11T07:06:41.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6924 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7192576~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.235282385000001, 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031099157999999998, 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6924 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:41.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676917+0000", 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4000000000000001e-07 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676921+0000", 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6899999999999998e-06 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676928+0000", 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8260000000000004e-06 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676933+0000", 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3109999999999996e-06 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707879+0000", 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030946265000000001 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.707946+0000", 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6365000000000006e-05 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708016+0000", 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0061000000000006e-05 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6925 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7307264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.235256530000001, 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.03121956, 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6925 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676943+0000", 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676996+0000", 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3483000000000003e-05 2024-09-11T07:06:41.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677000+0000", 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1840000000000001e-06 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677009+0000", 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2390000000000008e-06 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677016+0000", 2024-09-11T07:06:41.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0600000000000002e-06 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708042+0000", 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031025569999999999 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708106+0000", 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3723e-05 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.708162+0000", 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6301000000000002e-05 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7045 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5472256~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.230244973000001, 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030456286999999999, 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.963 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7045 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681954+0000", 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682107+0000", 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015256800000000001 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682111+0000", 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0450000000000002e-06 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682120+0000", 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6569999999999992e-06 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682127+0000", 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6239999999999996e-06 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712254+0000", 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030127068 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712333+0000", 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8788999999999994e-05 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712410+0000", 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7535999999999998e-05 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.967 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7046 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5586944~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.230060386000002, 2024-09-11T07:06:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030486447, 2024-09-11T07:06:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.968 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7046 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682139+0000", 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5400000000000001e-07 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682142+0000", 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7429999999999998e-06 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682149+0000", 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3209999999999999e-06 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682155+0000", 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7620000000000001e-06 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712454+0000", 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030298814 2024-09-11T07:06:41.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712563+0000", 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010932 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712625+0000", 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1933000000000005e-05 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7047 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.230036335000001, 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030677043000000001, 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7047 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.973 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682163+0000", 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682532+0000", 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036941099999999999 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682537+0000", 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2469999999999999e-06 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682547+0000", 2024-09-11T07:06:41.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9000000000000001e-06 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682554+0000", 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2060000000000001e-06 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712666+0000", 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030111422999999998 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712761+0000", 2024-09-11T07:06:41.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5212999999999998e-05 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712840+0000", 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8642999999999999e-05 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.977 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7048 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6340608~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.229631164000001, 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494950999999999, 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7048 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682568+0000", 2024-09-11T07:06:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7299999999999996e-07 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682571+0000", 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7760000000000002e-06 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682577+0000", 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0209999999999996e-06 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682584+0000", 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8630000000000002e-06 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712904+0000", 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030320347000000001 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.712987+0000", 2024-09-11T07:06:41.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2367000000000006e-05 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713063+0000", 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6003999999999999e-05 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7049 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6455296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.982 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.229606513, 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030670962999999999, 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7049 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682593+0000", 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7199999999999999e-07 2024-09-11T07:06:41.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682596+0000", 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5189999999999999e-06 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682602+0000", 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7240000000000003e-06 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682607+0000", 2024-09-11T07:06:41.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2410000000000003e-06 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713102+0000", 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030494841000000002 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713189+0000", 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6697e-05 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713263+0000", 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4468999999999995e-05 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7050 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6569984~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.229582952000001, 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030850200000000001, 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7050 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682616+0000", 2024-09-11T07:06:41.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682617+0000", 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682619+0000", 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2450000000000001e-06 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682627+0000", 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0520000000000002e-06 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682632+0000", 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2750000000000003e-06 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713310+0000", 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030678305999999999 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713391+0000", 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0164e-05 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713466+0000", 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5703000000000003e-05 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7051 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 6684672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.229559426000002, 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030997008, 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7051 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682640+0000", 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682684+0000", 2024-09-11T07:06:41.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4625e-05 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682695+0000", 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0575e-05 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682703+0000", 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1389999999999995e-06 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682709+0000", 2024-09-11T07:06:41.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0719999999999996e-06 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713498+0000", 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030789092000000001 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713571+0000", 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2554999999999999e-05 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713637+0000", 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5950000000000004e-05 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7052 3.8 3:136f8b0c:::rbd_data.1161d159867d.0000000000000002:5 [read 7323648~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.229480239000001, 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031135348, 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:41.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7052 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.682719+0000", 2024-09-11T07:06:41.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683050+0000", 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00033088699999999998 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683054+0000", 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.651e-06 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:41.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683066+0000", 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1372000000000001e-05 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.683074+0000", 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5939999999999994e-06 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713669+0000", 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.030594982 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:41.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713786+0000", 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000116937 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.713854+0000", 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7924999999999998e-05 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.000 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:33510 3.b 3:d16a5966:::rbd_object_map.116176c25662:head [call lock.assert_locked in=17b,call rbd.object_map_resize in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.53725066, 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.034759883999999998, 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 33510 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374948+0000", 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374951+0000", 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9399999999999998e-06 2024-09-11T07:06:42.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374966+0000", 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4623e-05 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.374992+0000", 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-05 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375006+0000", 2024-09-11T07:06:42.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3492999999999999e-05 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375078+0000", 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2125999999999994e-05 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.375151+0000", 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3250000000000005e-05 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.408158+0000", 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.033006967999999998 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409176+0000", 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001018288 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409544+0000", 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000367201 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409629+0000", 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5280999999999999e-05 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:28.409708+0000", 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9383999999999998e-05 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 4.2879241849999996, 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:06:42.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:06:42.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:42.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:42.012 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:42.014 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:42.014 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:42.010+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:42.092 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:06:42.099 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T07:06:42.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:42.110+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:42.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T07:06:42.151 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:41080 3.a 3:50ac21ea:::rbd_header.1161d1131845:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e58)", 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:42.152045+0000", 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.000176186, 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022168200000000001, 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 41080 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:42.152045+0000", 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:42.152045+0000", 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:42.152047+0000", 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7829999999999999e-06 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:42.152056+0000", 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9399999999999997e-06 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:42.152088+0000", 2024-09-11T07:06:42.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1525000000000001e-05 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:42.152103+0000", 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4630000000000001e-05 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:42.152171+0000", 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8076000000000003e-05 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:42.152216+0000", 2024-09-11T07:06:42.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5686999999999998e-05 2024-09-11T07:06:42.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.156 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.156 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-11T07:06:42.156 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-09-11T07:06:42.156 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:42.166 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:42.216 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:42.209+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:42.259 INFO:teuthology.orchestra.run.smithi079.stdout:leaving image image_client.0-clone22 intact 2024-09-11T07:06:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:42.286 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:42.286 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:42.300 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:42.344 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:42.341+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:42.417 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:42.414+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:42.470 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:42.470 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:42.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:42.470 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:42.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.470 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.470 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:42.470 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.180826497000002, 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:06:42.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:06:42.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:06:42.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.475 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.475 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.475 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.180754413999999, 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:06:42.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.180698921000001, 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:06:42.480 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:06:42.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:06:42.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.485 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.485 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:42.485 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978826952999999, 2024-09-11T07:06:42.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:06:42.485 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.485 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.485 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.485 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.485 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:42.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:06:42.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.489 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978764363, 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:06:42.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:06:42.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:06:42.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.494 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.494 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.494 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:42.494 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978707307000001, 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:42.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:06:42.498 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.499 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.499 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.499 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.499 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:42.499 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978651190000001, 2024-09-11T07:06:42.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:06:42.499 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.499 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.500 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.500 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.500 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.500 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.500 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:06:42.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.500 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:42.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:42.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:06:42.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:06:42.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:06:42.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:06:42.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:06:42.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:06:42.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:06:42.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:06:42.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:06:42.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:06:42.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:06:42.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:06:42.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:42.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:06:42.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.509 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.509 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:42.509 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978529928, 2024-09-11T07:06:42.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:06:42.510 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.510 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.510 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.511 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:06:42.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.511 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:42.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:42.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:06:42.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:06:42.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:06:42.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:06:42.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:06:42.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:06:42.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:06:42.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:06:42.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:42.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:06:42.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:06:42.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:06:42.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:06:42.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:06:42.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.519 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.519 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.520 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:42.520 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978425658999999, 2024-09-11T07:06:42.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:06:42.520 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.520 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.521 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.521 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.521 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.521 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.522 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:06:42.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.522 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:42.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:42.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:06:42.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:06:42.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:06:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:06:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:06:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:06:42.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:06:42.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:06:42.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:06:42.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:06:42.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:06:42.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:06:42.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:06:42.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:06:42.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.528 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.529 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.529 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:42.529 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978320119999999, 2024-09-11T07:06:42.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:06:42.529 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.529 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.529 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:06:42.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:06:42.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978252956999999, 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.538 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978153751000001, 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:42.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:42.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.543 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978066792, 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:06:42.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:06:42.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:06:42.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:06:42.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:06:42.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.551 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.551 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.551 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:42.551 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.978006515000001, 2024-09-11T07:06:42.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:06:42.551 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:06:42.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:06:42.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.556 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.556 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:42.556 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.977852810000002, 2024-09-11T07:06:42.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:06:42.556 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.556 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.556 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:06:42.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:06:42.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:06:42.561 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.561 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.561 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.561 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.977765634000001, 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.562 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:42.566 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.977701731, 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:42.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:06:42.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:06:42.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.977641888000001, 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.571 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.572 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:06:42.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.572 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:42.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:06:42.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:06:42.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.977563805999999, 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.576 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:06:42.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:42.580 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.977506036000001, 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:42.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:42.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:06:42.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:06:42.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:42.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:06:42.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:06:42.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:06:42.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:42.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:42.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:42.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:06:42.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:06:42.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:42.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:42.585 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:42.587 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:42.587 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:42.582+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:42.628 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #21, image image_client.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent22 2024-09-11T07:06:42.688 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:42.686+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:42.716 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:42.716 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:42.717 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:42.717 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:42.730 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:42.757 INFO:teuthology.orchestra.run.smithi079.stdout:2154 write 0x88cc505 thru 0x88cd10f (0xc0b bytes) 2024-09-11T07:06:42.781 INFO:teuthology.orchestra.run.smithi079.stdout:2155 write 0xad61ebf thru 0xad7094a (0xea8c bytes) 2024-09-11T07:06:42.788 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:42.785+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:42.789 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:42.789 INFO:teuthology.orchestra.run.smithi079.stdout:2157 write 0xf5dbbe thru 0xf60b52 (0x2f95 bytes) 2024-09-11T07:06:42.816 INFO:teuthology.orchestra.run.smithi079.stdout:2158 read 0x61c95d1 thru 0x61d21ab (0x8bdb bytes) 2024-09-11T07:06:42.817 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:42.817 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:42.817 INFO:teuthology.orchestra.run.smithi079.stdout:2161 write 0x1187c4b thru 0x1193be1 (0xbf97 bytes) 2024-09-11T07:06:42.821 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:42.821 INFO:teuthology.orchestra.run.smithi079.stdout:2166 read 0x53d9135 thru 0x53e2ad8 (0x99a4 bytes) 2024-09-11T07:06:42.822 INFO:teuthology.orchestra.run.smithi079.stdout:2167 write 0x89afbf0 thru 0x89bcba8 (0xcfb9 bytes) 2024-09-11T07:06:42.854 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:42.855 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:42.856 INFO:teuthology.orchestra.run.smithi079.stdout:2169 trunc from 0xad7094b to 0x77f786 2024-09-11T07:06:42.869 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:42.912 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:42.909+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:42.961 INFO:teuthology.orchestra.run.smithi079.stdout:2170 writesame 0xe0bdf93 thru 0xe0cd110 data_size 0x1(0xf17e bytes) 2024-09-11T07:06:42.961 INFO:teuthology.orchestra.run.smithi079.stdout:2171 clone 24 order 24 su 1048576 sc 2 2024-09-11T07:06:42.991 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:42.985+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:43.036 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:43.036 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:43.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:43.036 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:43.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.036 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.036 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.724326045000002, 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.724258491000001, 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.041 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:06:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.045 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.724177654000002, 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.046 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:43.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:06:43.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:43.050 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.724134308, 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:06:43.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:06:43.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.724064182999999, 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:43.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.059 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.723996059000001, 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:06:43.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:06:43.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.723955592999999, 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:06:43.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.723917552, 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.069 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:43.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.723878582000001, 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:06:43.073 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:06:43.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:06:43.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.077 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.723837708000001, 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:06:43.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:06:43.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.082 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.723509934999999, 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:06:43.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:06:43.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.723443424999999, 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.087 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.091 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.723375705999999, 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:06:43.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.723330768, 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.096 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:06:43.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.722531143000001, 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:06:43.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:06:43.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.722496800999998, 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:06:43.105 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:06:43.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.109 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.722134126, 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.110 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:06:43.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:43.114 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.720871101, 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:43.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:06:43.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.720838602000001, 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.119 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:06:43.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 14.784233175000001, 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.124 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:06:43.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:06:43.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:06:43.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.129 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:43.130 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T07:06:43.131 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:43.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:43.126+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:43.139 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T07:06:43.232 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:43.225+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:43.304 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:43.304 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:43.305 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:43.319 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:43.341 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone23 from 0xe0cd111 (overlap 0x77f786) to 0x17fe4e 2024-09-11T07:06:43.360 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:43.357+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:43.434 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:43.429+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:43.486 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:43.487 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:43.500 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:43.548 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:43.545+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:43.636 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:43.634+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:43.678 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:43.678 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.353685398, 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.679 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:06:43.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9997 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 180224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.051070426999999, 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010421191999999999, 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9997 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624848+0000", 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624854+0000", 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2330000000000003e-06 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624873+0000", 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8770000000000002e-05 2024-09-11T07:06:43.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624887+0000", 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.437e-05 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.634868+0000", 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0099809489999999994 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635065+0000", 2024-09-11T07:06:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196622 2024-09-11T07:06:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635268+0000", 2024-09-11T07:06:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020319500000000001 2024-09-11T07:06:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.689 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10000 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.051009967999999, 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010963796, 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.690 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10000 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624909+0000", 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.68e-06 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624915+0000", 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.003e-06 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624939+0000", 2024-09-11T07:06:43.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4386999999999999e-05 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624953+0000", 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.419e-05 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635384+0000", 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010430356 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635653+0000", 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026916499999999998 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635871+0000", 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021801500000000001 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10002 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050943952000001, 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011381399, 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10002 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.695 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624974+0000", 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2640000000000001e-06 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624994+0000", 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9826e-05 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625015+0000", 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0724e-05 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625031+0000", 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6089000000000001e-05 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635948+0000", 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010917349 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636143+0000", 2024-09-11T07:06:43.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019470199999999999 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636355+0000", 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021144499999999999 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10004 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050819033, 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011952765000000001, 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.699 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10004 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625099+0000", 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625118+0000", 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:06:43.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625135+0000", 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7669999999999999e-05 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625150+0000", 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4504e-05 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636471+0000", 2024-09-11T07:06:43.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011321278000000001 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636726+0000", 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025507200000000001 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637051+0000", 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032463099999999998 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050746303, 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050683187000001, 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:06:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:06:43.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050608193999999, 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:06:43.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:06:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:06:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:06:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:06:43.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050543638000001, 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050488409, 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.727 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050434511999999, 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:06:43.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050374012999999, 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:06:43.732 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.736 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050318000000001, 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:06:43.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050238647, 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.741 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:06:43.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:06:43.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.745 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050182344, 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:06:43.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:43.750 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050109904999999, 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:43.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:06:43.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.050053784999999, 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:43.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.049980318999999, 2024-09-11T07:06:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:06:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:43.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.764 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 29.049901926, 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:06:43.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:06:43.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.1407259119999997, 2024-09-11T07:06:43.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:43.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:43.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:06:43.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:43.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:43.774 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:43.775 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #22, image image_client.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent23 2024-09-11T07:06:43.776 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:43.776 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:43.769+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:43.820 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:43.876 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:43.874+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:43.947 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:43.948 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:43.954 INFO:teuthology.orchestra.run.smithi079.stdout:2172 punch from 0xbc115f2 to 0xbc1fd80, (0xe78e bytes) 2024-09-11T07:06:43.962 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:43.979 INFO:teuthology.orchestra.run.smithi079.stdout:2173 trunc from 0xe0cd111 to 0x3389e66 2024-09-11T07:06:43.990 INFO:teuthology.orchestra.run.smithi079.stdout:2175 read 0x1629659 thru 0x16337b3 (0xa15b bytes) 2024-09-11T07:06:43.990 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:43.991 INFO:teuthology.orchestra.run.smithi079.stdout:2177 read 0x1cb567f thru 0x1cc46fc (0xf07e bytes) 2024-09-11T07:06:43.991 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:43.991 INFO:teuthology.orchestra.run.smithi079.stdout:2178 write 0x3074784 thru 0x3081e6a (0xd6e7 bytes) 2024-09-11T07:06:43.993 INFO:teuthology.orchestra.run.smithi079.stdout:2179 read 0x2ad250c thru 0x2ad98e2 (0x73d7 bytes) 2024-09-11T07:06:43.993 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:43.993 INFO:teuthology.orchestra.run.smithi079.stdout:2181 read 0x1a1d584 thru 0x1a26007 (0x8a84 bytes) 2024-09-11T07:06:44.008 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:44.005+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:44.016 INFO:teuthology.orchestra.run.smithi079.stdout:2184 write 0xc602907 thru 0xc602ef5 (0x5ef bytes) 2024-09-11T07:06:44.017 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:44.017 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:44.021 INFO:teuthology.orchestra.run.smithi079.stdout:2186 punch from 0x1372b7c to 0x1376e54, (0x42d8 bytes) 2024-09-11T07:06:44.021 INFO:teuthology.orchestra.run.smithi079.stdout:2187 read 0x520eba3 thru 0x5218645 (0x9aa3 bytes) 2024-09-11T07:06:44.030 INFO:teuthology.orchestra.run.smithi079.stdout:2188 write 0xc9e270d thru 0xc9e62a8 (0x3b9c bytes) 2024-09-11T07:06:44.035 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:44.035 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:44.037 INFO:teuthology.orchestra.run.smithi079.stdout:2191 read 0xa706022 thru 0xa712293 (0xc272 bytes) 2024-09-11T07:06:44.037 INFO:teuthology.orchestra.run.smithi079.stdout:2193 punch from 0x2b89d2f to 0x2b8e667, (0x4938 bytes) 2024-09-11T07:06:44.037 INFO:teuthology.orchestra.run.smithi079.stdout:2194 write 0xc04fe3 thru 0xc0e4b4 (0x94d2 bytes) 2024-09-11T07:06:44.052 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:44.052 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:44.058 INFO:teuthology.orchestra.run.smithi079.stdout:2196 write 0x4e1d923 thru 0x4e261af (0x888d bytes) 2024-09-11T07:06:44.063 INFO:teuthology.orchestra.run.smithi079.stdout:2197 writesame 0x910b131 thru 0x910b3e7 data_size 0x5(0x2b7 bytes) 2024-09-11T07:06:44.068 INFO:teuthology.orchestra.run.smithi079.stdout:2198 read 0xba63446 thru 0xba71331 (0xdeec bytes) 2024-09-11T07:06:44.075 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:44.075 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:44.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:44.074+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:44.078 INFO:teuthology.orchestra.run.smithi079.stdout:2199 write 0xdd28aea thru 0xdd35580 (0xca97 bytes) 2024-09-11T07:06:44.082 INFO:teuthology.orchestra.run.smithi079.stdout:2200 read 0xc7d6f75 thru 0xc7da934 (0x39c0 bytes) 2024-09-11T07:06:44.082 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:44.082 INFO:teuthology.orchestra.run.smithi079.stdout:2204 punch from 0xb35da2a to 0xb36a48b, (0xca61 bytes) 2024-09-11T07:06:44.091 INFO:teuthology.orchestra.run.smithi079.stdout:2205 write 0xe43661c thru 0xe43f256 (0x8c3b bytes) 2024-09-11T07:06:44.096 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:44.096 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:44.096 INFO:teuthology.orchestra.run.smithi079.stdout:2207 read 0xc3113fc thru 0xc31f2e0 (0xdee5 bytes) 2024-09-11T07:06:44.097 INFO:teuthology.orchestra.run.smithi079.stdout:2208 read 0x69f16be thru 0x69f6353 (0x4c96 bytes) 2024-09-11T07:06:44.097 INFO:teuthology.orchestra.run.smithi079.stdout:2211 write 0x5825ff2 thru 0x5834103 (0xe112 bytes) 2024-09-11T07:06:44.098 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:44.098 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:44.098 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:44.104 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T07:06:44.114 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:44.118 INFO:teuthology.orchestra.run.smithi079.stdout:2212 trunc from 0xe43f257 to 0x1f3d726 2024-09-11T07:06:44.120 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:44.121 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:44.122 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:06:44.135 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T07:06:44.135 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:06:44.144 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:44.144 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:44.148 INFO:teuthology.orchestra.run.smithi079.stdout:2213 read 0x93ee89 thru 0x9429ba (0x3b32 bytes) 2024-09-11T07:06:44.162 INFO:teuthology.orchestra.run.smithi079.stdout:2214 write 0x469fc84 thru 0x46a52d7 (0x5654 bytes) 2024-09-11T07:06:44.176 INFO:teuthology.orchestra.run.smithi079.stdout:2215 writesame 0x586511a thru 0x586beef data_size 0x11(0x6dd6 bytes) 2024-09-11T07:06:44.177 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:44.177 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:44.177 INFO:teuthology.orchestra.run.smithi079.stdout:2219 punch from 0x42690ac to 0x426ff2e, (0x6e82 bytes) 2024-09-11T07:06:44.178 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:44.174+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:44.198 INFO:teuthology.orchestra.run.smithi079.stdout:2220 write 0xee5d635 thru 0xee62c6f (0x563b bytes) 2024-09-11T07:06:44.202 INFO:teuthology.orchestra.run.smithi079.stdout:2221 read 0x2a68b92 thru 0x2a6d292 (0x4701 bytes) 2024-09-11T07:06:44.202 INFO:teuthology.orchestra.run.smithi079.stdout:2222 read 0xb5f8e17 thru 0xb605c96 (0xce80 bytes) 2024-09-11T07:06:44.202 INFO:teuthology.orchestra.run.smithi079.stdout:2223 write 0xe2a42df thru 0xe2a5e45 (0x1b67 bytes) 2024-09-11T07:06:44.203 INFO:teuthology.orchestra.run.smithi079.stdout:2224 read 0x29ea55 thru 0x2a2f20 (0x44cc bytes) 2024-09-11T07:06:44.204 INFO:teuthology.orchestra.run.smithi079.stdout:2227 writesame 0xe6bc36 thru 0xe70d3b data_size 0x3(0x5106 bytes) 2024-09-11T07:06:44.209 INFO:teuthology.orchestra.run.smithi079.stdout:2228 write 0x6c255e7 thru 0x6c26552 (0xf6c bytes) 2024-09-11T07:06:44.228 INFO:teuthology.orchestra.run.smithi079.stdout:2229 trunc from 0xee62c70 to 0x4ccffd5 2024-09-11T07:06:44.253 INFO:teuthology.orchestra.run.smithi079.stdout:2230 write 0x661c7ab thru 0x661f0a2 (0x28f8 bytes) 2024-09-11T07:06:44.259 INFO:teuthology.orchestra.run.smithi079.stdout:2231 punch from 0x6ee1ba to 0x6f11af, (0x2ff5 bytes) 2024-09-11T07:06:44.259 INFO:teuthology.orchestra.run.smithi079.stdout:2232 punch from 0xc8b546 to 0xc99db4, (0xe86e bytes) 2024-09-11T07:06:44.259 INFO:teuthology.orchestra.run.smithi079.stdout:2234 punch from 0x46067c8 to 0x460faa2, (0x92da bytes) 2024-09-11T07:06:44.271 INFO:teuthology.orchestra.run.smithi079.stdout:2235 trunc from 0x661f0a3 to 0xe2a3f80 2024-09-11T07:06:44.278 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:44.274+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:44.280 INFO:teuthology.orchestra.run.smithi079.stdout:2236 trunc from 0xe2a3f80 to 0xedb28f3 2024-09-11T07:06:44.288 INFO:teuthology.orchestra.run.smithi079.stdout:2237 read 0xc16b8f thru 0xc191b8 (0x262a bytes) 2024-09-11T07:06:44.289 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:44.289 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:44.289 INFO:teuthology.orchestra.run.smithi079.stdout:2238 read 0x61ca008 thru 0x61d9aac (0xfaa5 bytes) 2024-09-11T07:06:44.289 INFO:teuthology.orchestra.run.smithi079.stdout:2239 write 0x50ba727 thru 0x50baf1b (0x7f5 bytes) 2024-09-11T07:06:44.291 INFO:teuthology.orchestra.run.smithi079.stdout:2241 write 0x24207c9 thru 0x242e20d (0xda45 bytes) 2024-09-11T07:06:44.298 INFO:teuthology.orchestra.run.smithi079.stdout:2242 write 0x910f5b2 thru 0x9110399 (0xde8 bytes) 2024-09-11T07:06:44.304 INFO:teuthology.orchestra.run.smithi079.stdout:2243 write 0x539463b thru 0x539fa3a (0xb400 bytes) 2024-09-11T07:06:44.305 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:44.309 INFO:teuthology.orchestra.run.smithi079.stdout:2244 writesame 0x8e7699c thru 0x8e7bb47 data_size 0x2(0x51ac bytes) 2024-09-11T07:06:44.319 INFO:teuthology.orchestra.run.smithi079.stdout:2245 write 0x22e0cb4 thru 0x22ed2df (0xc62c bytes) 2024-09-11T07:06:44.321 INFO:teuthology.orchestra.run.smithi079.stdout:2246 writesame 0xf7566e thru 0xf7a122 data_size 0x55(0x4ab5 bytes) 2024-09-11T07:06:44.323 INFO:teuthology.orchestra.run.smithi079.stdout:2247 read 0x5f83646 thru 0x5f8adba (0x7775 bytes) 2024-09-11T07:06:44.324 INFO:teuthology.orchestra.run.smithi079.stdout:2250 writesame 0x944ba54 thru 0x9455c8e data_size 0x11(0xa23b bytes) 2024-09-11T07:06:44.327 INFO:teuthology.orchestra.run.smithi079.stdout:2251 write 0xe4755cd thru 0xe47e8f2 (0x9326 bytes) 2024-09-11T07:06:44.332 INFO:teuthology.orchestra.run.smithi079.stdout:2253 write 0xe4d0559 thru 0xe4df8bf (0xf367 bytes) 2024-09-11T07:06:44.334 INFO:teuthology.orchestra.run.smithi079.stdout:2255 read 0x766bce3 thru 0x767125e (0x557c bytes) 2024-09-11T07:06:44.335 INFO:teuthology.orchestra.run.smithi079.stdout:2256 writesame 0x808574a thru 0x8088865 data_size 0xe(0x311c bytes) 2024-09-11T07:06:44.337 INFO:teuthology.orchestra.run.smithi079.stdout:2257 write 0x1a2209b thru 0x1a3208b (0xfff1 bytes) 2024-09-11T07:06:44.340 INFO:teuthology.orchestra.run.smithi079.stdout:2259 read 0x7b963d9 thru 0x7b9e826 (0x844e bytes) 2024-09-11T07:06:44.340 INFO:teuthology.orchestra.run.smithi079.stdout:2260 writesame 0xa90e691 thru 0xa9156a0 data_size 0x58(0x7010 bytes) 2024-09-11T07:06:44.345 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:44.345 INFO:teuthology.orchestra.run.smithi079.stdout:2262 read 0x16c2eef thru 0x16cae96 (0x7fa8 bytes) 2024-09-11T07:06:44.346 INFO:teuthology.orchestra.run.smithi079.stdout:2263 read 0x82ade7d thru 0x82b54e8 (0x766c bytes) 2024-09-11T07:06:44.346 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:44.346 INFO:teuthology.orchestra.run.smithi079.stdout:2265 read 0x2855d81 thru 0x2858b86 (0x2e06 bytes) 2024-09-11T07:06:44.347 INFO:teuthology.orchestra.run.smithi079.stdout:2266 clone 25 order 20 su 8192 sc 6 2024-09-11T07:06:44.379 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:44.373+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:44.421 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:44.421 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:44.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:44.464 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:06:44.465 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:06:44.480 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:44.477+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:44.481 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-11T07:06:44.106879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":521499501,"num_objects":829,"num_object_clones":170,"num_object_copies":1658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":829,"num_whiteouts":256,"num_read":57361,"num_read_kb":227083,"num_write":6606,"num_write_kb":173864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5344,"ondisk_log_size":5344,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":308380,"kb_used_data":25572,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754666340,"statfs":{"total":773094113280,"available":772778332160,"internally_reserved":0,"allocated":26185728,"data_stored":280289307,"data_compressed":6426991,"data_compressed_allocated":16879616,"data_compressed_original":275669524,"omap_allocated":12760,"internal_metadata":289394216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":163989477,"num_objects":97,"num_object_clones":32,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":30,"num_read":6665,"num_read_kb":41286,"num_write":823,"num_write_kb":55430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039689"},"pg_stats":[{"pgid":"3.1f","version":"57'248","reported_seq":1495,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.490179+0000","last_change":"2024-09-11T07:06:00.826807+0000","last_active":"2024-09-11T07:06:41.490179+0000","last_peered":"2024-09-11T07:06:41.490179+0000","last_clean":"2024-09-11T07:06:41.490179+0000","last_became_active":"2024-09-11T07:05:58.836990+0000","last_became_peered":"2024-09-11T07:05:58.836990+0000","last_unstale":"2024-09-11T07:06:41.490179+0000","last_undegraded":"2024-09-11T07:06:41.490179+0000","last_fullsized":"2024-09-11T07:06:41.490179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:31.660488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097647200000000004,"stat_sum":{"num_bytes":5990315,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":14,"num_read":1977,"num_read_kb":3829,"num_write":361,"num_write_kb":14130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"56'81","reported_seq":1171,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.159363+0000","last_change":"2024-09-11T07:06:00.970173+0000","last_active":"2024-09-11T07:06:41.159363+0000","last_peered":"2024-09-11T07:06:41.159363+0000","last_clean":"2024-09-11T07:06:41.159363+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:06:41.159363+0000","last_undegraded":"2024-09-11T07:06:41.159363+0000","last_fullsized":"2024-09-11T07:06:41.159363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:01.750176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084787600000000001,"stat_sum":{"num_bytes":22222596,"num_objects":25,"num_object_clones":5,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":7,"num_read":1025,"num_read_kb":9880,"num_write":75,"num_write_kb":6972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"57'112","reported_seq":1548,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.498051+0000","last_change":"2024-09-11T07:06:00.825433+0000","last_active":"2024-09-11T07:06:41.498051+0000","last_peered":"2024-09-11T07:06:41.498051+0000","last_clean":"2024-09-11T07:06:41.498051+0000","last_became_active":"2024-09-11T07:05:58.827234+0000","last_became_peered":"2024-09-11T07:05:58.827234+0000","last_unstale":"2024-09-11T07:06:41.498051+0000","last_undegraded":"2024-09-11T07:06:41.498051+0000","last_fullsized":"2024-09-11T07:06:41.498051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:12:41.547816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550473,"stat_sum":{"num_bytes":20276212,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":10,"num_read":1879,"num_read_kb":10756,"num_write":100,"num_write_kb":3044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"56'102","reported_seq":1521,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083325+0000","last_change":"2024-09-11T07:06:00.827149+0000","last_active":"2024-09-11T07:06:41.083325+0000","last_peered":"2024-09-11T07:06:41.083325+0000","last_clean":"2024-09-11T07:06:41.083325+0000","last_became_active":"2024-09-11T07:05:58.826843+0000","last_became_peered":"2024-09-11T07:05:58.826843+0000","last_unstale":"2024-09-11T07:06:41.083325+0000","last_undegraded":"2024-09-11T07:06:41.083325+0000","last_fullsized":"2024-09-11T07:06:41.083325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:05.930809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022332319999999999,"stat_sum":{"num_bytes":26446574,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":10,"num_read":1428,"num_read_kb":8330,"num_write":100,"num_write_kb":5948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"56'156","reported_seq":601,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.085925+0000","last_change":"2024-09-11T07:06:00.826913+0000","last_active":"2024-09-11T07:06:41.085925+0000","last_peered":"2024-09-11T07:06:41.085925+0000","last_clean":"2024-09-11T07:06:41.085925+0000","last_became_active":"2024-09-11T07:05:58.809515+0000","last_became_peered":"2024-09-11T07:05:58.809515+0000","last_unstale":"2024-09-11T07:06:41.085925+0000","last_undegraded":"2024-09-11T07:06:41.085925+0000","last_fullsized":"2024-09-11T07:06:41.085925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:01.502547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001182787,"stat_sum":{"num_bytes":4929789,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":1280,"num_read_kb":3720,"num_write":214,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"51'185","reported_seq":1689,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.494133+0000","last_change":"2024-09-11T07:06:00.813235+0000","last_active":"2024-09-11T07:06:41.494133+0000","last_peered":"2024-09-11T07:06:41.494133+0000","last_clean":"2024-09-11T07:06:41.494133+0000","last_became_active":"2024-09-11T07:05:58.808656+0000","last_became_peered":"2024-09-11T07:05:58.808656+0000","last_unstale":"2024-09-11T07:06:41.494133+0000","last_undegraded":"2024-09-11T07:06:41.494133+0000","last_fullsized":"2024-09-11T07:06:41.494133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:11.007182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059322499999999996,"stat_sum":{"num_bytes":6779403,"num_objects":21,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":2891,"num_read_kb":5093,"num_write":237,"num_write_kb":1356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"53'70","reported_seq":252,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.079958+0000","last_change":"2024-09-11T07:06:00.820857+0000","last_active":"2024-09-11T07:06:41.079958+0000","last_peered":"2024-09-11T07:06:41.079958+0000","last_clean":"2024-09-11T07:06:41.079958+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:06:41.079958+0000","last_undegraded":"2024-09-11T07:06:41.079958+0000","last_fullsized":"2024-09-11T07:06:41.079958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:19:43.042214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076385799999999996,"stat_sum":{"num_bytes":5085964,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":110,"num_read_kb":414,"num_write":65,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'80","reported_seq":1546,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.419174+0000","last_change":"2024-09-11T07:06:00.970030+0000","last_active":"2024-09-11T07:06:41.419174+0000","last_peered":"2024-09-11T07:06:41.419174+0000","last_clean":"2024-09-11T07:06:41.419174+0000","last_became_active":"2024-09-11T07:05:58.809573+0000","last_became_peered":"2024-09-11T07:05:58.809573+0000","last_unstale":"2024-09-11T07:06:41.419174+0000","last_undegraded":"2024-09-11T07:06:41.419174+0000","last_fullsized":"2024-09-11T07:06:41.419174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:15:08.607406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001212451,"stat_sum":{"num_bytes":16733805,"num_objects":25,"num_object_clones":5,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":10,"num_read":1429,"num_read_kb":6134,"num_write":83,"num_write_kb":19543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"57'143","reported_seq":1261,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.520837+0000","last_change":"2024-09-11T07:06:00.826609+0000","last_active":"2024-09-11T07:06:41.520837+0000","last_peered":"2024-09-11T07:06:41.520837+0000","last_clean":"2024-09-11T07:06:41.520837+0000","last_became_active":"2024-09-11T07:05:58.836977+0000","last_became_peered":"2024-09-11T07:05:58.836977+0000","last_unstale":"2024-09-11T07:06:41.520837+0000","last_undegraded":"2024-09-11T07:06:41.520837+0000","last_fullsized":"2024-09-11T07:06:41.520837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:37.309104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093584899999999999,"stat_sum":{"num_bytes":7981571,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":4,"num_read":1839,"num_read_kb":8176,"num_write":156,"num_write_kb":5994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"51'307","reported_seq":1432,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083389+0000","last_change":"2024-09-11T07:06:00.825499+0000","last_active":"2024-09-11T07:06:41.083389+0000","last_peered":"2024-09-11T07:06:41.083389+0000","last_clean":"2024-09-11T07:06:41.083389+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:06:41.083389+0000","last_undegraded":"2024-09-11T07:06:41.083389+0000","last_fullsized":"2024-09-11T07:06:41.083389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:13.753420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056977600000000003,"stat_sum":{"num_bytes":21739920,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":7,"num_read":2371,"num_read_kb":5967,"num_write":414,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"56'68","reported_seq":1057,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080489+0000","last_change":"2024-09-11T07:06:00.837150+0000","last_active":"2024-09-11T07:06:41.080489+0000","last_peered":"2024-09-11T07:06:41.080489+0000","last_clean":"2024-09-11T07:06:41.080489+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:06:41.080489+0000","last_undegraded":"2024-09-11T07:06:41.080489+0000","last_fullsized":"2024-09-11T07:06:41.080489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:26:30.358917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184086,"stat_sum":{"num_bytes":13228086,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":9,"num_read":954,"num_read_kb":7130,"num_write":61,"num_write_kb":5247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"55'221","reported_seq":1595,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.091214+0000","last_change":"2024-09-11T07:06:00.812896+0000","last_active":"2024-09-11T07:06:41.091214+0000","last_peered":"2024-09-11T07:06:41.091214+0000","last_clean":"2024-09-11T07:06:41.091214+0000","last_became_active":"2024-09-11T07:05:58.814550+0000","last_became_peered":"2024-09-11T07:05:58.814550+0000","last_unstale":"2024-09-11T07:06:41.091214+0000","last_undegraded":"2024-09-11T07:06:41.091214+0000","last_fullsized":"2024-09-11T07:06:41.091214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:26:26.276481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046265999999999999,"stat_sum":{"num_bytes":11377382,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":12,"num_read":2940,"num_read_kb":7684,"num_write":257,"num_write_kb":3232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080837+0000","last_change":"2024-09-11T07:06:26.962907+0000","last_active":"2024-09-11T07:06:41.080837+0000","last_peered":"2024-09-11T07:06:41.080837+0000","last_clean":"2024-09-11T07:06:41.080837+0000","last_became_active":"2024-09-11T07:06:26.962135+0000","last_became_peered":"2024-09-11T07:06:26.962135+0000","last_unstale":"2024-09-11T07:06:41.080837+0000","last_undegraded":"2024-09-11T07:06:41.080837+0000","last_fullsized":"2024-09-11T07:06:41.080837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:32.560330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"56'205","reported_seq":1403,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.085969+0000","last_change":"2024-09-11T07:06:00.826127+0000","last_active":"2024-09-11T07:06:41.085969+0000","last_peered":"2024-09-11T07:06:41.085969+0000","last_clean":"2024-09-11T07:06:41.085969+0000","last_became_active":"2024-09-11T07:05:58.811377+0000","last_became_peered":"2024-09-11T07:05:58.811377+0000","last_unstale":"2024-09-11T07:06:41.085969+0000","last_undegraded":"2024-09-11T07:06:41.085969+0000","last_fullsized":"2024-09-11T07:06:41.085969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:47.187334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056190700000000005,"stat_sum":{"num_bytes":31082122,"num_objects":31,"num_object_clones":8,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":1651,"num_read_kb":6957,"num_write":260,"num_write_kb":4290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.081088+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:06:41.081088+0000","last_peered":"2024-09-11T07:06:41.081088+0000","last_clean":"2024-09-11T07:06:41.081088+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:06:41.081088+0000","last_undegraded":"2024-09-11T07:06:41.081088+0000","last_fullsized":"2024-09-11T07:06:41.081088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"57'191","reported_seq":1208,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.461432+0000","last_change":"2024-09-11T07:06:00.969789+0000","last_active":"2024-09-11T07:06:41.461432+0000","last_peered":"2024-09-11T07:06:41.461432+0000","last_clean":"2024-09-11T07:06:41.461432+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:06:41.461432+0000","last_undegraded":"2024-09-11T07:06:41.461432+0000","last_fullsized":"2024-09-11T07:06:41.461432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:59:45.753214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068823799999999998,"stat_sum":{"num_bytes":14122330,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":1641,"num_read_kb":7635,"num_write":233,"num_write_kb":3833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080657+0000","last_change":"2024-09-11T07:05:51.786713+0000","last_active":"2024-09-11T07:06:41.080657+0000","last_peered":"2024-09-11T07:06:41.080657+0000","last_clean":"2024-09-11T07:06:41.080657+0000","last_became_active":"2024-09-11T07:05:49.724679+0000","last_became_peered":"2024-09-11T07:05:49.724679+0000","last_unstale":"2024-09-11T07:06:41.080657+0000","last_undegraded":"2024-09-11T07:06:41.080657+0000","last_fullsized":"2024-09-11T07:06:41.080657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:36:43.830759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"53'73","reported_seq":462,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080074+0000","last_change":"2024-09-11T07:06:00.821584+0000","last_active":"2024-09-11T07:06:41.080074+0000","last_peered":"2024-09-11T07:06:41.080074+0000","last_clean":"2024-09-11T07:06:41.080074+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:06:41.080074+0000","last_undegraded":"2024-09-11T07:06:41.080074+0000","last_fullsized":"2024-09-11T07:06:41.080074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:12.489802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001413975,"stat_sum":{"num_bytes":2743404,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":552,"num_read_kb":1405,"num_write":67,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080173+0000","last_change":"2024-09-11T07:05:51.151362+0000","last_active":"2024-09-11T07:06:41.080173+0000","last_peered":"2024-09-11T07:06:41.080173+0000","last_clean":"2024-09-11T07:06:41.080173+0000","last_became_active":"2024-09-11T07:05:49.725356+0000","last_became_peered":"2024-09-11T07:05:49.725356+0000","last_unstale":"2024-09-11T07:06:41.080173+0000","last_undegraded":"2024-09-11T07:06:41.080173+0000","last_fullsized":"2024-09-11T07:06:41.080173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:53.822013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"56'287","reported_seq":902,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083521+0000","last_change":"2024-09-11T07:06:00.827482+0000","last_active":"2024-09-11T07:06:41.083521+0000","last_peered":"2024-09-11T07:06:41.083521+0000","last_clean":"2024-09-11T07:06:41.083521+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:06:41.083521+0000","last_undegraded":"2024-09-11T07:06:41.083521+0000","last_fullsized":"2024-09-11T07:06:41.083521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:06:35.428567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002494839,"stat_sum":{"num_bytes":21397389,"num_objects":28,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":6,"num_read":1597,"num_read_kb":3760,"num_write":422,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"57'212","reported_seq":1215,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.497702+0000","last_change":"2024-09-11T07:06:00.812921+0000","last_active":"2024-09-11T07:06:41.497702+0000","last_peered":"2024-09-11T07:06:41.497702+0000","last_clean":"2024-09-11T07:06:41.497702+0000","last_became_active":"2024-09-11T07:05:58.808560+0000","last_became_peered":"2024-09-11T07:05:58.808560+0000","last_unstale":"2024-09-11T07:06:41.497702+0000","last_undegraded":"2024-09-11T07:06:41.497702+0000","last_fullsized":"2024-09-11T07:06:41.497702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:39.877619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040103300000000002,"stat_sum":{"num_bytes":21351582,"num_objects":28,"num_object_clones":6,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":9,"num_read":1461,"num_read_kb":5169,"num_write":285,"num_write_kb":4042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":95,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083326+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:06:41.083326+0000","last_peered":"2024-09-11T07:06:41.083326+0000","last_clean":"2024-09-11T07:06:41.083326+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:06:41.083326+0000","last_undegraded":"2024-09-11T07:06:41.083326+0000","last_fullsized":"2024-09-11T07:06:41.083326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"56'275","reported_seq":2607,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.079933+0000","last_change":"2024-09-11T07:06:00.820656+0000","last_active":"2024-09-11T07:06:41.079933+0000","last_peered":"2024-09-11T07:06:41.079933+0000","last_clean":"2024-09-11T07:06:41.079933+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:06:41.079933+0000","last_undegraded":"2024-09-11T07:06:41.079933+0000","last_fullsized":"2024-09-11T07:06:41.079933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:06.190645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058463999999999999,"stat_sum":{"num_bytes":72235053,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":6,"num_read":3115,"num_read_kb":27296,"num_write":342,"num_write_kb":24548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.081796+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:06:41.081796+0000","last_peered":"2024-09-11T07:06:41.081796+0000","last_clean":"2024-09-11T07:06:41.081796+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:06:41.081796+0000","last_undegraded":"2024-09-11T07:06:41.081796+0000","last_fullsized":"2024-09-11T07:06:41.081796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"57'168","reported_seq":2832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.511245+0000","last_change":"2024-09-11T07:06:00.826070+0000","last_active":"2024-09-11T07:06:41.511245+0000","last_peered":"2024-09-11T07:06:41.511245+0000","last_clean":"2024-09-11T07:06:41.511245+0000","last_became_active":"2024-09-11T07:05:58.817151+0000","last_became_peered":"2024-09-11T07:05:58.817151+0000","last_unstale":"2024-09-11T07:06:41.511245+0000","last_undegraded":"2024-09-11T07:06:41.511245+0000","last_fullsized":"2024-09-11T07:06:41.511245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:15.659224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070404599999999995,"stat_sum":{"num_bytes":30788754,"num_objects":22,"num_object_clones":3,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":3631,"num_read_kb":23088,"num_write":190,"num_write_kb":20265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080423+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:06:41.080423+0000","last_peered":"2024-09-11T07:06:41.080423+0000","last_clean":"2024-09-11T07:06:41.080423+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:06:41.080423+0000","last_undegraded":"2024-09-11T07:06:41.080423+0000","last_fullsized":"2024-09-11T07:06:41.080423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"53'155","reported_seq":323,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.159179+0000","last_change":"2024-09-11T07:06:00.970754+0000","last_active":"2024-09-11T07:06:41.159179+0000","last_peered":"2024-09-11T07:06:41.159179+0000","last_clean":"2024-09-11T07:06:41.159179+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:06:41.159179+0000","last_undegraded":"2024-09-11T07:06:41.159179+0000","last_fullsized":"2024-09-11T07:06:41.159179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:16.420049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013822890000000001,"stat_sum":{"num_bytes":1915234,"num_objects":14,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":4,"num_read":599,"num_read_kb":1291,"num_write":220,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":94,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083310+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:06:41.083310+0000","last_peered":"2024-09-11T07:06:41.083310+0000","last_clean":"2024-09-11T07:06:41.083310+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:06:41.083310+0000","last_undegraded":"2024-09-11T07:06:41.083310+0000","last_fullsized":"2024-09-11T07:06:41.083310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":244,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080554+0000","last_change":"2024-09-11T07:05:43.785344+0000","last_active":"2024-09-11T07:06:41.080554+0000","last_peered":"2024-09-11T07:06:41.080554+0000","last_clean":"2024-09-11T07:06:41.080554+0000","last_became_active":"2024-09-11T07:05:43.783090+0000","last_became_peered":"2024-09-11T07:05:43.783090+0000","last_unstale":"2024-09-11T07:06:41.080554+0000","last_undegraded":"2024-09-11T07:06:41.080554+0000","last_fullsized":"2024-09-11T07:06:41.080554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:32.027951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"57'107","reported_seq":987,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.499149+0000","last_change":"2024-09-11T07:06:00.970646+0000","last_active":"2024-09-11T07:06:41.499149+0000","last_peered":"2024-09-11T07:06:41.499149+0000","last_clean":"2024-09-11T07:06:41.499149+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:06:41.499149+0000","last_undegraded":"2024-09-11T07:06:41.499149+0000","last_fullsized":"2024-09-11T07:06:41.499149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:42.472025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012611810000000001,"stat_sum":{"num_bytes":15890304,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":9,"num_read":847,"num_read_kb":6540,"num_write":118,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"54'76","reported_seq":398,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.091196+0000","last_change":"2024-09-11T07:06:00.813164+0000","last_active":"2024-09-11T07:06:41.091196+0000","last_peered":"2024-09-11T07:06:41.091196+0000","last_clean":"2024-09-11T07:06:41.091196+0000","last_became_active":"2024-09-11T07:05:59.016079+0000","last_became_peered":"2024-09-11T07:05:59.016079+0000","last_unstale":"2024-09-11T07:06:41.091196+0000","last_undegraded":"2024-09-11T07:06:41.091196+0000","last_fullsized":"2024-09-11T07:06:41.091196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:57.905386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062012700000000005,"stat_sum":{"num_bytes":6735888,"num_objects":21,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":457,"num_read_kb":3594,"num_write":71,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"56'266","reported_seq":849,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.091110+0000","last_change":"2024-09-11T07:06:26.964107+0000","last_active":"2024-09-11T07:06:41.091110+0000","last_peered":"2024-09-11T07:06:41.091110+0000","last_clean":"2024-09-11T07:06:41.091110+0000","last_became_active":"2024-09-11T07:06:26.960126+0000","last_became_peered":"2024-09-11T07:06:26.960126+0000","last_unstale":"2024-09-11T07:06:41.091110+0000","last_undegraded":"2024-09-11T07:06:41.091110+0000","last_fullsized":"2024-09-11T07:06:41.091110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:54.975336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046764000000000002,"stat_sum":{"num_bytes":14425618,"num_objects":24,"num_object_clones":2,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":8,"num_read":1566,"num_read_kb":4642,"num_write":368,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"57'197","reported_seq":981,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.416337+0000","last_change":"2024-09-11T07:06:00.971293+0000","last_active":"2024-09-11T07:06:41.416337+0000","last_peered":"2024-09-11T07:06:41.416337+0000","last_clean":"2024-09-11T07:06:41.416337+0000","last_became_active":"2024-09-11T07:05:58.809044+0000","last_became_peered":"2024-09-11T07:05:58.809044+0000","last_unstale":"2024-09-11T07:06:41.416337+0000","last_undegraded":"2024-09-11T07:06:41.416337+0000","last_fullsized":"2024-09-11T07:06:41.416337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:30.707703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021149200000000002,"stat_sum":{"num_bytes":6761336,"num_objects":21,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":2042,"num_read_kb":4069,"num_write":267,"num_write_kb":1376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"54'85","reported_seq":1908,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083370+0000","last_change":"2024-09-11T07:06:00.827407+0000","last_active":"2024-09-11T07:06:41.083370+0000","last_peered":"2024-09-11T07:06:41.083370+0000","last_clean":"2024-09-11T07:06:41.083370+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:06:41.083370+0000","last_undegraded":"2024-09-11T07:06:41.083370+0000","last_fullsized":"2024-09-11T07:06:41.083370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:06.653695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024738579999999998,"stat_sum":{"num_bytes":10718941,"num_objects":22,"num_object_clones":6,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":7,"num_read":1767,"num_read_kb":3101,"num_write":78,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"57'151","reported_seq":1765,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.511561+0000","last_change":"2024-09-11T07:06:00.838531+0000","last_active":"2024-09-11T07:06:41.511561+0000","last_peered":"2024-09-11T07:06:41.511561+0000","last_clean":"2024-09-11T07:06:41.511561+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:06:41.511561+0000","last_undegraded":"2024-09-11T07:06:41.511561+0000","last_fullsized":"2024-09-11T07:06:41.511561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:14.897827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022638789999999999,"stat_sum":{"num_bytes":26590081,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":6,"num_read":2173,"num_read_kb":12357,"num_write":176,"num_write_kb":5593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"57'180","reported_seq":1222,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.510898+0000","last_change":"2024-09-11T07:06:00.837799+0000","last_active":"2024-09-11T07:06:41.510898+0000","last_peered":"2024-09-11T07:06:41.510898+0000","last_clean":"2024-09-11T07:06:41.510898+0000","last_became_active":"2024-09-11T07:05:58.825160+0000","last_became_peered":"2024-09-11T07:05:58.825160+0000","last_unstale":"2024-09-11T07:06:41.510898+0000","last_undegraded":"2024-09-11T07:06:41.510898+0000","last_fullsized":"2024-09-11T07:06:41.510898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:36:39.672582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017910619999999999,"stat_sum":{"num_bytes":12523294,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":6,"num_read":2717,"num_read_kb":10287,"num_write":199,"num_write_kb":7263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"53'404","reported_seq":3575,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080733+0000","last_change":"2024-09-11T07:06:00.838063+0000","last_active":"2024-09-11T07:06:41.080733+0000","last_peered":"2024-09-11T07:06:41.080733+0000","last_clean":"2024-09-11T07:06:41.080733+0000","last_became_active":"2024-09-11T07:05:58.822422+0000","last_became_peered":"2024-09-11T07:05:58.822422+0000","last_unstale":"2024-09-11T07:06:41.080733+0000","last_undegraded":"2024-09-11T07:06:41.080733+0000","last_fullsized":"2024-09-11T07:06:41.080733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:25.391346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020506280000000001,"stat_sum":{"num_bytes":11183931,"num_objects":27,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":9,"num_read":5508,"num_read_kb":6370,"num_write":563,"num_write_kb":1252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"57'124","reported_seq":690,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.511958+0000","last_change":"2024-09-11T07:06:26.962057+0000","last_active":"2024-09-11T07:06:41.511958+0000","last_peered":"2024-09-11T07:06:41.511958+0000","last_clean":"2024-09-11T07:06:41.511958+0000","last_became_active":"2024-09-11T07:06:26.961501+0000","last_became_peered":"2024-09-11T07:06:26.961501+0000","last_unstale":"2024-09-11T07:06:41.511958+0000","last_undegraded":"2024-09-11T07:06:41.511958+0000","last_fullsized":"2024-09-11T07:06:41.511958+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:12:21.128218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049279100000000002,"stat_sum":{"num_bytes":13014185,"num_objects":29,"num_object_clones":4,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":11,"num_read":814,"num_read_kb":2396,"num_write":149,"num_write_kb":7953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"56'68","reported_seq":2155,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080423+0000","last_change":"2024-09-11T07:06:00.836320+0000","last_active":"2024-09-11T07:06:41.080423+0000","last_peered":"2024-09-11T07:06:41.080423+0000","last_clean":"2024-09-11T07:06:41.080423+0000","last_became_active":"2024-09-11T07:05:58.822373+0000","last_became_peered":"2024-09-11T07:05:58.822373+0000","last_unstale":"2024-09-11T07:06:41.080423+0000","last_undegraded":"2024-09-11T07:06:41.080423+0000","last_fullsized":"2024-09-11T07:06:41.080423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:53:22.018837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089665299999999997,"stat_sum":{"num_bytes":13279470,"num_objects":26,"num_object_clones":6,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":8,"num_read":2013,"num_read_kb":2558,"num_write":66,"num_write_kb":1838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"57'90","reported_seq":1868,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.140262+0000","last_change":"2024-09-11T07:06:00.826460+0000","last_active":"2024-09-11T07:06:41.140262+0000","last_peered":"2024-09-11T07:06:41.140262+0000","last_clean":"2024-09-11T07:06:41.140262+0000","last_became_active":"2024-09-11T07:05:58.833983+0000","last_became_peered":"2024-09-11T07:05:58.833983+0000","last_unstale":"2024-09-11T07:06:41.140262+0000","last_undegraded":"2024-09-11T07:06:41.140262+0000","last_fullsized":"2024-09-11T07:06:41.140262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:30.368424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086507200000000004,"stat_sum":{"num_bytes":24485006,"num_objects":31,"num_object_clones":8,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":1725,"num_read_kb":15298,"num_write":93,"num_write_kb":6919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"53'137","reported_seq":1037,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080463+0000","last_change":"2024-09-11T07:06:00.836900+0000","last_active":"2024-09-11T07:06:41.080463+0000","last_peered":"2024-09-11T07:06:41.080463+0000","last_clean":"2024-09-11T07:06:41.080463+0000","last_became_active":"2024-09-11T07:05:58.823540+0000","last_became_peered":"2024-09-11T07:05:58.823540+0000","last_unstale":"2024-09-11T07:06:41.080463+0000","last_undegraded":"2024-09-11T07:06:41.080463+0000","last_fullsized":"2024-09-11T07:06:41.080463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:15.886247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012764899999999999,"stat_sum":{"num_bytes":6873575,"num_objects":23,"num_object_clones":3,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":1246,"num_read_kb":2057,"num_write":155,"num_write_kb":1273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":520909114,"num_objects":825,"num_object_clones":170,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":825,"num_whiteouts":256,"num_read":57245,"num_read_kb":226983,"num_write":6445,"num_write_kb":171446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21438464,"data_stored":282030860,"data_compressed":6686390,"data_compressed_allocated":17375232,"data_compressed_original":279742932,"omap_allocated":0,"internal_metadata":0},"log_size":5224,"ondisk_log_size":5224,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42956,"kb_used_data":3432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328884,"statfs":{"total":96636764160,"available":96592777216,"internally_reserved":0,"allocated":3514368,"data_stored":28917197,"data_compressed":830324,"data_compressed_allocated":2154496,"data_compressed_original":28206795,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32752,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339088,"statfs":{"total":96636764160,"available":96603226112,"internally_reserved":0,"allocated":1601536,"data_stored":12362596,"data_compressed":228271,"data_compressed_allocated":749568,"data_compressed_original":11948470,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42292,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329548,"statfs":{"total":96636764160,"available":96593457152,"internally_reserved":0,"allocated":2854912,"data_stored":21100569,"data_compressed":695338,"data_compressed_allocated":1658880,"data_compressed_original":20522989,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44104,"kb_used_data":4592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327736,"statfs":{"total":96636764160,"available":96591601664,"internally_reserved":0,"allocated":4702208,"data_stored":51631384,"data_compressed":1346067,"data_compressed_allocated":3248128,"data_compressed_original":50855227,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38368,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333472,"statfs":{"total":96636764160,"available":96597475328,"internally_reserved":0,"allocated":3084288,"data_stored":29495527,"data_compressed":634877,"data_compressed_allocated":1806336,"data_compressed_original":28897792,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33756,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338084,"statfs":{"total":96636764160,"available":96602198016,"internally_reserved":0,"allocated":2629632,"data_stored":37878392,"data_compressed":610308,"data_compressed_allocated":1765376,"data_compressed_original":37462498,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34548,"kb_used_data":3360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337292,"statfs":{"total":96636764160,"available":96601387008,"internally_reserved":0,"allocated":3440640,"data_stored":42976137,"data_compressed":938517,"data_compressed_allocated":2347008,"data_compressed_original":42447330,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":4256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":4358144,"data_stored":55927505,"data_compressed":1143289,"data_compressed_allocated":3149824,"data_compressed_original":55328423,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3870720,"data_stored":58130873,"data_compressed":1166005,"data_compressed_allocated":3325952,"data_compressed_original":57834119,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2777088,"data_stored":42683849,"data_compressed":938517,"data_compressed_allocated":2347008,"data_compressed_original":42447330,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1970176,"data_stored":37586123,"data_compressed":610308,"data_compressed_allocated":1765376,"data_compressed_original":37462498,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2580480,"data_stored":30042181,"data_compressed":735745,"data_compressed_allocated":1945600,"data_compressed_original":29729280,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4087808,"data_stored":51392616,"data_compressed":1376760,"data_compressed_allocated":3284992,"data_compressed_original":50904379,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2191360,"data_stored":20808281,"data_compressed":695338,"data_compressed_allocated":1658880,"data_compressed_original":20522989,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":946176,"data_stored":12070327,"data_compressed":228271,"data_compressed_allocated":749568,"data_compressed_original":11947414,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3014656,"data_stored":29316610,"data_compressed":935446,"data_compressed_allocated":2297856,"data_compressed_original":28894923,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:06:44.483 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:06:44.578 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:44.578 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:44.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:44.578+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:44.593 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:44.682 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:44.678+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:44.742 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:44.742 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:44.755 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:44.804 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:44.802+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:44.806 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:06:44.807 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:06:44.823 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2024-09-11T07:06:44.106879+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":521499501,"num_objects":829,"num_object_clones":170,"num_object_copies":1658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":829,"num_whiteouts":256,"num_read":57361,"num_read_kb":227083,"num_write":6606,"num_write_kb":173864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5344,"ondisk_log_size":5344,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":308380,"kb_used_data":25572,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754666340,"statfs":{"total":773094113280,"available":772778332160,"internally_reserved":0,"allocated":26185728,"data_stored":280289307,"data_compressed":6426991,"data_compressed_allocated":16879616,"data_compressed_original":275669524,"omap_allocated":12760,"internal_metadata":289394216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":163989477,"num_objects":97,"num_object_clones":32,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":30,"num_read":6665,"num_read_kb":41286,"num_write":823,"num_write_kb":55430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.039689"},"pg_stats":[{"pgid":"3.1f","version":"57'248","reported_seq":1495,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.490179+0000","last_change":"2024-09-11T07:06:00.826807+0000","last_active":"2024-09-11T07:06:41.490179+0000","last_peered":"2024-09-11T07:06:41.490179+0000","last_clean":"2024-09-11T07:06:41.490179+0000","last_became_active":"2024-09-11T07:05:58.836990+0000","last_became_peered":"2024-09-11T07:05:58.836990+0000","last_unstale":"2024-09-11T07:06:41.490179+0000","last_undegraded":"2024-09-11T07:06:41.490179+0000","last_fullsized":"2024-09-11T07:06:41.490179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:31.660488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097647200000000004,"stat_sum":{"num_bytes":5990315,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":14,"num_read":1977,"num_read_kb":3829,"num_write":361,"num_write_kb":14130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"56'81","reported_seq":1171,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.159363+0000","last_change":"2024-09-11T07:06:00.970173+0000","last_active":"2024-09-11T07:06:41.159363+0000","last_peered":"2024-09-11T07:06:41.159363+0000","last_clean":"2024-09-11T07:06:41.159363+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:06:41.159363+0000","last_undegraded":"2024-09-11T07:06:41.159363+0000","last_fullsized":"2024-09-11T07:06:41.159363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:01.750176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084787600000000001,"stat_sum":{"num_bytes":22222596,"num_objects":25,"num_object_clones":5,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":7,"num_read":1025,"num_read_kb":9880,"num_write":75,"num_write_kb":6972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"57'112","reported_seq":1548,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.498051+0000","last_change":"2024-09-11T07:06:00.825433+0000","last_active":"2024-09-11T07:06:41.498051+0000","last_peered":"2024-09-11T07:06:41.498051+0000","last_clean":"2024-09-11T07:06:41.498051+0000","last_became_active":"2024-09-11T07:05:58.827234+0000","last_became_peered":"2024-09-11T07:05:58.827234+0000","last_unstale":"2024-09-11T07:06:41.498051+0000","last_undegraded":"2024-09-11T07:06:41.498051+0000","last_fullsized":"2024-09-11T07:06:41.498051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:12:41.547816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550473,"stat_sum":{"num_bytes":20276212,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":10,"num_read":1879,"num_read_kb":10756,"num_write":100,"num_write_kb":3044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"56'102","reported_seq":1521,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083325+0000","last_change":"2024-09-11T07:06:00.827149+0000","last_active":"2024-09-11T07:06:41.083325+0000","last_peered":"2024-09-11T07:06:41.083325+0000","last_clean":"2024-09-11T07:06:41.083325+0000","last_became_active":"2024-09-11T07:05:58.826843+0000","last_became_peered":"2024-09-11T07:05:58.826843+0000","last_unstale":"2024-09-11T07:06:41.083325+0000","last_undegraded":"2024-09-11T07:06:41.083325+0000","last_fullsized":"2024-09-11T07:06:41.083325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:05.930809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022332319999999999,"stat_sum":{"num_bytes":26446574,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":10,"num_read":1428,"num_read_kb":8330,"num_write":100,"num_write_kb":5948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"56'156","reported_seq":601,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.085925+0000","last_change":"2024-09-11T07:06:00.826913+0000","last_active":"2024-09-11T07:06:41.085925+0000","last_peered":"2024-09-11T07:06:41.085925+0000","last_clean":"2024-09-11T07:06:41.085925+0000","last_became_active":"2024-09-11T07:05:58.809515+0000","last_became_peered":"2024-09-11T07:05:58.809515+0000","last_unstale":"2024-09-11T07:06:41.085925+0000","last_undegraded":"2024-09-11T07:06:41.085925+0000","last_fullsized":"2024-09-11T07:06:41.085925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:01.502547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001182787,"stat_sum":{"num_bytes":4929789,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":1280,"num_read_kb":3720,"num_write":214,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"51'185","reported_seq":1689,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.494133+0000","last_change":"2024-09-11T07:06:00.813235+0000","last_active":"2024-09-11T07:06:41.494133+0000","last_peered":"2024-09-11T07:06:41.494133+0000","last_clean":"2024-09-11T07:06:41.494133+0000","last_became_active":"2024-09-11T07:05:58.808656+0000","last_became_peered":"2024-09-11T07:05:58.808656+0000","last_unstale":"2024-09-11T07:06:41.494133+0000","last_undegraded":"2024-09-11T07:06:41.494133+0000","last_fullsized":"2024-09-11T07:06:41.494133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:11.007182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059322499999999996,"stat_sum":{"num_bytes":6779403,"num_objects":21,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":2891,"num_read_kb":5093,"num_write":237,"num_write_kb":1356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"53'70","reported_seq":252,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.079958+0000","last_change":"2024-09-11T07:06:00.820857+0000","last_active":"2024-09-11T07:06:41.079958+0000","last_peered":"2024-09-11T07:06:41.079958+0000","last_clean":"2024-09-11T07:06:41.079958+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:06:41.079958+0000","last_undegraded":"2024-09-11T07:06:41.079958+0000","last_fullsized":"2024-09-11T07:06:41.079958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:19:43.042214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076385799999999996,"stat_sum":{"num_bytes":5085964,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":110,"num_read_kb":414,"num_write":65,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'80","reported_seq":1546,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.419174+0000","last_change":"2024-09-11T07:06:00.970030+0000","last_active":"2024-09-11T07:06:41.419174+0000","last_peered":"2024-09-11T07:06:41.419174+0000","last_clean":"2024-09-11T07:06:41.419174+0000","last_became_active":"2024-09-11T07:05:58.809573+0000","last_became_peered":"2024-09-11T07:05:58.809573+0000","last_unstale":"2024-09-11T07:06:41.419174+0000","last_undegraded":"2024-09-11T07:06:41.419174+0000","last_fullsized":"2024-09-11T07:06:41.419174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:15:08.607406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001212451,"stat_sum":{"num_bytes":16733805,"num_objects":25,"num_object_clones":5,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":10,"num_read":1429,"num_read_kb":6134,"num_write":83,"num_write_kb":19543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"57'143","reported_seq":1261,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.520837+0000","last_change":"2024-09-11T07:06:00.826609+0000","last_active":"2024-09-11T07:06:41.520837+0000","last_peered":"2024-09-11T07:06:41.520837+0000","last_clean":"2024-09-11T07:06:41.520837+0000","last_became_active":"2024-09-11T07:05:58.836977+0000","last_became_peered":"2024-09-11T07:05:58.836977+0000","last_unstale":"2024-09-11T07:06:41.520837+0000","last_undegraded":"2024-09-11T07:06:41.520837+0000","last_fullsized":"2024-09-11T07:06:41.520837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:37.309104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093584899999999999,"stat_sum":{"num_bytes":7981571,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":4,"num_read":1839,"num_read_kb":8176,"num_write":156,"num_write_kb":5994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"51'307","reported_seq":1432,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083389+0000","last_change":"2024-09-11T07:06:00.825499+0000","last_active":"2024-09-11T07:06:41.083389+0000","last_peered":"2024-09-11T07:06:41.083389+0000","last_clean":"2024-09-11T07:06:41.083389+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:06:41.083389+0000","last_undegraded":"2024-09-11T07:06:41.083389+0000","last_fullsized":"2024-09-11T07:06:41.083389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:13.753420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056977600000000003,"stat_sum":{"num_bytes":21739920,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":7,"num_read":2371,"num_read_kb":5967,"num_write":414,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"56'68","reported_seq":1057,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080489+0000","last_change":"2024-09-11T07:06:00.837150+0000","last_active":"2024-09-11T07:06:41.080489+0000","last_peered":"2024-09-11T07:06:41.080489+0000","last_clean":"2024-09-11T07:06:41.080489+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:06:41.080489+0000","last_undegraded":"2024-09-11T07:06:41.080489+0000","last_fullsized":"2024-09-11T07:06:41.080489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:26:30.358917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184086,"stat_sum":{"num_bytes":13228086,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":9,"num_read":954,"num_read_kb":7130,"num_write":61,"num_write_kb":5247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"55'221","reported_seq":1595,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.091214+0000","last_change":"2024-09-11T07:06:00.812896+0000","last_active":"2024-09-11T07:06:41.091214+0000","last_peered":"2024-09-11T07:06:41.091214+0000","last_clean":"2024-09-11T07:06:41.091214+0000","last_became_active":"2024-09-11T07:05:58.814550+0000","last_became_peered":"2024-09-11T07:05:58.814550+0000","last_unstale":"2024-09-11T07:06:41.091214+0000","last_undegraded":"2024-09-11T07:06:41.091214+0000","last_fullsized":"2024-09-11T07:06:41.091214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:26:26.276481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046265999999999999,"stat_sum":{"num_bytes":11377382,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":12,"num_read":2940,"num_read_kb":7684,"num_write":257,"num_write_kb":3232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080837+0000","last_change":"2024-09-11T07:06:26.962907+0000","last_active":"2024-09-11T07:06:41.080837+0000","last_peered":"2024-09-11T07:06:41.080837+0000","last_clean":"2024-09-11T07:06:41.080837+0000","last_became_active":"2024-09-11T07:06:26.962135+0000","last_became_peered":"2024-09-11T07:06:26.962135+0000","last_unstale":"2024-09-11T07:06:41.080837+0000","last_undegraded":"2024-09-11T07:06:41.080837+0000","last_fullsized":"2024-09-11T07:06:41.080837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:32.560330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"56'205","reported_seq":1403,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.085969+0000","last_change":"2024-09-11T07:06:00.826127+0000","last_active":"2024-09-11T07:06:41.085969+0000","last_peered":"2024-09-11T07:06:41.085969+0000","last_clean":"2024-09-11T07:06:41.085969+0000","last_became_active":"2024-09-11T07:05:58.811377+0000","last_became_peered":"2024-09-11T07:05:58.811377+0000","last_unstale":"2024-09-11T07:06:41.085969+0000","last_undegraded":"2024-09-11T07:06:41.085969+0000","last_fullsized":"2024-09-11T07:06:41.085969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:47.187334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056190700000000005,"stat_sum":{"num_bytes":31082122,"num_objects":31,"num_object_clones":8,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":1651,"num_read_kb":6957,"num_write":260,"num_write_kb":4290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.081088+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:06:41.081088+0000","last_peered":"2024-09-11T07:06:41.081088+0000","last_clean":"2024-09-11T07:06:41.081088+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:06:41.081088+0000","last_undegraded":"2024-09-11T07:06:41.081088+0000","last_fullsized":"2024-09-11T07:06:41.081088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"57'191","reported_seq":1208,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.461432+0000","last_change":"2024-09-11T07:06:00.969789+0000","last_active":"2024-09-11T07:06:41.461432+0000","last_peered":"2024-09-11T07:06:41.461432+0000","last_clean":"2024-09-11T07:06:41.461432+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:06:41.461432+0000","last_undegraded":"2024-09-11T07:06:41.461432+0000","last_fullsized":"2024-09-11T07:06:41.461432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:59:45.753214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068823799999999998,"stat_sum":{"num_bytes":14122330,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":1641,"num_read_kb":7635,"num_write":233,"num_write_kb":3833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080657+0000","last_change":"2024-09-11T07:05:51.786713+0000","last_active":"2024-09-11T07:06:41.080657+0000","last_peered":"2024-09-11T07:06:41.080657+0000","last_clean":"2024-09-11T07:06:41.080657+0000","last_became_active":"2024-09-11T07:05:49.724679+0000","last_became_peered":"2024-09-11T07:05:49.724679+0000","last_unstale":"2024-09-11T07:06:41.080657+0000","last_undegraded":"2024-09-11T07:06:41.080657+0000","last_fullsized":"2024-09-11T07:06:41.080657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:36:43.830759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"53'73","reported_seq":462,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080074+0000","last_change":"2024-09-11T07:06:00.821584+0000","last_active":"2024-09-11T07:06:41.080074+0000","last_peered":"2024-09-11T07:06:41.080074+0000","last_clean":"2024-09-11T07:06:41.080074+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:06:41.080074+0000","last_undegraded":"2024-09-11T07:06:41.080074+0000","last_fullsized":"2024-09-11T07:06:41.080074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:12.489802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001413975,"stat_sum":{"num_bytes":2743404,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":552,"num_read_kb":1405,"num_write":67,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080173+0000","last_change":"2024-09-11T07:05:51.151362+0000","last_active":"2024-09-11T07:06:41.080173+0000","last_peered":"2024-09-11T07:06:41.080173+0000","last_clean":"2024-09-11T07:06:41.080173+0000","last_became_active":"2024-09-11T07:05:49.725356+0000","last_became_peered":"2024-09-11T07:05:49.725356+0000","last_unstale":"2024-09-11T07:06:41.080173+0000","last_undegraded":"2024-09-11T07:06:41.080173+0000","last_fullsized":"2024-09-11T07:06:41.080173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:53.822013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"56'287","reported_seq":902,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083521+0000","last_change":"2024-09-11T07:06:00.827482+0000","last_active":"2024-09-11T07:06:41.083521+0000","last_peered":"2024-09-11T07:06:41.083521+0000","last_clean":"2024-09-11T07:06:41.083521+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:06:41.083521+0000","last_undegraded":"2024-09-11T07:06:41.083521+0000","last_fullsized":"2024-09-11T07:06:41.083521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:06:35.428567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002494839,"stat_sum":{"num_bytes":21397389,"num_objects":28,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":6,"num_read":1597,"num_read_kb":3760,"num_write":422,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"57'212","reported_seq":1215,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.497702+0000","last_change":"2024-09-11T07:06:00.812921+0000","last_active":"2024-09-11T07:06:41.497702+0000","last_peered":"2024-09-11T07:06:41.497702+0000","last_clean":"2024-09-11T07:06:41.497702+0000","last_became_active":"2024-09-11T07:05:58.808560+0000","last_became_peered":"2024-09-11T07:05:58.808560+0000","last_unstale":"2024-09-11T07:06:41.497702+0000","last_undegraded":"2024-09-11T07:06:41.497702+0000","last_fullsized":"2024-09-11T07:06:41.497702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:39.877619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040103300000000002,"stat_sum":{"num_bytes":21351582,"num_objects":28,"num_object_clones":6,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":9,"num_read":1461,"num_read_kb":5169,"num_write":285,"num_write_kb":4042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":95,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083326+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:06:41.083326+0000","last_peered":"2024-09-11T07:06:41.083326+0000","last_clean":"2024-09-11T07:06:41.083326+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:06:41.083326+0000","last_undegraded":"2024-09-11T07:06:41.083326+0000","last_fullsized":"2024-09-11T07:06:41.083326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"56'275","reported_seq":2607,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.079933+0000","last_change":"2024-09-11T07:06:00.820656+0000","last_active":"2024-09-11T07:06:41.079933+0000","last_peered":"2024-09-11T07:06:41.079933+0000","last_clean":"2024-09-11T07:06:41.079933+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:06:41.079933+0000","last_undegraded":"2024-09-11T07:06:41.079933+0000","last_fullsized":"2024-09-11T07:06:41.079933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:06.190645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058463999999999999,"stat_sum":{"num_bytes":72235053,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":6,"num_read":3115,"num_read_kb":27296,"num_write":342,"num_write_kb":24548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.081796+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:06:41.081796+0000","last_peered":"2024-09-11T07:06:41.081796+0000","last_clean":"2024-09-11T07:06:41.081796+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:06:41.081796+0000","last_undegraded":"2024-09-11T07:06:41.081796+0000","last_fullsized":"2024-09-11T07:06:41.081796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"57'168","reported_seq":2832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.511245+0000","last_change":"2024-09-11T07:06:00.826070+0000","last_active":"2024-09-11T07:06:41.511245+0000","last_peered":"2024-09-11T07:06:41.511245+0000","last_clean":"2024-09-11T07:06:41.511245+0000","last_became_active":"2024-09-11T07:05:58.817151+0000","last_became_peered":"2024-09-11T07:05:58.817151+0000","last_unstale":"2024-09-11T07:06:41.511245+0000","last_undegraded":"2024-09-11T07:06:41.511245+0000","last_fullsized":"2024-09-11T07:06:41.511245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:15.659224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070404599999999995,"stat_sum":{"num_bytes":30788754,"num_objects":22,"num_object_clones":3,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":3631,"num_read_kb":23088,"num_write":190,"num_write_kb":20265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080423+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:06:41.080423+0000","last_peered":"2024-09-11T07:06:41.080423+0000","last_clean":"2024-09-11T07:06:41.080423+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:06:41.080423+0000","last_undegraded":"2024-09-11T07:06:41.080423+0000","last_fullsized":"2024-09-11T07:06:41.080423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"53'155","reported_seq":323,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.159179+0000","last_change":"2024-09-11T07:06:00.970754+0000","last_active":"2024-09-11T07:06:41.159179+0000","last_peered":"2024-09-11T07:06:41.159179+0000","last_clean":"2024-09-11T07:06:41.159179+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:06:41.159179+0000","last_undegraded":"2024-09-11T07:06:41.159179+0000","last_fullsized":"2024-09-11T07:06:41.159179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:16.420049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013822890000000001,"stat_sum":{"num_bytes":1915234,"num_objects":14,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":4,"num_read":599,"num_read_kb":1291,"num_write":220,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":94,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083310+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:06:41.083310+0000","last_peered":"2024-09-11T07:06:41.083310+0000","last_clean":"2024-09-11T07:06:41.083310+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:06:41.083310+0000","last_undegraded":"2024-09-11T07:06:41.083310+0000","last_fullsized":"2024-09-11T07:06:41.083310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":244,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080554+0000","last_change":"2024-09-11T07:05:43.785344+0000","last_active":"2024-09-11T07:06:41.080554+0000","last_peered":"2024-09-11T07:06:41.080554+0000","last_clean":"2024-09-11T07:06:41.080554+0000","last_became_active":"2024-09-11T07:05:43.783090+0000","last_became_peered":"2024-09-11T07:05:43.783090+0000","last_unstale":"2024-09-11T07:06:41.080554+0000","last_undegraded":"2024-09-11T07:06:41.080554+0000","last_fullsized":"2024-09-11T07:06:41.080554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:32.027951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"57'107","reported_seq":987,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.499149+0000","last_change":"2024-09-11T07:06:00.970646+0000","last_active":"2024-09-11T07:06:41.499149+0000","last_peered":"2024-09-11T07:06:41.499149+0000","last_clean":"2024-09-11T07:06:41.499149+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:06:41.499149+0000","last_undegraded":"2024-09-11T07:06:41.499149+0000","last_fullsized":"2024-09-11T07:06:41.499149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:42.472025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012611810000000001,"stat_sum":{"num_bytes":15890304,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":9,"num_read":847,"num_read_kb":6540,"num_write":118,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"54'76","reported_seq":398,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.091196+0000","last_change":"2024-09-11T07:06:00.813164+0000","last_active":"2024-09-11T07:06:41.091196+0000","last_peered":"2024-09-11T07:06:41.091196+0000","last_clean":"2024-09-11T07:06:41.091196+0000","last_became_active":"2024-09-11T07:05:59.016079+0000","last_became_peered":"2024-09-11T07:05:59.016079+0000","last_unstale":"2024-09-11T07:06:41.091196+0000","last_undegraded":"2024-09-11T07:06:41.091196+0000","last_fullsized":"2024-09-11T07:06:41.091196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:57.905386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062012700000000005,"stat_sum":{"num_bytes":6735888,"num_objects":21,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":457,"num_read_kb":3594,"num_write":71,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"56'266","reported_seq":849,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.091110+0000","last_change":"2024-09-11T07:06:26.964107+0000","last_active":"2024-09-11T07:06:41.091110+0000","last_peered":"2024-09-11T07:06:41.091110+0000","last_clean":"2024-09-11T07:06:41.091110+0000","last_became_active":"2024-09-11T07:06:26.960126+0000","last_became_peered":"2024-09-11T07:06:26.960126+0000","last_unstale":"2024-09-11T07:06:41.091110+0000","last_undegraded":"2024-09-11T07:06:41.091110+0000","last_fullsized":"2024-09-11T07:06:41.091110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:54.975336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046764000000000002,"stat_sum":{"num_bytes":14425618,"num_objects":24,"num_object_clones":2,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":8,"num_read":1566,"num_read_kb":4642,"num_write":368,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"57'197","reported_seq":981,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.416337+0000","last_change":"2024-09-11T07:06:00.971293+0000","last_active":"2024-09-11T07:06:41.416337+0000","last_peered":"2024-09-11T07:06:41.416337+0000","last_clean":"2024-09-11T07:06:41.416337+0000","last_became_active":"2024-09-11T07:05:58.809044+0000","last_became_peered":"2024-09-11T07:05:58.809044+0000","last_unstale":"2024-09-11T07:06:41.416337+0000","last_undegraded":"2024-09-11T07:06:41.416337+0000","last_fullsized":"2024-09-11T07:06:41.416337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:30.707703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021149200000000002,"stat_sum":{"num_bytes":6761336,"num_objects":21,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":2042,"num_read_kb":4069,"num_write":267,"num_write_kb":1376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"54'85","reported_seq":1908,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083370+0000","last_change":"2024-09-11T07:06:00.827407+0000","last_active":"2024-09-11T07:06:41.083370+0000","last_peered":"2024-09-11T07:06:41.083370+0000","last_clean":"2024-09-11T07:06:41.083370+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:06:41.083370+0000","last_undegraded":"2024-09-11T07:06:41.083370+0000","last_fullsized":"2024-09-11T07:06:41.083370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:06.653695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024738579999999998,"stat_sum":{"num_bytes":10718941,"num_objects":22,"num_object_clones":6,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":7,"num_read":1767,"num_read_kb":3101,"num_write":78,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"57'151","reported_seq":1765,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.511561+0000","last_change":"2024-09-11T07:06:00.838531+0000","last_active":"2024-09-11T07:06:41.511561+0000","last_peered":"2024-09-11T07:06:41.511561+0000","last_clean":"2024-09-11T07:06:41.511561+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:06:41.511561+0000","last_undegraded":"2024-09-11T07:06:41.511561+0000","last_fullsized":"2024-09-11T07:06:41.511561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:14.897827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022638789999999999,"stat_sum":{"num_bytes":26590081,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":6,"num_read":2173,"num_read_kb":12357,"num_write":176,"num_write_kb":5593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"57'180","reported_seq":1222,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.510898+0000","last_change":"2024-09-11T07:06:00.837799+0000","last_active":"2024-09-11T07:06:41.510898+0000","last_peered":"2024-09-11T07:06:41.510898+0000","last_clean":"2024-09-11T07:06:41.510898+0000","last_became_active":"2024-09-11T07:05:58.825160+0000","last_became_peered":"2024-09-11T07:05:58.825160+0000","last_unstale":"2024-09-11T07:06:41.510898+0000","last_undegraded":"2024-09-11T07:06:41.510898+0000","last_fullsized":"2024-09-11T07:06:41.510898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:36:39.672582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017910619999999999,"stat_sum":{"num_bytes":12523294,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":6,"num_read":2717,"num_read_kb":10287,"num_write":199,"num_write_kb":7263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"53'404","reported_seq":3575,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080733+0000","last_change":"2024-09-11T07:06:00.838063+0000","last_active":"2024-09-11T07:06:41.080733+0000","last_peered":"2024-09-11T07:06:41.080733+0000","last_clean":"2024-09-11T07:06:41.080733+0000","last_became_active":"2024-09-11T07:05:58.822422+0000","last_became_peered":"2024-09-11T07:05:58.822422+0000","last_unstale":"2024-09-11T07:06:41.080733+0000","last_undegraded":"2024-09-11T07:06:41.080733+0000","last_fullsized":"2024-09-11T07:06:41.080733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:25.391346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020506280000000001,"stat_sum":{"num_bytes":11183931,"num_objects":27,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":9,"num_read":5508,"num_read_kb":6370,"num_write":563,"num_write_kb":1252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"57'124","reported_seq":690,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.511958+0000","last_change":"2024-09-11T07:06:26.962057+0000","last_active":"2024-09-11T07:06:41.511958+0000","last_peered":"2024-09-11T07:06:41.511958+0000","last_clean":"2024-09-11T07:06:41.511958+0000","last_became_active":"2024-09-11T07:06:26.961501+0000","last_became_peered":"2024-09-11T07:06:26.961501+0000","last_unstale":"2024-09-11T07:06:41.511958+0000","last_undegraded":"2024-09-11T07:06:41.511958+0000","last_fullsized":"2024-09-11T07:06:41.511958+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:12:21.128218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049279100000000002,"stat_sum":{"num_bytes":13014185,"num_objects":29,"num_object_clones":4,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":11,"num_read":814,"num_read_kb":2396,"num_write":149,"num_write_kb":7953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"56'68","reported_seq":2155,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080423+0000","last_change":"2024-09-11T07:06:00.836320+0000","last_active":"2024-09-11T07:06:41.080423+0000","last_peered":"2024-09-11T07:06:41.080423+0000","last_clean":"2024-09-11T07:06:41.080423+0000","last_became_active":"2024-09-11T07:05:58.822373+0000","last_became_peered":"2024-09-11T07:05:58.822373+0000","last_unstale":"2024-09-11T07:06:41.080423+0000","last_undegraded":"2024-09-11T07:06:41.080423+0000","last_fullsized":"2024-09-11T07:06:41.080423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:53:22.018837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089665299999999997,"stat_sum":{"num_bytes":13279470,"num_objects":26,"num_object_clones":6,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":8,"num_read":2013,"num_read_kb":2558,"num_write":66,"num_write_kb":1838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"57'90","reported_seq":1868,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.140262+0000","last_change":"2024-09-11T07:06:00.826460+0000","last_active":"2024-09-11T07:06:41.140262+0000","last_peered":"2024-09-11T07:06:41.140262+0000","last_clean":"2024-09-11T07:06:41.140262+0000","last_became_active":"2024-09-11T07:05:58.833983+0000","last_became_peered":"2024-09-11T07:05:58.833983+0000","last_unstale":"2024-09-11T07:06:41.140262+0000","last_undegraded":"2024-09-11T07:06:41.140262+0000","last_fullsized":"2024-09-11T07:06:41.140262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:30.368424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086507200000000004,"stat_sum":{"num_bytes":24485006,"num_objects":31,"num_object_clones":8,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":1725,"num_read_kb":15298,"num_write":93,"num_write_kb":6919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"53'137","reported_seq":1037,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080463+0000","last_change":"2024-09-11T07:06:00.836900+0000","last_active":"2024-09-11T07:06:41.080463+0000","last_peered":"2024-09-11T07:06:41.080463+0000","last_clean":"2024-09-11T07:06:41.080463+0000","last_became_active":"2024-09-11T07:05:58.823540+0000","last_became_peered":"2024-09-11T07:05:58.823540+0000","last_unstale":"2024-09-11T07:06:41.080463+0000","last_undegraded":"2024-09-11T07:06:41.080463+0000","last_fullsized":"2024-09-11T07:06:41.080463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:15.886247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012764899999999999,"stat_sum":{"num_bytes":6873575,"num_objects":23,"num_object_clones":3,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":1246,"num_read_kb":2057,"num_write":155,"num_write_kb":1273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":520909114,"num_objects":825,"num_object_clones":170,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":825,"num_whiteouts":256,"num_read":57245,"num_read_kb":226983,"num_write":6445,"num_write_kb":171446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21438464,"data_stored":282030860,"data_compressed":6686390,"data_compressed_allocated":17375232,"data_compressed_original":279742932,"omap_allocated":0,"internal_metadata":0},"log_size":5224,"ondisk_log_size":5224,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42956,"kb_used_data":3432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328884,"statfs":{"total":96636764160,"available":96592777216,"internally_reserved":0,"allocated":3514368,"data_stored":28917197,"data_compressed":830324,"data_compressed_allocated":2154496,"data_compressed_original":28206795,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32752,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339088,"statfs":{"total":96636764160,"available":96603226112,"internally_reserved":0,"allocated":1601536,"data_stored":12362596,"data_compressed":228271,"data_compressed_allocated":749568,"data_compressed_original":11948470,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42292,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329548,"statfs":{"total":96636764160,"available":96593457152,"internally_reserved":0,"allocated":2854912,"data_stored":21100569,"data_compressed":695338,"data_compressed_allocated":1658880,"data_compressed_original":20522989,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44104,"kb_used_data":4592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327736,"statfs":{"total":96636764160,"available":96591601664,"internally_reserved":0,"allocated":4702208,"data_stored":51631384,"data_compressed":1346067,"data_compressed_allocated":3248128,"data_compressed_original":50855227,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38368,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333472,"statfs":{"total":96636764160,"available":96597475328,"internally_reserved":0,"allocated":3084288,"data_stored":29495527,"data_compressed":634877,"data_compressed_allocated":1806336,"data_compressed_original":28897792,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33756,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338084,"statfs":{"total":96636764160,"available":96602198016,"internally_reserved":0,"allocated":2629632,"data_stored":37878392,"data_compressed":610308,"data_compressed_allocated":1765376,"data_compressed_original":37462498,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34548,"kb_used_data":3360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337292,"statfs":{"total":96636764160,"available":96601387008,"internally_reserved":0,"allocated":3440640,"data_stored":42976137,"data_compressed":938517,"data_compressed_allocated":2347008,"data_compressed_original":42447330,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":4256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":4358144,"data_stored":55927505,"data_compressed":1143289,"data_compressed_allocated":3149824,"data_compressed_original":55328423,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3870720,"data_stored":58130873,"data_compressed":1166005,"data_compressed_allocated":3325952,"data_compressed_original":57834119,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2777088,"data_stored":42683849,"data_compressed":938517,"data_compressed_allocated":2347008,"data_compressed_original":42447330,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1970176,"data_stored":37586123,"data_compressed":610308,"data_compressed_allocated":1765376,"data_compressed_original":37462498,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2580480,"data_stored":30042181,"data_compressed":735745,"data_compressed_allocated":1945600,"data_compressed_original":29729280,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4087808,"data_stored":51392616,"data_compressed":1376760,"data_compressed_allocated":3284992,"data_compressed_original":50904379,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2191360,"data_stored":20808281,"data_compressed":695338,"data_compressed_allocated":1658880,"data_compressed_original":20522989,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":946176,"data_stored":12070327,"data_compressed":228271,"data_compressed_allocated":749568,"data_compressed_original":11947414,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3014656,"data_stored":29316610,"data_compressed":935446,"data_compressed_allocated":2297856,"data_compressed_original":28894923,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:06:44.826 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T07:06:44.826 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:06:44.826 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T07:06:44.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T07:06:44.883 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:44.881+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:44.912 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:44.912 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:44.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:44.984 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:44.982+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:45.034 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:45.034 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:45.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:45.084 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:45.081+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:45.124 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:06:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:06:45.171 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 61, 2024-09-11T07:06:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "e1313abd-54a9-4e53-ab67-469f744048b1", 2024-09-11T07:06:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-11T07:05:29.098467+0000", 2024-09-11T07:06:45.171 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-11T07:06:45.113377+0000", 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-11T07:05:41.051856+0000", 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-11T07:05:31.688503+0000", 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5801984, 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "noscrub", 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-11T07:06:45.172 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "jewel", 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "squid", 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-11T07:06:45.173 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:41.897005+0000", 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:06:45.174 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.175 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:06:45.176 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:06:45.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-11T07:06:45.178 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 6.9000000953674316, 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 6.9000000953674316, 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.28999999165534973, 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.875, 2024-09-11T07:06:45.179 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:47.687214+0000", 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:06:45.180 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-11T07:06:45.181 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "20", 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:06:45.182 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 2, 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 20, 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:06:45.183 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:06:45.184 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.185 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 2.630000114440918, 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 2.630000114440918, 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 1, 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2.630000114440918, 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2.630000114440918, 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.875, 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:06:45.186 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:57.298060+0000", 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:06:45.187 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:06:45.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "61", 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 27, 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 61, 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:06:45.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:06:45.190 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:06:45.191 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.5399999618530273, 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.5399999618530273, 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 1.1399999856948853, 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.75, 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.75, 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.875, 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 1, 2024-09-11T07:06:45.192 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.87999999523162842 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "24d57cdb-2f3a-4a96-903d-11be7dc26a20", 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:45.193 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-11T07:06:45.194 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.195 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/1708235775", 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/1708235775", 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/1708235775", 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/1708235775", 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "aa51dc1b-b783-4212-8736-1f666239613b", 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:45.199 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.201 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:45.202 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:06:45.203 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/2076268206", 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/2076268206", 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/2076268206", 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/2076268206", 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.204 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "141a913f-7353-44a9-9dbd-70219bcee638", 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 17, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:45.205 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:45.207 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:45.208 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/1904492349", 2024-09-11T07:06:45.209 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/1904492349", 2024-09-11T07:06:45.210 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/1904492349", 2024-09-11T07:06:45.210 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/1904492349", 2024-09-11T07:06:45.210 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:45.210 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:45.210 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:45.214 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.214 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:06:45.214 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "32550aeb-0c8d-4ca9-afd5-3e5258e7255b", 2024-09-11T07:06:45.214 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.215 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:45.216 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.217 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:45.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.219 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/1327328912", 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/1327328912", 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/1327328912", 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/1327328912", 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:45.220 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc", 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2024-09-11T07:06:45.221 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6808", 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6809", 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:45.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6810", 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6811", 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6814", 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6815", 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.224 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6812", 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6813", 2024-09-11T07:06:45.225 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6809/4087452871", 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6811/4087452871", 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6815/4087452871", 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6813/4087452871", 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:06:45.226 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "42c83053-328e-4c9b-bdaf-09e1a4cc8b7d", 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.227 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6824", 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6825", 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6826", 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6827", 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.229 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6830", 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6831", 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.230 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6828", 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6829", 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6825/2133006853", 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6827/2133006853", 2024-09-11T07:06:45.231 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6831/2133006853", 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6829/2133006853", 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "0ab29b1f-3012-4528-8f47-2cac908122c9", 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 0, 2024-09-11T07:06:45.232 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 21, 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6816", 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6817", 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6818", 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6819", 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6822", 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.235 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6823", 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6820", 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.236 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6821", 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6817/2083734892", 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6819/2083734892", 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6823/2083734892", 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6821/2083734892", 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:45.237 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d9c7d12b-be93-41c9-a246-773faa65ecaf", 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:06:45.238 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 43, 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6800", 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6801", 2024-09-11T07:06:45.239 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6802", 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.240 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6803", 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6806", 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6807", 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6804", 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6805", 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6801/2322042784", 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6803/2322042784", 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2322042784", 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2322042784", 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:06:45.243 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.653648+0000", 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.846269+0000", 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:45.245 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.970884+0000", 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.985630+0000", 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:45.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.236412+0000", 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:45.247 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.336953+0000", 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:45.248 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.306806+0000", 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.104744+0000", 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2024-09-11T07:06:45.249 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:45.251 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:45.254 INFO:tasks.thrashosds.thrasher:j is {'epoch': 61, 'fsid': 'e1313abd-54a9-4e53-ab67-469f744048b1', 'created': '2024-09-11T07:05:29.098467+0000', 'modified': '2024-09-11T07:06:45.113377+0000', 'last_up_change': '2024-09-11T07:05:41.051856+0000', 'last_in_change': '2024-09-11T07:05:31.688503+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T07:05:41.897005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T07:05:47.687214+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.630000114440918, 'score_stable': 2.630000114440918, 'optimal_score': 1, 'raw_score_acting': 2.630000114440918, 'raw_score_stable': 2.630000114440918, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T07:05:57.298060+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '61', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 27, 'snap_epoch': 61, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5399999618530273, 'score_stable': 1.5399999618530273, 'optimal_score': 1.1399999856948853, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.875, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 0.8799999952316284}}], 'osds': [{'osd': 0, 'uuid': '24d57cdb-2f3a-4a96-903d-11be7dc26a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 43, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6825', 'nonce': 1708235775}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6826', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 1708235775}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6830', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 1708235775}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6829', 'nonce': 1708235775}]}, 'public_addr': '172.21.15.79:6825/1708235775', 'cluster_addr': '172.21.15.79:6827/1708235775', 'heartbeat_back_addr': '172.21.15.79:6831/1708235775', 'heartbeat_front_addr': '172.21.15.79:6829/1708235775', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa51dc1b-b783-4212-8736-1f666239613b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 2076268206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 2076268206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 2076268206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 2076268206}]}, 'public_addr': '172.21.15.79:6801/2076268206', 'cluster_addr': '172.21.15.79:6803/2076268206', 'heartbeat_back_addr': '172.21.15.79:6807/2076268206', 'heartbeat_front_addr': '172.21.15.79:6805/2076268206', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '141a913f-7353-44a9-9dbd-70219bcee638', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6817', 'nonce': 1904492349}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6818', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1904492349}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6822', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 1904492349}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6821', 'nonce': 1904492349}]}, 'public_addr': '172.21.15.79:6817/1904492349', 'cluster_addr': '172.21.15.79:6819/1904492349', 'heartbeat_back_addr': '172.21.15.79:6823/1904492349', 'heartbeat_front_addr': '172.21.15.79:6821/1904492349', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '32550aeb-0c8d-4ca9-afd5-3e5258e7255b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 1327328912}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 1327328912}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 1327328912}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 1327328912}]}, 'public_addr': '172.21.15.79:6809/1327328912', 'cluster_addr': '172.21.15.79:6811/1327328912', 'heartbeat_back_addr': '172.21.15.79:6815/1327328912', 'heartbeat_front_addr': '172.21.15.79:6813/1327328912', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 43, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 4087452871}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 4087452871}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 4087452871}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 4087452871}]}, 'public_addr': '172.21.15.110:6809/4087452871', 'cluster_addr': '172.21.15.110:6811/4087452871', 'heartbeat_back_addr': '172.21.15.110:6815/4087452871', 'heartbeat_front_addr': '172.21.15.110:6813/4087452871', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '42c83053-328e-4c9b-bdaf-09e1a4cc8b7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 2133006853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 2133006853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 2133006853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 2133006853}]}, 'public_addr': '172.21.15.110:6825/2133006853', 'cluster_addr': '172.21.15.110:6827/2133006853', 'heartbeat_back_addr': '172.21.15.110:6831/2133006853', 'heartbeat_front_addr': '172.21.15.110:6829/2133006853', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0ab29b1f-3012-4528-8f47-2cac908122c9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 21, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 2083734892}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 2083734892}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 2083734892}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 2083734892}]}, 'public_addr': '172.21.15.110:6817/2083734892', 'cluster_addr': '172.21.15.110:6819/2083734892', 'heartbeat_back_addr': '172.21.15.110:6823/2083734892', 'heartbeat_front_addr': '172.21.15.110:6821/2083734892', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'd9c7d12b-be93-41c9-a246-773faa65ecaf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 43, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2322042784}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2322042784}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2322042784}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2322042784}]}, 'public_addr': '172.21.15.110:6801/2322042784', 'cluster_addr': '172.21.15.110:6803/2322042784', 'heartbeat_back_addr': '172.21.15.110:6807/2322042784', 'heartbeat_front_addr': '172.21.15.110:6805/2322042784', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.653648+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.846269+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.970884+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.985630+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.236412+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.336953+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.306806+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.104744+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T07:06:45.254 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:06:45.255 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:45.255 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:45.255 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:45.255 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:45.250+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:45.339 INFO:teuthology.orchestra.run.smithi079.stdout:leaving image image_client.0-clone24 intact 2024-09-11T07:06:45.384 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:45.382+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:45.430 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:45.430 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:45.451 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:45.454 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:45.449+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:45.555 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:45.550+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:45.592 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:06:45.592 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:06:45.609 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-11T07:06:45.122929+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":521499501,"num_objects":829,"num_object_clones":170,"num_object_copies":1658,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":829,"num_whiteouts":256,"num_read":57361,"num_read_kb":227083,"num_write":6606,"num_write_kb":173864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5344,"ondisk_log_size":5344,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":308380,"kb_used_data":25572,"kb_used_omap":12,"kb_used_meta":282611,"kb_avail":754666340,"statfs":{"total":773094113280,"available":772778332160,"internally_reserved":0,"allocated":26185728,"data_stored":280289307,"data_compressed":6426991,"data_compressed_allocated":16879616,"data_compressed_original":275669524,"omap_allocated":12760,"internal_metadata":289394216},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":163989477,"num_objects":97,"num_object_clones":32,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":97,"num_whiteouts":30,"num_read":6665,"num_read_kb":41286,"num_write":823,"num_write_kb":55430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.043493"},"pg_stats":[{"pgid":"3.1f","version":"57'248","reported_seq":1495,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.490179+0000","last_change":"2024-09-11T07:06:00.826807+0000","last_active":"2024-09-11T07:06:41.490179+0000","last_peered":"2024-09-11T07:06:41.490179+0000","last_clean":"2024-09-11T07:06:41.490179+0000","last_became_active":"2024-09-11T07:05:58.836990+0000","last_became_peered":"2024-09-11T07:05:58.836990+0000","last_unstale":"2024-09-11T07:06:41.490179+0000","last_undegraded":"2024-09-11T07:06:41.490179+0000","last_fullsized":"2024-09-11T07:06:41.490179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":248,"log_dups_size":0,"ondisk_log_size":248,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:23:31.660488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097647200000000004,"stat_sum":{"num_bytes":5990315,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":14,"num_read":1977,"num_read_kb":3829,"num_write":361,"num_write_kb":14130,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"56'81","reported_seq":1171,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.159363+0000","last_change":"2024-09-11T07:06:00.970173+0000","last_active":"2024-09-11T07:06:41.159363+0000","last_peered":"2024-09-11T07:06:41.159363+0000","last_clean":"2024-09-11T07:06:41.159363+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:06:41.159363+0000","last_undegraded":"2024-09-11T07:06:41.159363+0000","last_fullsized":"2024-09-11T07:06:41.159363+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:14:01.750176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084787600000000001,"stat_sum":{"num_bytes":22222596,"num_objects":25,"num_object_clones":5,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":7,"num_read":1025,"num_read_kb":9880,"num_write":75,"num_write_kb":6972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"57'112","reported_seq":1548,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.498051+0000","last_change":"2024-09-11T07:06:00.825433+0000","last_active":"2024-09-11T07:06:41.498051+0000","last_peered":"2024-09-11T07:06:41.498051+0000","last_clean":"2024-09-11T07:06:41.498051+0000","last_became_active":"2024-09-11T07:05:58.827234+0000","last_became_peered":"2024-09-11T07:05:58.827234+0000","last_unstale":"2024-09-11T07:06:41.498051+0000","last_undegraded":"2024-09-11T07:06:41.498051+0000","last_fullsized":"2024-09-11T07:06:41.498051+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:12:41.547816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550473,"stat_sum":{"num_bytes":20276212,"num_objects":27,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":10,"num_read":1879,"num_read_kb":10756,"num_write":100,"num_write_kb":3044,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"56'102","reported_seq":1521,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083325+0000","last_change":"2024-09-11T07:06:00.827149+0000","last_active":"2024-09-11T07:06:41.083325+0000","last_peered":"2024-09-11T07:06:41.083325+0000","last_clean":"2024-09-11T07:06:41.083325+0000","last_became_active":"2024-09-11T07:05:58.826843+0000","last_became_peered":"2024-09-11T07:05:58.826843+0000","last_unstale":"2024-09-11T07:06:41.083325+0000","last_undegraded":"2024-09-11T07:06:41.083325+0000","last_fullsized":"2024-09-11T07:06:41.083325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:15:05.930809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022332319999999999,"stat_sum":{"num_bytes":26446574,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":10,"num_read":1428,"num_read_kb":8330,"num_write":100,"num_write_kb":5948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"56'156","reported_seq":601,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.085925+0000","last_change":"2024-09-11T07:06:00.826913+0000","last_active":"2024-09-11T07:06:41.085925+0000","last_peered":"2024-09-11T07:06:41.085925+0000","last_clean":"2024-09-11T07:06:41.085925+0000","last_became_active":"2024-09-11T07:05:58.809515+0000","last_became_peered":"2024-09-11T07:05:58.809515+0000","last_unstale":"2024-09-11T07:06:41.085925+0000","last_undegraded":"2024-09-11T07:06:41.085925+0000","last_fullsized":"2024-09-11T07:06:41.085925+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":156,"log_dups_size":0,"ondisk_log_size":156,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:53:01.502547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001182787,"stat_sum":{"num_bytes":4929789,"num_objects":20,"num_object_clones":4,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":6,"num_read":1280,"num_read_kb":3720,"num_write":214,"num_write_kb":1664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"51'185","reported_seq":1689,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.494133+0000","last_change":"2024-09-11T07:06:00.813235+0000","last_active":"2024-09-11T07:06:41.494133+0000","last_peered":"2024-09-11T07:06:41.494133+0000","last_clean":"2024-09-11T07:06:41.494133+0000","last_became_active":"2024-09-11T07:05:58.808656+0000","last_became_peered":"2024-09-11T07:05:58.808656+0000","last_unstale":"2024-09-11T07:06:41.494133+0000","last_undegraded":"2024-09-11T07:06:41.494133+0000","last_fullsized":"2024-09-11T07:06:41.494133+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":185,"log_dups_size":0,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:11.007182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059322499999999996,"stat_sum":{"num_bytes":6779403,"num_objects":21,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":8,"num_read":2891,"num_read_kb":5093,"num_write":237,"num_write_kb":1356,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"53'70","reported_seq":252,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.079958+0000","last_change":"2024-09-11T07:06:00.820857+0000","last_active":"2024-09-11T07:06:41.079958+0000","last_peered":"2024-09-11T07:06:41.079958+0000","last_clean":"2024-09-11T07:06:41.079958+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:06:41.079958+0000","last_undegraded":"2024-09-11T07:06:41.079958+0000","last_fullsized":"2024-09-11T07:06:41.079958+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:19:43.042214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076385799999999996,"stat_sum":{"num_bytes":5085964,"num_objects":21,"num_object_clones":3,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":110,"num_read_kb":414,"num_write":65,"num_write_kb":1085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"57'80","reported_seq":1546,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.419174+0000","last_change":"2024-09-11T07:06:00.970030+0000","last_active":"2024-09-11T07:06:41.419174+0000","last_peered":"2024-09-11T07:06:41.419174+0000","last_clean":"2024-09-11T07:06:41.419174+0000","last_became_active":"2024-09-11T07:05:58.809573+0000","last_became_peered":"2024-09-11T07:05:58.809573+0000","last_unstale":"2024-09-11T07:06:41.419174+0000","last_undegraded":"2024-09-11T07:06:41.419174+0000","last_fullsized":"2024-09-11T07:06:41.419174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:15:08.607406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001212451,"stat_sum":{"num_bytes":16733805,"num_objects":25,"num_object_clones":5,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":10,"num_read":1429,"num_read_kb":6134,"num_write":83,"num_write_kb":19543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"57'143","reported_seq":1261,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.520837+0000","last_change":"2024-09-11T07:06:00.826609+0000","last_active":"2024-09-11T07:06:41.520837+0000","last_peered":"2024-09-11T07:06:41.520837+0000","last_clean":"2024-09-11T07:06:41.520837+0000","last_became_active":"2024-09-11T07:05:58.836977+0000","last_became_peered":"2024-09-11T07:05:58.836977+0000","last_unstale":"2024-09-11T07:06:41.520837+0000","last_undegraded":"2024-09-11T07:06:41.520837+0000","last_fullsized":"2024-09-11T07:06:41.520837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":143,"log_dups_size":0,"ondisk_log_size":143,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:26:37.309104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093584899999999999,"stat_sum":{"num_bytes":7981571,"num_objects":16,"num_object_clones":3,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":4,"num_read":1839,"num_read_kb":8176,"num_write":156,"num_write_kb":5994,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"51'307","reported_seq":1432,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083389+0000","last_change":"2024-09-11T07:06:00.825499+0000","last_active":"2024-09-11T07:06:41.083389+0000","last_peered":"2024-09-11T07:06:41.083389+0000","last_clean":"2024-09-11T07:06:41.083389+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:06:41.083389+0000","last_undegraded":"2024-09-11T07:06:41.083389+0000","last_fullsized":"2024-09-11T07:06:41.083389+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":307,"log_dups_size":0,"ondisk_log_size":307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:16:13.753420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056977600000000003,"stat_sum":{"num_bytes":21739920,"num_objects":28,"num_object_clones":8,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":7,"num_read":2371,"num_read_kb":5967,"num_write":414,"num_write_kb":1475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"56'68","reported_seq":1057,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080489+0000","last_change":"2024-09-11T07:06:00.837150+0000","last_active":"2024-09-11T07:06:41.080489+0000","last_peered":"2024-09-11T07:06:41.080489+0000","last_clean":"2024-09-11T07:06:41.080489+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:06:41.080489+0000","last_undegraded":"2024-09-11T07:06:41.080489+0000","last_fullsized":"2024-09-11T07:06:41.080489+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:26:30.358917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184086,"stat_sum":{"num_bytes":13228086,"num_objects":25,"num_object_clones":7,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":9,"num_read":954,"num_read_kb":7130,"num_write":61,"num_write_kb":5247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"55'221","reported_seq":1595,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.091214+0000","last_change":"2024-09-11T07:06:00.812896+0000","last_active":"2024-09-11T07:06:41.091214+0000","last_peered":"2024-09-11T07:06:41.091214+0000","last_clean":"2024-09-11T07:06:41.091214+0000","last_became_active":"2024-09-11T07:05:58.814550+0000","last_became_peered":"2024-09-11T07:05:58.814550+0000","last_unstale":"2024-09-11T07:06:41.091214+0000","last_undegraded":"2024-09-11T07:06:41.091214+0000","last_fullsized":"2024-09-11T07:06:41.091214+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:26:26.276481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046265999999999999,"stat_sum":{"num_bytes":11377382,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":12,"num_read":2940,"num_read_kb":7684,"num_write":257,"num_write_kb":3232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080837+0000","last_change":"2024-09-11T07:06:26.962907+0000","last_active":"2024-09-11T07:06:41.080837+0000","last_peered":"2024-09-11T07:06:41.080837+0000","last_clean":"2024-09-11T07:06:41.080837+0000","last_became_active":"2024-09-11T07:06:26.962135+0000","last_became_peered":"2024-09-11T07:06:26.962135+0000","last_unstale":"2024-09-11T07:06:41.080837+0000","last_undegraded":"2024-09-11T07:06:41.080837+0000","last_fullsized":"2024-09-11T07:06:41.080837+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:32.560330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"56'205","reported_seq":1403,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.085969+0000","last_change":"2024-09-11T07:06:00.826127+0000","last_active":"2024-09-11T07:06:41.085969+0000","last_peered":"2024-09-11T07:06:41.085969+0000","last_clean":"2024-09-11T07:06:41.085969+0000","last_became_active":"2024-09-11T07:05:58.811377+0000","last_became_peered":"2024-09-11T07:05:58.811377+0000","last_unstale":"2024-09-11T07:06:41.085969+0000","last_undegraded":"2024-09-11T07:06:41.085969+0000","last_fullsized":"2024-09-11T07:06:41.085969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:47.187334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056190700000000005,"stat_sum":{"num_bytes":31082122,"num_objects":31,"num_object_clones":8,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":1651,"num_read_kb":6957,"num_write":260,"num_write_kb":4290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.081088+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:06:41.081088+0000","last_peered":"2024-09-11T07:06:41.081088+0000","last_clean":"2024-09-11T07:06:41.081088+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:06:41.081088+0000","last_undegraded":"2024-09-11T07:06:41.081088+0000","last_fullsized":"2024-09-11T07:06:41.081088+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"57'191","reported_seq":1208,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.461432+0000","last_change":"2024-09-11T07:06:00.969789+0000","last_active":"2024-09-11T07:06:41.461432+0000","last_peered":"2024-09-11T07:06:41.461432+0000","last_clean":"2024-09-11T07:06:41.461432+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:06:41.461432+0000","last_undegraded":"2024-09-11T07:06:41.461432+0000","last_fullsized":"2024-09-11T07:06:41.461432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:59:45.753214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068823799999999998,"stat_sum":{"num_bytes":14122330,"num_objects":35,"num_object_clones":10,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":14,"num_read":1641,"num_read_kb":7635,"num_write":233,"num_write_kb":3833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080657+0000","last_change":"2024-09-11T07:05:51.786713+0000","last_active":"2024-09-11T07:06:41.080657+0000","last_peered":"2024-09-11T07:06:41.080657+0000","last_clean":"2024-09-11T07:06:41.080657+0000","last_became_active":"2024-09-11T07:05:49.724679+0000","last_became_peered":"2024-09-11T07:05:49.724679+0000","last_unstale":"2024-09-11T07:06:41.080657+0000","last_undegraded":"2024-09-11T07:06:41.080657+0000","last_fullsized":"2024-09-11T07:06:41.080657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:36:43.830759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"53'73","reported_seq":462,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080074+0000","last_change":"2024-09-11T07:06:00.821584+0000","last_active":"2024-09-11T07:06:41.080074+0000","last_peered":"2024-09-11T07:06:41.080074+0000","last_clean":"2024-09-11T07:06:41.080074+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:06:41.080074+0000","last_undegraded":"2024-09-11T07:06:41.080074+0000","last_fullsized":"2024-09-11T07:06:41.080074+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:12.489802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001413975,"stat_sum":{"num_bytes":2743404,"num_objects":18,"num_object_clones":2,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":7,"num_read":552,"num_read_kb":1405,"num_write":67,"num_write_kb":509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080173+0000","last_change":"2024-09-11T07:05:51.151362+0000","last_active":"2024-09-11T07:06:41.080173+0000","last_peered":"2024-09-11T07:06:41.080173+0000","last_clean":"2024-09-11T07:06:41.080173+0000","last_became_active":"2024-09-11T07:05:49.725356+0000","last_became_peered":"2024-09-11T07:05:49.725356+0000","last_unstale":"2024-09-11T07:06:41.080173+0000","last_undegraded":"2024-09-11T07:06:41.080173+0000","last_fullsized":"2024-09-11T07:06:41.080173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:26:53.822013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"56'287","reported_seq":902,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083521+0000","last_change":"2024-09-11T07:06:00.827482+0000","last_active":"2024-09-11T07:06:41.083521+0000","last_peered":"2024-09-11T07:06:41.083521+0000","last_clean":"2024-09-11T07:06:41.083521+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:06:41.083521+0000","last_undegraded":"2024-09-11T07:06:41.083521+0000","last_fullsized":"2024-09-11T07:06:41.083521+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":287,"log_dups_size":0,"ondisk_log_size":287,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:06:35.428567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002494839,"stat_sum":{"num_bytes":21397389,"num_objects":28,"num_object_clones":4,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":6,"num_read":1597,"num_read_kb":3760,"num_write":422,"num_write_kb":1811,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"57'212","reported_seq":1215,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.497702+0000","last_change":"2024-09-11T07:06:00.812921+0000","last_active":"2024-09-11T07:06:41.497702+0000","last_peered":"2024-09-11T07:06:41.497702+0000","last_clean":"2024-09-11T07:06:41.497702+0000","last_became_active":"2024-09-11T07:05:58.808560+0000","last_became_peered":"2024-09-11T07:05:58.808560+0000","last_unstale":"2024-09-11T07:06:41.497702+0000","last_undegraded":"2024-09-11T07:06:41.497702+0000","last_fullsized":"2024-09-11T07:06:41.497702+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:39.877619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040103300000000002,"stat_sum":{"num_bytes":21351582,"num_objects":28,"num_object_clones":6,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":9,"num_read":1461,"num_read_kb":5169,"num_write":285,"num_write_kb":4042,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":95,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083326+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:06:41.083326+0000","last_peered":"2024-09-11T07:06:41.083326+0000","last_clean":"2024-09-11T07:06:41.083326+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:06:41.083326+0000","last_undegraded":"2024-09-11T07:06:41.083326+0000","last_fullsized":"2024-09-11T07:06:41.083326+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"56'275","reported_seq":2607,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.079933+0000","last_change":"2024-09-11T07:06:00.820656+0000","last_active":"2024-09-11T07:06:41.079933+0000","last_peered":"2024-09-11T07:06:41.079933+0000","last_clean":"2024-09-11T07:06:41.079933+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:06:41.079933+0000","last_undegraded":"2024-09-11T07:06:41.079933+0000","last_fullsized":"2024-09-11T07:06:41.079933+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":275,"log_dups_size":0,"ondisk_log_size":275,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:38:06.190645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058463999999999999,"stat_sum":{"num_bytes":72235053,"num_objects":39,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":6,"num_read":3115,"num_read_kb":27296,"num_write":342,"num_write_kb":24548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.081796+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:06:41.081796+0000","last_peered":"2024-09-11T07:06:41.081796+0000","last_clean":"2024-09-11T07:06:41.081796+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:06:41.081796+0000","last_undegraded":"2024-09-11T07:06:41.081796+0000","last_fullsized":"2024-09-11T07:06:41.081796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"57'168","reported_seq":2832,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.511245+0000","last_change":"2024-09-11T07:06:00.826070+0000","last_active":"2024-09-11T07:06:41.511245+0000","last_peered":"2024-09-11T07:06:41.511245+0000","last_clean":"2024-09-11T07:06:41.511245+0000","last_became_active":"2024-09-11T07:05:58.817151+0000","last_became_peered":"2024-09-11T07:05:58.817151+0000","last_unstale":"2024-09-11T07:06:41.511245+0000","last_undegraded":"2024-09-11T07:06:41.511245+0000","last_fullsized":"2024-09-11T07:06:41.511245+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":168,"log_dups_size":0,"ondisk_log_size":168,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:36:15.659224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070404599999999995,"stat_sum":{"num_bytes":30788754,"num_objects":22,"num_object_clones":3,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":3631,"num_read_kb":23088,"num_write":190,"num_write_kb":20265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":93,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080423+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:06:41.080423+0000","last_peered":"2024-09-11T07:06:41.080423+0000","last_clean":"2024-09-11T07:06:41.080423+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:06:41.080423+0000","last_undegraded":"2024-09-11T07:06:41.080423+0000","last_fullsized":"2024-09-11T07:06:41.080423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"53'155","reported_seq":323,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.159179+0000","last_change":"2024-09-11T07:06:00.970754+0000","last_active":"2024-09-11T07:06:41.159179+0000","last_peered":"2024-09-11T07:06:41.159179+0000","last_clean":"2024-09-11T07:06:41.159179+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:06:41.159179+0000","last_undegraded":"2024-09-11T07:06:41.159179+0000","last_fullsized":"2024-09-11T07:06:41.159179+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:15:16.420049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013822890000000001,"stat_sum":{"num_bytes":1915234,"num_objects":14,"num_object_clones":1,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":4,"num_read":599,"num_read_kb":1291,"num_write":220,"num_write_kb":635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":94,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083310+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:06:41.083310+0000","last_peered":"2024-09-11T07:06:41.083310+0000","last_clean":"2024-09-11T07:06:41.083310+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:06:41.083310+0000","last_undegraded":"2024-09-11T07:06:41.083310+0000","last_fullsized":"2024-09-11T07:06:41.083310+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":244,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080554+0000","last_change":"2024-09-11T07:05:43.785344+0000","last_active":"2024-09-11T07:06:41.080554+0000","last_peered":"2024-09-11T07:06:41.080554+0000","last_clean":"2024-09-11T07:06:41.080554+0000","last_became_active":"2024-09-11T07:05:43.783090+0000","last_became_peered":"2024-09-11T07:05:43.783090+0000","last_unstale":"2024-09-11T07:06:41.080554+0000","last_undegraded":"2024-09-11T07:06:41.080554+0000","last_fullsized":"2024-09-11T07:06:41.080554+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:24:32.027951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"57'107","reported_seq":987,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.499149+0000","last_change":"2024-09-11T07:06:00.970646+0000","last_active":"2024-09-11T07:06:41.499149+0000","last_peered":"2024-09-11T07:06:41.499149+0000","last_clean":"2024-09-11T07:06:41.499149+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:06:41.499149+0000","last_undegraded":"2024-09-11T07:06:41.499149+0000","last_fullsized":"2024-09-11T07:06:41.499149+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:06:42.472025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012611810000000001,"stat_sum":{"num_bytes":15890304,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":9,"num_read":847,"num_read_kb":6540,"num_write":118,"num_write_kb":4491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"54'76","reported_seq":398,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.091196+0000","last_change":"2024-09-11T07:06:00.813164+0000","last_active":"2024-09-11T07:06:41.091196+0000","last_peered":"2024-09-11T07:06:41.091196+0000","last_clean":"2024-09-11T07:06:41.091196+0000","last_became_active":"2024-09-11T07:05:59.016079+0000","last_became_peered":"2024-09-11T07:05:59.016079+0000","last_unstale":"2024-09-11T07:06:41.091196+0000","last_undegraded":"2024-09-11T07:06:41.091196+0000","last_fullsized":"2024-09-11T07:06:41.091196+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:25:57.905386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062012700000000005,"stat_sum":{"num_bytes":6735888,"num_objects":21,"num_object_clones":2,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":457,"num_read_kb":3594,"num_write":71,"num_write_kb":1259,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"56'266","reported_seq":849,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.091110+0000","last_change":"2024-09-11T07:06:26.964107+0000","last_active":"2024-09-11T07:06:41.091110+0000","last_peered":"2024-09-11T07:06:41.091110+0000","last_clean":"2024-09-11T07:06:41.091110+0000","last_became_active":"2024-09-11T07:06:26.960126+0000","last_became_peered":"2024-09-11T07:06:26.960126+0000","last_unstale":"2024-09-11T07:06:41.091110+0000","last_undegraded":"2024-09-11T07:06:41.091110+0000","last_fullsized":"2024-09-11T07:06:41.091110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":266,"log_dups_size":0,"ondisk_log_size":266,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:51:54.975336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046764000000000002,"stat_sum":{"num_bytes":14425618,"num_objects":24,"num_object_clones":2,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":8,"num_read":1566,"num_read_kb":4642,"num_write":368,"num_write_kb":1706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"57'197","reported_seq":981,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.416337+0000","last_change":"2024-09-11T07:06:00.971293+0000","last_active":"2024-09-11T07:06:41.416337+0000","last_peered":"2024-09-11T07:06:41.416337+0000","last_clean":"2024-09-11T07:06:41.416337+0000","last_became_active":"2024-09-11T07:05:58.809044+0000","last_became_peered":"2024-09-11T07:05:58.809044+0000","last_unstale":"2024-09-11T07:06:41.416337+0000","last_undegraded":"2024-09-11T07:06:41.416337+0000","last_fullsized":"2024-09-11T07:06:41.416337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":197,"log_dups_size":0,"ondisk_log_size":197,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:30.707703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021149200000000002,"stat_sum":{"num_bytes":6761336,"num_objects":21,"num_object_clones":4,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":6,"num_read":2042,"num_read_kb":4069,"num_write":267,"num_write_kb":1376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"54'85","reported_seq":1908,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.083370+0000","last_change":"2024-09-11T07:06:00.827407+0000","last_active":"2024-09-11T07:06:41.083370+0000","last_peered":"2024-09-11T07:06:41.083370+0000","last_clean":"2024-09-11T07:06:41.083370+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:06:41.083370+0000","last_undegraded":"2024-09-11T07:06:41.083370+0000","last_fullsized":"2024-09-11T07:06:41.083370+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:50:06.653695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024738579999999998,"stat_sum":{"num_bytes":10718941,"num_objects":22,"num_object_clones":6,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":7,"num_read":1767,"num_read_kb":3101,"num_write":78,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"57'151","reported_seq":1765,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.511561+0000","last_change":"2024-09-11T07:06:00.838531+0000","last_active":"2024-09-11T07:06:41.511561+0000","last_peered":"2024-09-11T07:06:41.511561+0000","last_clean":"2024-09-11T07:06:41.511561+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:06:41.511561+0000","last_undegraded":"2024-09-11T07:06:41.511561+0000","last_fullsized":"2024-09-11T07:06:41.511561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":151,"log_dups_size":0,"ondisk_log_size":151,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:43:14.897827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022638789999999999,"stat_sum":{"num_bytes":26590081,"num_objects":31,"num_object_clones":6,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":6,"num_read":2173,"num_read_kb":12357,"num_write":176,"num_write_kb":5593,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"57'180","reported_seq":1222,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.510898+0000","last_change":"2024-09-11T07:06:00.837799+0000","last_active":"2024-09-11T07:06:41.510898+0000","last_peered":"2024-09-11T07:06:41.510898+0000","last_clean":"2024-09-11T07:06:41.510898+0000","last_became_active":"2024-09-11T07:05:58.825160+0000","last_became_peered":"2024-09-11T07:05:58.825160+0000","last_unstale":"2024-09-11T07:06:41.510898+0000","last_undegraded":"2024-09-11T07:06:41.510898+0000","last_fullsized":"2024-09-11T07:06:41.510898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":180,"log_dups_size":0,"ondisk_log_size":180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:36:39.672582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017910619999999999,"stat_sum":{"num_bytes":12523294,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":6,"num_read":2717,"num_read_kb":10287,"num_write":199,"num_write_kb":7263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"53'404","reported_seq":3575,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080733+0000","last_change":"2024-09-11T07:06:00.838063+0000","last_active":"2024-09-11T07:06:41.080733+0000","last_peered":"2024-09-11T07:06:41.080733+0000","last_clean":"2024-09-11T07:06:41.080733+0000","last_became_active":"2024-09-11T07:05:58.822422+0000","last_became_peered":"2024-09-11T07:05:58.822422+0000","last_unstale":"2024-09-11T07:06:41.080733+0000","last_undegraded":"2024-09-11T07:06:41.080733+0000","last_fullsized":"2024-09-11T07:06:41.080733+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:21:25.391346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020506280000000001,"stat_sum":{"num_bytes":11183931,"num_objects":27,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":9,"num_read":5508,"num_read_kb":6370,"num_write":563,"num_write_kb":1252,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"57'124","reported_seq":690,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.511958+0000","last_change":"2024-09-11T07:06:26.962057+0000","last_active":"2024-09-11T07:06:41.511958+0000","last_peered":"2024-09-11T07:06:41.511958+0000","last_clean":"2024-09-11T07:06:41.511958+0000","last_became_active":"2024-09-11T07:06:26.961501+0000","last_became_peered":"2024-09-11T07:06:26.961501+0000","last_unstale":"2024-09-11T07:06:41.511958+0000","last_undegraded":"2024-09-11T07:06:41.511958+0000","last_fullsized":"2024-09-11T07:06:41.511958+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":124,"log_dups_size":0,"ondisk_log_size":124,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:12:21.128218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049279100000000002,"stat_sum":{"num_bytes":13014185,"num_objects":29,"num_object_clones":4,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":11,"num_read":814,"num_read_kb":2396,"num_write":149,"num_write_kb":7953,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"56'68","reported_seq":2155,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080423+0000","last_change":"2024-09-11T07:06:00.836320+0000","last_active":"2024-09-11T07:06:41.080423+0000","last_peered":"2024-09-11T07:06:41.080423+0000","last_clean":"2024-09-11T07:06:41.080423+0000","last_became_active":"2024-09-11T07:05:58.822373+0000","last_became_peered":"2024-09-11T07:05:58.822373+0000","last_unstale":"2024-09-11T07:06:41.080423+0000","last_undegraded":"2024-09-11T07:06:41.080423+0000","last_fullsized":"2024-09-11T07:06:41.080423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:53:22.018837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089665299999999997,"stat_sum":{"num_bytes":13279470,"num_objects":26,"num_object_clones":6,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":8,"num_read":2013,"num_read_kb":2558,"num_write":66,"num_write_kb":1838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"57'90","reported_seq":1868,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.140262+0000","last_change":"2024-09-11T07:06:00.826460+0000","last_active":"2024-09-11T07:06:41.140262+0000","last_peered":"2024-09-11T07:06:41.140262+0000","last_clean":"2024-09-11T07:06:41.140262+0000","last_became_active":"2024-09-11T07:05:58.833983+0000","last_became_peered":"2024-09-11T07:05:58.833983+0000","last_unstale":"2024-09-11T07:06:41.140262+0000","last_undegraded":"2024-09-11T07:06:41.140262+0000","last_fullsized":"2024-09-11T07:06:41.140262+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:30.368424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086507200000000004,"stat_sum":{"num_bytes":24485006,"num_objects":31,"num_object_clones":8,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":10,"num_read":1725,"num_read_kb":15298,"num_write":93,"num_write_kb":6919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"53'137","reported_seq":1037,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-11T07:06:41.080463+0000","last_change":"2024-09-11T07:06:00.836900+0000","last_active":"2024-09-11T07:06:41.080463+0000","last_peered":"2024-09-11T07:06:41.080463+0000","last_clean":"2024-09-11T07:06:41.080463+0000","last_became_active":"2024-09-11T07:05:58.823540+0000","last_became_peered":"2024-09-11T07:05:58.823540+0000","last_unstale":"2024-09-11T07:06:41.080463+0000","last_undegraded":"2024-09-11T07:06:41.080463+0000","last_fullsized":"2024-09-11T07:06:41.080463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:17:15.886247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012764899999999999,"stat_sum":{"num_bytes":6873575,"num_objects":23,"num_object_clones":3,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":1246,"num_read_kb":2057,"num_write":155,"num_write_kb":1273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":520909114,"num_objects":825,"num_object_clones":170,"num_object_copies":1650,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":825,"num_whiteouts":256,"num_read":57245,"num_read_kb":226983,"num_write":6445,"num_write_kb":171446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":25,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":21438464,"data_stored":282030860,"data_compressed":6686390,"data_compressed_allocated":17375232,"data_compressed_original":279742932,"omap_allocated":0,"internal_metadata":0},"log_size":5224,"ondisk_log_size":5224,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":11638,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42956,"kb_used_data":3432,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328884,"statfs":{"total":96636764160,"available":96592777216,"internally_reserved":0,"allocated":3514368,"data_stored":28917197,"data_compressed":830324,"data_compressed_allocated":2154496,"data_compressed_original":28206795,"omap_allocated":1591,"internal_metadata":40434121},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32752,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339088,"statfs":{"total":96636764160,"available":96603226112,"internally_reserved":0,"allocated":1601536,"data_stored":12362596,"data_compressed":228271,"data_compressed_allocated":749568,"data_compressed_original":11948470,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42292,"kb_used_data":2788,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329548,"statfs":{"total":96636764160,"available":96593457152,"internally_reserved":0,"allocated":2854912,"data_stored":21100569,"data_compressed":695338,"data_compressed_allocated":1658880,"data_compressed_original":20522989,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44104,"kb_used_data":4592,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327736,"statfs":{"total":96636764160,"available":96591601664,"internally_reserved":0,"allocated":4702208,"data_stored":51631384,"data_compressed":1346067,"data_compressed_allocated":3248128,"data_compressed_original":50855227,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38368,"kb_used_data":3012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333472,"statfs":{"total":96636764160,"available":96597475328,"internally_reserved":0,"allocated":3084288,"data_stored":29495527,"data_compressed":634877,"data_compressed_allocated":1806336,"data_compressed_original":28897792,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33756,"kb_used_data":2568,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338084,"statfs":{"total":96636764160,"available":96602198016,"internally_reserved":0,"allocated":2629632,"data_stored":37878392,"data_compressed":610308,"data_compressed_allocated":1765376,"data_compressed_original":37462498,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34548,"kb_used_data":3360,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337292,"statfs":{"total":96636764160,"available":96601387008,"internally_reserved":0,"allocated":3440640,"data_stored":42976137,"data_compressed":938517,"data_compressed_allocated":2347008,"data_compressed_original":42447330,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39604,"kb_used_data":4256,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94332236,"statfs":{"total":96636764160,"available":96596209664,"internally_reserved":0,"allocated":4358144,"data_stored":55927505,"data_compressed":1143289,"data_compressed_allocated":3149824,"data_compressed_original":55328423,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":3870720,"data_stored":58130873,"data_compressed":1166005,"data_compressed_allocated":3325952,"data_compressed_original":57834119,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":2777088,"data_stored":42683849,"data_compressed":938517,"data_compressed_allocated":2347008,"data_compressed_original":42447330,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1970176,"data_stored":37586123,"data_compressed":610308,"data_compressed_allocated":1765376,"data_compressed_original":37462498,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2580480,"data_stored":30042181,"data_compressed":735745,"data_compressed_allocated":1945600,"data_compressed_original":29729280,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4087808,"data_stored":51392616,"data_compressed":1376760,"data_compressed_allocated":3284992,"data_compressed_original":50904379,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2191360,"data_stored":20808281,"data_compressed":695338,"data_compressed_allocated":1658880,"data_compressed_original":20522989,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":946176,"data_stored":12070327,"data_compressed":228271,"data_compressed_allocated":749568,"data_compressed_original":11947414,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":3014656,"data_stored":29316610,"data_compressed":935446,"data_compressed_allocated":2297856,"data_compressed_original":28894923,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:06:45.611 INFO:tasks.thrashosds.thrasher:Setting 3.17 to [3, 1, 5, 2] 2024-09-11T07:06:45.611 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.17', '3', '1', '5', '2'] 2024-09-11T07:06:45.612 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.17 3 1 5 2 2024-09-11T07:06:45.614 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:45.614 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:45.630 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:45.676 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:45.674+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:45.757 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:45.753+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:45.785 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #23, image image_client.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent24 2024-09-11T07:06:45.790 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:45.790 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:45.793 INFO:teuthology.orchestra.run.smithi079.stdout:2267 write 0x3ab35cb thru 0x3ac34b4 (0xfeea bytes) 2024-09-11T07:06:45.806 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:45.858 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:45.854+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:45.919 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:45.919 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:45.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:45.948 INFO:teuthology.orchestra.run.smithi079.stdout:2269 punch from 0x71954b3 to 0x71a3e15, (0xe962 bytes) 2024-09-11T07:06:45.949 INFO:teuthology.orchestra.run.smithi079.stdout:2270 write 0x67ecd41 thru 0x67ee9d7 (0x1c97 bytes) 2024-09-11T07:06:45.959 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:45.953+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:46.000 INFO:teuthology.orchestra.run.smithi079.stdout:2271 trunc from 0xedb28f3 to 0x44ee7b9 2024-09-11T07:06:46.061 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:46.057+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:46.096 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:46.096 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:46.116 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:46.134 INFO:teuthology.orchestra.run.smithi079.stderr:set 3.17 pg_upmap_items mapping to [3->1,5->2] 2024-09-11T07:06:46.151 INFO:teuthology.orchestra.run.smithi079.stdout:2272 trunc from 0x44ee7b9 to 0x65bf0e4 2024-09-11T07:06:46.161 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:46.157+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:46.161 INFO:teuthology.orchestra.run.smithi079.stdout:2273 trunc from 0x65bf0e4 to 0x9a49f5c 2024-09-11T07:06:46.168 INFO:teuthology.orchestra.run.smithi079.stdout:2275 read 0x73c3645 thru 0x73c4322 (0xcde bytes) 2024-09-11T07:06:46.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:46.178 INFO:teuthology.orchestra.run.smithi079.stdout:2276 trunc from 0x9a49f5c to 0x1c09afa 2024-09-11T07:06:46.260 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:46.261 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:46.262 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:46.257+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:46.276 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:46.323 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:46.323 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:46.339 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:46.340 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:46.356 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:46.357 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:46.363 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:46.357+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:46.374 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:46.374 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:46.381 INFO:teuthology.orchestra.run.smithi079.stdout:2277 write 0xd12e360 thru 0xd13643f (0x80e0 bytes) 2024-09-11T07:06:46.390 INFO:teuthology.orchestra.run.smithi079.stdout:2279 write 0x922896e thru 0x922bdc8 (0x345b bytes) 2024-09-11T07:06:46.396 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:46.396 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:46.407 INFO:teuthology.orchestra.run.smithi079.stdout:2280 writesame 0xe0509ee thru 0xe056c10 data_size 0x25(0x6223 bytes) 2024-09-11T07:06:46.407 INFO:teuthology.orchestra.run.smithi079.stdout:2281 write 0xb58028b thru 0xb589f91 (0x9d07 bytes) 2024-09-11T07:06:46.415 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:46.415 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:46.416 INFO:teuthology.orchestra.run.smithi079.stdout:2282 write 0x85131a2 thru 0x851f943 (0xc7a2 bytes) 2024-09-11T07:06:46.420 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:46.420 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:46.420 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:46.425 INFO:teuthology.orchestra.run.smithi079.stdout:2283 write 0x5bde3e3 thru 0x5be7170 (0x8d8e bytes) 2024-09-11T07:06:46.434 INFO:teuthology.orchestra.run.smithi079.stdout:2284 punch from 0x7a4ddb to 0x7aea03, (0x9c28 bytes) 2024-09-11T07:06:46.434 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:46.434 INFO:teuthology.orchestra.run.smithi079.stdout:2286 punch from 0x6df1d2 to 0x6ea5af, (0xb3dd bytes) 2024-09-11T07:06:46.434 INFO:teuthology.orchestra.run.smithi079.stdout:2287 read 0x2d0757c thru 0x2d0845a (0xedf bytes) 2024-09-11T07:06:46.434 INFO:teuthology.orchestra.run.smithi079.stdout:2288 write 0x7193f80 thru 0x719ce19 (0x8e9a bytes) 2024-09-11T07:06:46.435 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:46.435 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:46.441 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:46.456 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:46.456 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:46.485 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:46.481+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:46.564 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:46.561+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:46.607 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:46.607 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:46.607 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:46.621 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:46.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:46.662+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:46.766 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:46.761+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:46.793 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:46.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.504487813000001, 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:46.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.504415730000002, 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:46.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:06:46.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.802 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.504360237, 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:06:46.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:06:46.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.302488269000001, 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.807 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:46.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.811 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.302425678999999, 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:06:46.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.302368623, 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.816 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:06:46.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.302312506, 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:06:46.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:06:46.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:46.825 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.302191243999999, 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:46.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.829 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.302086975000002, 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.830 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:06:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:06:46.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.301981435999998, 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:06:46.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.301914273000001, 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.839 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:06:46.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:06:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:06:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:06:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:06:46.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:06:46.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.301815067, 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.301728107999999, 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.848 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:06:46.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.852 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.301667831, 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:46.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:06:46.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:06:46.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.856 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.301514126000001, 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:06:46.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:06:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:06:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:06:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.30142695, 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:06:46.861 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:46.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:06:46.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:06:46.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.301363046999999, 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.866 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:06:46.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.301303204, 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:46.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.301225122000002, 2024-09-11T07:06:46.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:06:46.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.879 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.301167352, 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:06:46.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:46.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:06:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:06:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:46.884 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:46.884 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:46.886 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:46.886 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:46.882+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:46.986 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:46.986+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:47.057 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:47.057 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:47.057 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:47.070 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:47.116 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:47.113+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:47.153 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:06:47.196 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:47.196 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:47.197 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:47.197 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:47.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:47.198+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:47.210 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:47.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:47.286+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:47.372 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.060567234000001, 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.373 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:06:47.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.06049968, 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:06:47.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.060418843000001, 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:06:47.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:47.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:06:47.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.060375496999999, 2024-09-11T07:06:47.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:06:47.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.391 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.060305371999998, 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:47.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:06:47.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.060237248, 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.397 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:06:47.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.060196781999998, 2024-09-11T07:06:47.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:47.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:06:47.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:06:47.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.405 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.060158740999999, 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:06:47.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:06:47.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.060119771, 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:47.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:06:47.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:06:47.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.060078897, 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:06:47.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:06:47.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.059751124000002, 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:06:47.419 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:06:47.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:06:47.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.059684613999998, 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.424 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:06:47.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:06:47.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.059616895000001, 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.428 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:47.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:06:47.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:47.432 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.059571956999999, 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:47.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.436 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.058772332, 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.437 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:06:47.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.058737990000001, 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.441 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:06:47.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:47.445 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.058375314999999, 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:47.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:06:47.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.449 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.057112289999999, 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:06:47.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.057079791, 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.454 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:47.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:47.458 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 19.120474364, 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:47.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:47.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:06:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:06:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:06:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:06:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:06:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:06:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:06:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:06:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:47.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:06:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:06:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:47.467 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:47.467 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:47.469 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:47.469 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:47.465+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:47.570 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:47.565+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:47.638 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:47.638 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:47.638 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:47.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:47.696 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:47.693+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:47.771 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:47.765+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:47.818 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:47.818 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:47.818 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:47.819 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:47.819 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:47.832 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:47.872 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:47.870+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:47.973 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:47.969+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:48.004 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:48.004 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:48.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:48.004 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.679852189000002, 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:06:48.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:06:48.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:06:48.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9997 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 180224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.377237217999998, 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010421191999999999, 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9997 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.011 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624848+0000", 2024-09-11T07:06:48.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624854+0000", 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2330000000000003e-06 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624873+0000", 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8770000000000002e-05 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624887+0000", 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.437e-05 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.634868+0000", 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0099809489999999994 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635065+0000", 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196622 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635268+0000", 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020319500000000001 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10000 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.377176759000001, 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010963796, 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.015 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10000 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624909+0000", 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.68e-06 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624915+0000", 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.003e-06 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624939+0000", 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4386999999999999e-05 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624953+0000", 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.419e-05 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635384+0000", 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010430356 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635653+0000", 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026916499999999998 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635871+0000", 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021801500000000001 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.019 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10002 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.377110743000003, 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011381399, 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10002 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624974+0000", 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2640000000000001e-06 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624994+0000", 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9826e-05 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625015+0000", 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0724e-05 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625031+0000", 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6089000000000001e-05 2024-09-11T07:06:48.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635948+0000", 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010917349 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636143+0000", 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019470199999999999 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636355+0000", 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021144499999999999 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10004 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376985824000002, 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011952765000000001, 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.025 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.025 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10004 2024-09-11T07:06:48.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.025 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625099+0000", 2024-09-11T07:06:48.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-11T07:06:48.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625118+0000", 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625135+0000", 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7669999999999999e-05 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625150+0000", 2024-09-11T07:06:48.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4504e-05 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636471+0000", 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011321278000000001 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636726+0000", 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025507200000000001 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637051+0000", 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032463099999999998 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376913094000003, 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.030 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:06:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:06:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:06:48.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376849978000003, 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.038 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:06:48.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:06:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:06:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:06:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:06:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:06:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:06:48.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376774984999997, 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.044 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:06:48.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376710428999999, 2024-09-11T07:06:48.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:06:48.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376655200000002, 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:06:48.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:06:48.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376601303000001, 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376540804000001, 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:06:48.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376484791000003, 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.066 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:06:48.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:06:48.070 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376405437999999, 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.071 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:06:48.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376349134999998, 2024-09-11T07:06:48.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:06:48.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376276695999998, 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:06:48.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376220576000001, 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.084 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:06:48.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376147109999998, 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:06:48.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:06:48.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:06:48.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.376068717000003, 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.093 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:06:48.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.4668927029999992, 2024-09-11T07:06:48.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:06:48.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:06:48.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.101 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.102 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.102 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:48.103 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:48.104 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:48.102+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:48.158 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:06:48.170 INFO:teuthology.orchestra.run.smithi079.stdout:truncating to largest ever: 0xee6078e 2024-09-11T07:06:48.172 INFO:teuthology.orchestra.run.smithi079.stdout:2289 trunc from 0xe056c11 to 0xee6078e 2024-09-11T07:06:48.183 INFO:teuthology.orchestra.run.smithi079.stdout:2290 write 0x47f4613 thru 0x47f5055 (0xa43 bytes) 2024-09-11T07:06:48.187 INFO:teuthology.orchestra.run.smithi079.stdout:2292 punch from 0x925cbeb to 0x926cb90, (0xffa5 bytes) 2024-09-11T07:06:48.187 INFO:teuthology.orchestra.run.smithi079.stdout:2293 read 0x28357d5 thru 0x283be49 (0x6675 bytes) 2024-09-11T07:06:48.187 INFO:teuthology.orchestra.run.smithi079.stdout:2296 write 0x50d0153 thru 0x50d5011 (0x4ebf bytes) 2024-09-11T07:06:48.193 INFO:teuthology.orchestra.run.smithi079.stdout:2297 read 0xc940096 thru 0xc942d89 (0x2cf4 bytes) 2024-09-11T07:06:48.193 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:48.193 INFO:teuthology.orchestra.run.smithi079.stdout:2300 punch from 0x5da4a41 to 0x5dabe6a, (0x7429 bytes) 2024-09-11T07:06:48.193 INFO:teuthology.orchestra.run.smithi079.stdout:2302 write 0x8d1bdd3 thru 0x8d29a17 (0xdc45 bytes) 2024-09-11T07:06:48.202 INFO:teuthology.orchestra.run.smithi079.stdout:2303 writesame 0xaae6163 thru 0xaaf60d4 data_size 0x1b(0xff72 bytes) 2024-09-11T07:06:48.204 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:48.202+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:48.212 INFO:teuthology.orchestra.run.smithi079.stdout:2304 write 0x7dccacb thru 0x7dcf131 (0x2667 bytes) 2024-09-11T07:06:48.218 INFO:teuthology.orchestra.run.smithi079.stdout:2305 read 0x6dd96cc thru 0x6de89de (0xf313 bytes) 2024-09-11T07:06:48.219 INFO:teuthology.orchestra.run.smithi079.stdout:2306 read 0xea6a44a thru 0xea77454 (0xd00b bytes) 2024-09-11T07:06:48.219 INFO:teuthology.orchestra.run.smithi079.stdout:2309 writesame 0xcbce4f1 thru 0xcbd71cc data_size 0x14(0x8cdc bytes) 2024-09-11T07:06:48.228 INFO:teuthology.orchestra.run.smithi079.stdout:2310 read 0xe671a7d thru 0xe678d04 (0x7288 bytes) 2024-09-11T07:06:48.228 INFO:teuthology.orchestra.run.smithi079.stdout:2311 read 0xc58d327 thru 0xc59a07c (0xcd56 bytes) 2024-09-11T07:06:48.229 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:48.229 INFO:teuthology.orchestra.run.smithi079.stdout:2313 write 0x682fa49 thru 0x683e288 (0xe840 bytes) 2024-09-11T07:06:48.238 INFO:teuthology.orchestra.run.smithi079.stdout:2314 read 0xbd279f6 thru 0xbd2d222 (0x582d bytes) 2024-09-11T07:06:48.251 INFO:teuthology.orchestra.run.smithi079.stdout:2315 trunc from 0xee6078e to 0x796f5e2 2024-09-11T07:06:48.276 INFO:teuthology.orchestra.run.smithi079.stdout:2316 write 0xbde56c thru 0xbec9b2 (0xe447 bytes) 2024-09-11T07:06:48.286 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:48.286 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:48.286 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:48.301 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:48.348 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:48.345+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:48.381 INFO:teuthology.orchestra.run.smithi079.stdout:2317 punch from 0x4e980cd to 0x4ea197d, (0x98b0 bytes) 2024-09-11T07:06:48.381 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:48.382 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:48.387 INFO:teuthology.orchestra.run.smithi079.stdout:2320 writesame 0x7d3cf23 thru 0x7d41d68 data_size 0x2b(0x4e46 bytes) 2024-09-11T07:06:48.391 INFO:teuthology.orchestra.run.smithi079.stdout:2321 trunc from 0x7d41d69 to 0x67fbf41 2024-09-11T07:06:48.407 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:48.402+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:48.408 INFO:teuthology.orchestra.run.smithi079.stdout:2322 trunc from 0x67fbf41 to 0x5d0cfb1 2024-09-11T07:06:48.439 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:48.440 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:48.440 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:48.440 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:48.440 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:48.441 INFO:teuthology.orchestra.run.smithi079.stdout:2323 write 0xdcc434c thru 0xdcca2a9 (0x5f5e bytes) 2024-09-11T07:06:48.449 INFO:teuthology.orchestra.run.smithi079.stdout:2324 trunc from 0xdcca2aa to 0xd2fd591 2024-09-11T07:06:48.456 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:48.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:48.483 INFO:teuthology.orchestra.run.smithi079.stdout:2326 trunc from 0xd2fd591 to 0x47e40da 2024-09-11T07:06:48.498 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:48.498 INFO:teuthology.orchestra.run.smithi079.stdout:2328 read 0x2e7e290 thru 0x2e85286 (0x6ff7 bytes) 2024-09-11T07:06:48.503 INFO:teuthology.orchestra.run.smithi079.stdout:2330 trunc from 0x47e40da to 0x70dfee6 2024-09-11T07:06:48.507 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:48.502+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:48.510 INFO:teuthology.orchestra.run.smithi079.stdout:2332 write 0x868075 thru 0x8693e6 (0x1372 bytes) 2024-09-11T07:06:48.512 INFO:teuthology.orchestra.run.smithi079.stdout:2333 read 0x603cc75 thru 0x6041452 (0x47de bytes) 2024-09-11T07:06:48.532 INFO:teuthology.orchestra.run.smithi079.stdout:2336 write 0xee2defd thru 0xee3cd0d (0xee11 bytes) 2024-09-11T07:06:48.541 INFO:teuthology.orchestra.run.smithi079.stdout:2338 writesame 0x11010f0 thru 0x110795f data_size 0x18(0x6870 bytes) 2024-09-11T07:06:48.596 INFO:teuthology.orchestra.run.smithi079.stdout:2339 write 0xd1d30e9 thru 0xd1e11c6 (0xe0de bytes) 2024-09-11T07:06:48.605 INFO:teuthology.orchestra.run.smithi079.stdout:2340 read 0x91a1a7d thru 0x91a5b56 (0x40da bytes) 2024-09-11T07:06:48.605 INFO:teuthology.orchestra.run.smithi079.stdout:2341 write 0x8b3fdeb thru 0x8b40cc2 (0xed8 bytes) 2024-09-11T07:06:48.609 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:48.605+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:48.610 INFO:teuthology.orchestra.run.smithi079.stdout:2343 writesame 0x16569c0 thru 0x1665ab8 data_size 0x1(0xf0f9 bytes) 2024-09-11T07:06:48.648 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:48.648 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:48.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:48.648 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:48.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.648 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:48.648 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:48.648 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.578595003000004, 2024-09-11T07:06:48.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:06:48.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:06:48.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:48.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7525 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4898816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.947621390999998, 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058576490000000002, 2024-09-11T07:06:48.655 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.656 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.656 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.656 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.656 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.656 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.656 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7525 2024-09-11T07:06:48.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.656 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:48.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:48.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701087+0000", 2024-09-11T07:06:48.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018042780000000001 2024-09-11T07:06:48.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701093+0000", 2024-09-11T07:06:48.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7880000000000003e-06 2024-09-11T07:06:48.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701108+0000", 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4409999999999999e-05 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701116+0000", 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2120000000000003e-06 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757734+0000", 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056618467999999998 2024-09-11T07:06:48.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757798+0000", 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3978000000000003e-05 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757860+0000", 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1356e-05 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.152424507999999, 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.152368290999998, 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:06:48.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.670 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26245 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 88064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.149369661000001, 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058494675000000003, 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26245 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497536+0000", 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.035e-06 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497541+0000", 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9740000000000001e-06 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497557+0000", 2024-09-11T07:06:48.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5794000000000002e-05 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497568+0000", 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0879999999999999e-05 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555887+0000", 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058319353999999997 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555952+0000", 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4875999999999993e-05 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556030+0000", 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7762000000000005e-05 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:06:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.149321130000001, 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:06:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.149268030000002, 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:06:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:06:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:06:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:06:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.149169125, 2024-09-11T07:06:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:06:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:06:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:06:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.149101257000002, 2024-09-11T07:06:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:06:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:06:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:06:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.149044722999999, 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:06:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.148992263, 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:06:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.148940634999999, 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.148889213, 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:06:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.148838119000001, 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:06:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:06:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:06:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.148786159, 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.148686646000002, 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:06:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.148627841, 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.148576686999998, 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.148520381000001, 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:06:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:06:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.141720866, 2024-09-11T07:06:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:06:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:06:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:48.747 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:48.748 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:48.748 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:48.749 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:48.749 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:48.749 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:48.750 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:48.750 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:48.751 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:48.751 INFO:teuthology.orchestra.run.smithi079.stdout:2345 write 0xe8e3a59 thru 0xe8f16cb (0xdc73 bytes) 2024-09-11T07:06:48.751 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:48.751 INFO:teuthology.orchestra.run.smithi079.stdout:2347 writesame 0x36e4031 thru 0x36ed954 data_size 0x9(0x9924 bytes) 2024-09-11T07:06:48.752 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:48.752 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:48.752 INFO:teuthology.orchestra.run.smithi079.stdout:2349 punch from 0x868bc81 to 0x8690d81, (0x5100 bytes) 2024-09-11T07:06:48.752 INFO:teuthology.orchestra.run.smithi079.stdout:2350 write 0x9a7a326 thru 0x9a826da (0x83b5 bytes) 2024-09-11T07:06:48.752 INFO:teuthology.orchestra.run.smithi079.stdout:2352 writesame 0x9bff576 thru 0x9c0d744 data_size 0x9(0xe1cf bytes) 2024-09-11T07:06:48.753 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:48.746+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:48.753 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:48.753 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:48.754 INFO:teuthology.orchestra.run.smithi079.stdout:2353 trunc from 0xee3cd0e to 0xd5172ed 2024-09-11T07:06:48.766 INFO:teuthology.orchestra.run.smithi079.stdout:2357 writesame 0xab2b769 thru 0xab2ec86 data_size 0x1(0x351e bytes) 2024-09-11T07:06:48.769 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:48.777 INFO:teuthology.orchestra.run.smithi079.stdout:2359 punch from 0x96933fa to 0x96a28b7, (0xf4bd bytes) 2024-09-11T07:06:48.777 INFO:teuthology.orchestra.run.smithi079.stdout:2360 write 0x4931ea1 thru 0x493c8d2 (0xaa32 bytes) 2024-09-11T07:06:48.786 INFO:teuthology.orchestra.run.smithi079.stdout:2361 punch from 0xb92801d to 0xb92d360, (0x5343 bytes) 2024-09-11T07:06:48.786 INFO:teuthology.orchestra.run.smithi079.stdout:2362 write 0x70e4309 thru 0x70f35ba (0xf2b2 bytes) 2024-09-11T07:06:48.793 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:48.793 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:48.795 INFO:teuthology.orchestra.run.smithi079.stdout:2363 writesame 0x38d324d thru 0x38dca2c data_size 0x1b(0x97e0 bytes) 2024-09-11T07:06:48.800 INFO:teuthology.orchestra.run.smithi079.stdout:2365 read 0xbb9b78b thru 0xbba6d53 (0xb5c9 bytes) 2024-09-11T07:06:48.808 INFO:teuthology.orchestra.run.smithi079.stdout:2366 trunc from 0xd5172ed to 0x7cc2df1 2024-09-11T07:06:48.815 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:48.815 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:48.840 INFO:teuthology.orchestra.run.smithi079.stdout:2367 writesame 0x9291ef1 thru 0x929c18b data_size 0x1(0xa29b bytes) 2024-09-11T07:06:48.841 INFO:teuthology.orchestra.run.smithi079.stdout:2368 read 0x2164acd thru 0x217086a (0xbd9e bytes) 2024-09-11T07:06:48.841 INFO:teuthology.orchestra.run.smithi079.stdout:2370 read 0x7df9a02 thru 0x7dfe8cd (0x4ecc bytes) 2024-09-11T07:06:48.841 INFO:teuthology.orchestra.run.smithi079.stdout:2371 read 0x82d77b6 thru 0x82dccc6 (0x5511 bytes) 2024-09-11T07:06:48.841 INFO:teuthology.orchestra.run.smithi079.stdout:2372 read 0x4ae3bdd thru 0x4aeb7f7 (0x7c1b bytes) 2024-09-11T07:06:48.842 INFO:teuthology.orchestra.run.smithi079.stdout:2373 punch from 0x2f3aefc to 0x2f4187e, (0x6982 bytes) 2024-09-11T07:06:48.847 INFO:teuthology.orchestra.run.smithi079.stdout:2374 trunc from 0x929c18c to 0x4bb9973 2024-09-11T07:06:48.848 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:48.846+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:48.889 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:48.889 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:48.903 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:48.950 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:48.949+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:49.051 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:49.049+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:49.064 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:49.064 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:49.078 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:49.151 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:49.146+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:49.205 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:49.205 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:49.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:49.252 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:49.245+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:49.353 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:49.349+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:49.382 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:49.382 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:49.396 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:49.453 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:49.450+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:49.517 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:49.517 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:49.530 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:49.572 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:49.570+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:49.655 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:49.650+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:49.691 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:49.692 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:49.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:49.755 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:49.749+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:49.843 INFO:teuthology.orchestra.run.smithi079.stdout:2375 trunc from 0x4bb9973 to 0x8512c6e 2024-09-11T07:06:49.854 INFO:teuthology.orchestra.run.smithi079.stdout:2377 write 0x1eacfda thru 0x1eb3953 (0x697a bytes) 2024-09-11T07:06:49.856 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:49.853+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:49.865 INFO:teuthology.orchestra.run.smithi079.stdout:2378 punch from 0x1590fbc to 0x1591efa, (0xf3e bytes) 2024-09-11T07:06:49.865 INFO:teuthology.orchestra.run.smithi079.stdout:2379 read 0x52a0a9f thru 0x52ad45d (0xc9bf bytes) 2024-09-11T07:06:49.883 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:49.883 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:49.884 INFO:teuthology.orchestra.run.smithi079.stdout:2381 write 0xe8943c0 thru 0xe8a1474 (0xd0b5 bytes) 2024-09-11T07:06:49.899 INFO:teuthology.orchestra.run.smithi079.stdout:2383 writesame 0x30a567f thru 0x30a6cc9 data_size 0x1(0x164b bytes) 2024-09-11T07:06:49.900 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:49.907 INFO:teuthology.orchestra.run.smithi079.stdout:2384 punch from 0x5e7d4b6 to 0x5e83e3f, (0x6989 bytes) 2024-09-11T07:06:49.912 INFO:teuthology.orchestra.run.smithi079.stdout:2386 trunc from 0xe8a1475 to 0xb76112c 2024-09-11T07:06:49.929 INFO:teuthology.orchestra.run.smithi079.stdout:2387 read 0x9155cca thru 0x91642a1 (0xe5d8 bytes) 2024-09-11T07:06:49.929 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:49.929 INFO:teuthology.orchestra.run.smithi079.stdout:2389 read 0x74760c5 thru 0x747c2db (0x6217 bytes) 2024-09-11T07:06:49.945 INFO:teuthology.orchestra.run.smithi079.stdout:2390 trunc from 0xb76112c to 0x93128f 2024-09-11T07:06:49.957 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:49.954+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:50.001 INFO:teuthology.orchestra.run.smithi079.stdout:2391 writesame 0x96f76cf thru 0x97035df data_size 0x1(0xbf11 bytes) 2024-09-11T07:06:50.012 INFO:teuthology.orchestra.run.smithi079.stdout:2394 write 0xb6fb995 thru 0xb7065a9 (0xac15 bytes) 2024-09-11T07:06:50.025 INFO:teuthology.orchestra.run.smithi079.stdout:2396 writesame 0x1dfcfd4 thru 0x1dfeab4 data_size 0x1(0x1ae1 bytes) 2024-09-11T07:06:50.036 INFO:teuthology.orchestra.run.smithi079.stdout:2397 read 0xae75286 thru 0xae7cf8e (0x7d09 bytes) 2024-09-11T07:06:50.037 INFO:teuthology.orchestra.run.smithi079.stdout:2398 punch from 0xa139e55 to 0xa13ae35, (0xfe0 bytes) 2024-09-11T07:06:50.037 INFO:teuthology.orchestra.run.smithi079.stdout:2400 read 0x2dc2a45 thru 0x2dcba7f (0x903b bytes) 2024-09-11T07:06:50.037 INFO:teuthology.orchestra.run.smithi079.stdout:2401 writesame 0xb2ddbdf thru 0xb2e6e06 data_size 0xc(0x9228 bytes) 2024-09-11T07:06:50.039 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:50.039 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:50.052 INFO:teuthology.orchestra.run.smithi079.stdout:2402 writesame 0x23bb25e thru 0x23c545f data_size 0x59(0xa202 bytes) 2024-09-11T07:06:50.055 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:50.073 INFO:teuthology.orchestra.run.smithi079.stdout:2403 writesame 0xdd59632 thru 0xdd5f6c7 data_size 0x1(0x6096 bytes) 2024-09-11T07:06:50.073 INFO:teuthology.orchestra.run.smithi079.stdout:2404 read 0xc6054bb thru 0xc60b586 (0x60cc bytes) 2024-09-11T07:06:50.073 INFO:teuthology.orchestra.run.smithi079.stdout:2405 writesame 0x48d8ad6 thru 0x48d9878 data_size 0x1(0xda3 bytes) 2024-09-11T07:06:50.073 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:50.070+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:50.078 INFO:teuthology.orchestra.run.smithi079.stdout:2406 write 0x5f6dfea thru 0x5f799da (0xb9f1 bytes) 2024-09-11T07:06:50.093 INFO:teuthology.orchestra.run.smithi079.stdout:2407 punch from 0x42bf284 to 0x42ca190, (0xaf0c bytes) 2024-09-11T07:06:50.101 INFO:teuthology.orchestra.run.smithi079.stdout:2408 trunc from 0xdd5f6c8 to 0x98e0773 2024-09-11T07:06:50.120 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:50.120 INFO:teuthology.orchestra.run.smithi079.stdout:2413 trunc from 0x98e0773 to 0x951d4c1 2024-09-11T07:06:50.127 INFO:teuthology.orchestra.run.smithi079.stdout:2414 read 0x2a95a4d thru 0x2aa4fb1 (0xf565 bytes) 2024-09-11T07:06:50.127 INFO:teuthology.orchestra.run.smithi079.stdout:2416 punch from 0x18bd125 to 0x18be380, (0x125b bytes) 2024-09-11T07:06:50.128 INFO:teuthology.orchestra.run.smithi079.stdout:2417 read 0x6a36e43 thru 0x6a43d7c (0xcf3a bytes) 2024-09-11T07:06:50.139 INFO:teuthology.orchestra.run.smithi079.stdout:2418 writesame 0xc283cd2 thru 0xc284e61 data_size 0x8(0x1190 bytes) 2024-09-11T07:06:50.140 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:50.152 INFO:teuthology.orchestra.run.smithi079.stdout:2420 trunc from 0xc284e62 to 0x4621578 2024-09-11T07:06:50.158 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:50.154+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:50.169 INFO:teuthology.orchestra.run.smithi079.stdout:2422 read 0xc2a9f7 thru 0xc30f2c (0x6536 bytes) 2024-09-11T07:06:50.169 INFO:teuthology.orchestra.run.smithi079.stdout:2423 writesame 0x25137f0 thru 0x251c25e data_size 0x1(0x8a6f bytes) 2024-09-11T07:06:50.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:06:50.186 INFO:teuthology.orchestra.run.smithi079.stdout:2424 write 0x41e1ff0 thru 0x41f0ab7 (0xeac8 bytes) 2024-09-11T07:06:50.200 INFO:teuthology.orchestra.run.smithi079.stdout:2425 punch from 0x3361ca1 to 0x3369215, (0x7574 bytes) 2024-09-11T07:06:50.215 INFO:teuthology.orchestra.run.smithi079.stdout:2426 writesame 0x903bc2b thru 0x90434a4 data_size 0x7(0x787a bytes) 2024-09-11T07:06:50.215 INFO:teuthology.orchestra.run.smithi079.stdout:2427 read 0x25b2cc3 thru 0x25b4171 (0x14af bytes) 2024-09-11T07:06:50.216 INFO:teuthology.orchestra.run.smithi079.stdout:2428 write 0x1540a49 thru 0x1546eee (0x64a6 bytes) 2024-09-11T07:06:50.219 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:50.219 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:50.229 INFO:teuthology.orchestra.run.smithi079.stdout:2429 trunc from 0x90434a5 to 0x657a7f4 2024-09-11T07:06:50.239 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:50.241 INFO:teuthology.orchestra.run.smithi079.stdout:2430 trunc from 0x657a7f4 to 0x2e6b9bd 2024-09-11T07:06:50.259 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:50.253+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:50.267 INFO:teuthology.orchestra.run.smithi079.stdout:2431 trunc from 0x2e6b9bd to 0x81eaa53 2024-09-11T07:06:50.274 INFO:teuthology.orchestra.run.smithi079.stdout:2432 write 0xf2b00c thru 0xf39e2c (0xee21 bytes) 2024-09-11T07:06:50.287 INFO:teuthology.orchestra.run.smithi079.stdout:2433 read 0x198e416 thru 0x199461a (0x6205 bytes) 2024-09-11T07:06:50.287 INFO:teuthology.orchestra.run.smithi079.stdout:2434 read 0x1a0958f thru 0x1a0a15f (0xbd1 bytes) 2024-09-11T07:06:50.305 INFO:teuthology.orchestra.run.smithi079.stdout:2435 writesame 0xe983702 thru 0xe98e0b0 data_size 0xb(0xa9af bytes) 2024-09-11T07:06:50.305 INFO:teuthology.orchestra.run.smithi079.stdout:2436 write 0xc0c74d thru 0xc0ca10 (0x2c4 bytes) 2024-09-11T07:06:50.317 INFO:teuthology.orchestra.run.smithi079.stdout:2437 trunc from 0xe98e0b1 to 0x8307c21 2024-09-11T07:06:50.324 INFO:teuthology.orchestra.run.smithi079.stdout:2438 read 0x256824c thru 0x25726a6 (0xa45b bytes) 2024-09-11T07:06:50.325 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:50.325 INFO:teuthology.orchestra.run.smithi079.stdout:2440 read 0x3713579 thru 0x371b68a (0x8112 bytes) 2024-09-11T07:06:50.334 INFO:teuthology.orchestra.run.smithi079.stdout:2441 write 0x8fd3f0d thru 0x8fd9e9c (0x5f90 bytes) 2024-09-11T07:06:50.360 INFO:teuthology.orchestra.run.smithi079.stdout:2442 write 0xe7ab1b4 thru 0xe7aee12 (0x3c5f bytes) 2024-09-11T07:06:50.360 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:50.357+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:50.367 INFO:teuthology.orchestra.run.smithi079.stdout:2443 read 0x366934a thru 0x36733b5 (0xa06c bytes) 2024-09-11T07:06:50.367 INFO:teuthology.orchestra.run.smithi079.stdout:2444 punch from 0x6553aef to 0x6556354, (0x2865 bytes) 2024-09-11T07:06:50.367 INFO:teuthology.orchestra.run.smithi079.stdout:2445 write 0x84b4ef8 thru 0x84b9ecc (0x4fd5 bytes) 2024-09-11T07:06:50.375 INFO:teuthology.orchestra.run.smithi079.stdout:2446 writesame 0x5b3375a thru 0x5b3bdf3 data_size 0x3(0x869a bytes) 2024-09-11T07:06:50.380 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:50.381 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:50.389 INFO:teuthology.orchestra.run.smithi079.stdout:2449 writesame 0x53120ce thru 0x5317105 data_size 0x11(0x5038 bytes) 2024-09-11T07:06:50.399 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:50.400 INFO:teuthology.orchestra.run.smithi079.stdout:2450 punch from 0x85b629f to 0x85b9134, (0x2e95 bytes) 2024-09-11T07:06:50.401 INFO:teuthology.orchestra.run.smithi079.stdout:2452 clone 26 order 21 su 32768 sc 10 2024-09-11T07:06:50.461 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:50.457+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:50.513 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:50.513 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:50.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:50.563 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:50.557+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:50.643 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:50.643 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:50.656 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:50.704 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:50.701+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:50.764 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:50.762+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:50.788 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:50.788 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:50.802 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:50.816 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:06:50.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:50.888 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:50.885+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:50.966 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:50.962+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:50.978 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:50.978 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:50.993 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:50.996 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:50.996 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:51.013 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:51.014 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:51.030 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:51.031 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:51.034 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone25 from 0xe7aee13 (overlap 0x93128f) to 0x2c1f2a 2024-09-11T07:06:51.054 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:51.077 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:51.077 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:51.084 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:51.081+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:51.102 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:51.102 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:51.129 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:51.129 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:51.150 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:51.151 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:51.165 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:06:51.165 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:06:51.165 INFO:tasks.thrashosds.thrasher:inject_pause on osd.7 2024-09-11T07:06:51.165 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T07:06:51.166 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T07:06:51.166 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok config set filestore_inject_stall 3 2024-09-11T07:06:51.167 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:51.162+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.894347989, 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.182 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:51.186 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.894275906000001, 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:51.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:06:51.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.190 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.894220412999999, 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.191 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:06:51.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.692348445, 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:06:51.195 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:51.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:06:51.199 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.692285855000002, 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.200 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:06:51.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:06:51.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.692228798999999, 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:06:51.204 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:06:51.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:06:51.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.208 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.692172681999999, 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:06:51.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:06:51.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.692051419999999, 2024-09-11T07:06:51.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:06:51.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:06:51.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691947151000001, 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.218 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:06:51.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691841612000001, 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.222 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:06:51.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:06:51.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691774449, 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.226 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:06:51.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:51.230 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691675242999999, 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691588284000002, 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.235 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:06:51.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.239 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691528006999999, 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:06:51.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:06:51.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691374302, 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.244 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691287125999999, 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:06:51.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:06:51.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.252 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691223223000001, 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:51.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:06:51.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:06:51.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691163379999999, 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.257 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:06:51.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:06:51.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691085298000001, 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.261 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:06:51.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:51.265 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.691027527999999, 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:06:51.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:06:51.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.270 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.270 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.270 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.270 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.270 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:51.271 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:51.272 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:51.265+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:51.282 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T07:06:51.282 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:51.372 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:51.369+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:51.406 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:51.407 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:51.407 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:51.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:51.473 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:51.470+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:51.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:51.570+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:51.582 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #24, image image_client.0-clone24 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent25 2024-09-11T07:06:51.589 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:51.589 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:51.589 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:51.589 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:51.589 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:51.603 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:51.675 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:51.670+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409889436, 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.722 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409821881999999, 2024-09-11T07:06:51.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.730 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409741045000001, 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409697698999999, 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.735 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409627574000002, 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.739 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:51.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:51.743 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.40955945, 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409518984000002, 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.748 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:06:51.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409480942999998, 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409441973, 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.756 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.760 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409401099, 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:06:51.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409073326000001, 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:06:51.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.769 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.409006816000002, 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:06:51.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.408939097000001, 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.774 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:06:51.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.778 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.408894158999999, 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:06:51.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:06:51.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.408094534, 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:51.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.408060192000001, 2024-09-11T07:06:51.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:06:51.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.407697516999999, 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.792 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.406434491999999, 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.796 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:51.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.406401992999999, 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:06:51.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 23.469796565999999, 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:51.805 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:51.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:06:51.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:51.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.810 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:51.811 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:51.811 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:51.812 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:51.813 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:51.810+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:51.914 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:51.909+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:51.941 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:51.941 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:51.941 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:51.941 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:51.955 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:52.040 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:52.037+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:52.099 INFO:teuthology.orchestra.run.smithi079.stdout:2453 trunc from 0xe7aee13 to 0x935752e 2024-09-11T07:06:52.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:52.114+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:52.122 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:52.122 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:52.140 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:52.157 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.157 INFO:teuthology.orchestra.run.smithi079.stdout:2457 write 0x54c4db thru 0x55841b (0xbf41 bytes) 2024-09-11T07:06:52.216 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:52.214+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:52.229 INFO:teuthology.orchestra.run.smithi079.stdout:2458 write 0xe2f6fe6 thru 0xe303e83 (0xce9e bytes) 2024-09-11T07:06:52.238 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.238 INFO:teuthology.orchestra.run.smithi079.stdout:2460 punch from 0x5456391 to 0x5459dee, (0x3a5d bytes) 2024-09-11T07:06:52.238 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.260 INFO:teuthology.orchestra.run.smithi079.stdout:2462 trunc from 0xe303e84 to 0xf129e2 2024-09-11T07:06:52.317 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:52.313+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:52.343 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:52.343 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.020056480999997, 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.344 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:06:52.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:06:52.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9997 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 180224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.71744151, 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010421191999999999, 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9997 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:52.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624848+0000", 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624854+0000", 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2330000000000003e-06 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624873+0000", 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8770000000000002e-05 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624887+0000", 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.437e-05 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.634868+0000", 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0099809489999999994 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635065+0000", 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196622 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635268+0000", 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020319500000000001 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10000 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.717381050999997, 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010963796, 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10000 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:52.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624909+0000", 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.68e-06 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624915+0000", 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.003e-06 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624939+0000", 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4386999999999999e-05 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624953+0000", 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.419e-05 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635384+0000", 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010430356 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635653+0000", 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026916499999999998 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635871+0000", 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021801500000000001 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.359 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10002 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.717315034999999, 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011381399, 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10002 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624974+0000", 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2640000000000001e-06 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624994+0000", 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9826e-05 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625015+0000", 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0724e-05 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625031+0000", 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6089000000000001e-05 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635948+0000", 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010917349 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636143+0000", 2024-09-11T07:06:52.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019470199999999999 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636355+0000", 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021144499999999999 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10004 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:52.364 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.717190115999998, 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011952765000000001, 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10004 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:52.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625099+0000", 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625118+0000", 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625135+0000", 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7669999999999999e-05 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625150+0000", 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4504e-05 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636471+0000", 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011321278000000001 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636726+0000", 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025507200000000001 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637051+0000", 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032463099999999998 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.368 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.717117385999998, 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:06:52.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:06:52.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.717054269999998, 2024-09-11T07:06:52.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:52.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.377 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716979277, 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:06:52.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716914721000002, 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.382 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:06:52.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716859491999998, 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:06:52.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:06:52.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.391 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716805594999997, 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:06:52.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:06:52.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716745095999997, 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.396 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716689082999999, 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:06:52.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716609730000002, 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.405 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:06:52.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716553427000001, 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.410 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:06:52.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716480988000001, 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:06:52.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716424867999997, 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.419 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:06:52.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716351402000001, 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.424 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:06:52.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:06:52.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.716273008999998, 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.428 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:52.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.432 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.807096995, 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:06:52.436 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.437 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.437 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:52.439 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:52.439 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:52.433+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:52.440 INFO:teuthology.orchestra.run.smithi079.stdout:2463 read 0xad5036 thru 0xadb9a5 (0x6970 bytes) 2024-09-11T07:06:52.440 INFO:teuthology.orchestra.run.smithi079.stdout:2464 writesame 0x15623db thru 0x1563d67 data_size 0x1(0x198d bytes) 2024-09-11T07:06:52.440 INFO:teuthology.orchestra.run.smithi079.stdout:2465 trunc from 0x1563d68 to 0xebe40ac 2024-09-11T07:06:52.440 INFO:teuthology.orchestra.run.smithi079.stdout:2467 punch from 0xdd6ff98 to 0xdd7a371, (0xa3d9 bytes) 2024-09-11T07:06:52.440 INFO:teuthology.orchestra.run.smithi079.stdout:2468 read 0xae94e7 thru 0xaf1eb7 (0x89d1 bytes) 2024-09-11T07:06:52.440 INFO:teuthology.orchestra.run.smithi079.stdout:2469 read 0x21d234d thru 0x21dfb7c (0xd830 bytes) 2024-09-11T07:06:52.441 INFO:teuthology.orchestra.run.smithi079.stdout:2470 punch from 0xbe861bf to 0xbe8f808, (0x9649 bytes) 2024-09-11T07:06:52.441 INFO:teuthology.orchestra.run.smithi079.stdout:2471 write 0xce6098d thru 0xce616aa (0xd1e bytes) 2024-09-11T07:06:52.441 INFO:teuthology.orchestra.run.smithi079.stdout:2472 write 0x49f078b thru 0x49fcc15 (0xc48b bytes) 2024-09-11T07:06:52.441 INFO:teuthology.orchestra.run.smithi079.stdout:2473 trunc from 0xebe40ac to 0x9f4b330 2024-09-11T07:06:52.447 INFO:teuthology.orchestra.run.smithi079.stdout:2474 read 0x65825ef thru 0x6589ed2 (0x78e4 bytes) 2024-09-11T07:06:52.466 INFO:teuthology.orchestra.run.smithi079.stdout:2475 trunc from 0x9f4b330 to 0x6ac62f 2024-09-11T07:06:52.497 INFO:teuthology.orchestra.run.smithi079.stdout:2476 read 0x3dc28a thru 0x3eba9e (0xf815 bytes) 2024-09-11T07:06:52.499 INFO:teuthology.orchestra.run.smithi079.stdout:2477 read 0x5b8910 thru 0x5c0ee8 (0x85d9 bytes) 2024-09-11T07:06:52.513 INFO:teuthology.orchestra.run.smithi079.stdout:2478 write 0x158ff93 thru 0x159e82a (0xe898 bytes) 2024-09-11T07:06:52.539 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:52.534+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:52.551 INFO:teuthology.orchestra.run.smithi079.stdout:2479 writesame 0xa340723 thru 0xa34e25a data_size 0xb8(0xdb38 bytes) 2024-09-11T07:06:52.552 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.552 INFO:teuthology.orchestra.run.smithi079.stdout:2482 read 0x3bce11a thru 0x3bdafad (0xce94 bytes) 2024-09-11T07:06:52.562 INFO:teuthology.orchestra.run.smithi079.stdout:2483 write 0xa91dee7 thru 0xa9209e1 (0x2afb bytes) 2024-09-11T07:06:52.570 INFO:teuthology.orchestra.run.smithi079.stdout:2484 write 0x829430d thru 0x829ae9b (0x6b8f bytes) 2024-09-11T07:06:52.591 INFO:teuthology.orchestra.run.smithi079.stdout:2485 trunc from 0xa9209e2 to 0x356598b 2024-09-11T07:06:52.612 INFO:teuthology.orchestra.run.smithi079.stdout:2487 read 0xb49099 thru 0xb4ec11 (0x5b79 bytes) 2024-09-11T07:06:52.618 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:52.619 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:52.619 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:52.619 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:52.633 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:52.642 INFO:teuthology.orchestra.run.smithi079.stdout:2488 write 0xb720049 thru 0xb72fdc6 (0xfd7e bytes) 2024-09-11T07:06:52.650 INFO:teuthology.orchestra.run.smithi079.stdout:2489 read 0x88a1638 thru 0x88a81b2 (0x6b7b bytes) 2024-09-11T07:06:52.673 INFO:teuthology.orchestra.run.smithi079.stdout:2490 trunc from 0xb72fdc7 to 0x332cef 2024-09-11T07:06:52.680 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:52.677+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:52.697 INFO:teuthology.orchestra.run.smithi079.stdout:2492 punch from 0x2c7447 to 0x2cce4d, (0x5a06 bytes) 2024-09-11T07:06:52.723 INFO:teuthology.orchestra.run.smithi079.stdout:2493 write 0x660da35 thru 0x661156d (0x3b39 bytes) 2024-09-11T07:06:52.732 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.732 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.740 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:52.738+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:52.742 INFO:teuthology.orchestra.run.smithi079.stdout:2496 trunc from 0x661156e to 0x1978f4d 2024-09-11T07:06:52.757 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:52.758 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:52.772 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:52.791 INFO:teuthology.orchestra.run.smithi079.stdout:2498 write 0x848b077 thru 0x848e0cb (0x3055 bytes) 2024-09-11T07:06:52.798 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.798 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.798 INFO:teuthology.orchestra.run.smithi079.stdout:2502 punch from 0x4fc89dd to 0x4fd4cee, (0xc311 bytes) 2024-09-11T07:06:52.798 INFO:teuthology.orchestra.run.smithi079.stdout:2504 read 0x2657cc7 thru 0x2664f55 (0xd28f bytes) 2024-09-11T07:06:52.798 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.798 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.798 INFO:teuthology.orchestra.run.smithi079.stdout:2510 write 0x51ae83a thru 0x51be066 (0xf82d bytes) 2024-09-11T07:06:52.830 INFO:teuthology.orchestra.run.smithi079.stdout:2512 write 0xcbf0be2 thru 0xcbf6203 (0x5622 bytes) 2024-09-11T07:06:52.846 INFO:teuthology.orchestra.run.smithi079.stdout:2513 trunc from 0xcbf6204 to 0x954aceb 2024-09-11T07:06:52.849 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:06:52.860 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:52.857+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:52.865 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.865 INFO:teuthology.orchestra.run.smithi079.stdout:2515 punch from 0x641e6b4 to 0x642659f, (0x7eeb bytes) 2024-09-11T07:06:52.865 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:52.865 INFO:teuthology.orchestra.run.smithi079.stdout:2517 trunc from 0x954aceb to 0x9644dc2 2024-09-11T07:06:52.871 INFO:teuthology.orchestra.run.smithi079.stdout:2518 read 0x75a348c thru 0x75b0713 (0xd288 bytes) 2024-09-11T07:06:52.879 INFO:teuthology.orchestra.run.smithi079.stdout:2519 write 0xa0797b3 thru 0xa0852f6 (0xbb44 bytes) 2024-09-11T07:06:52.885 INFO:teuthology.orchestra.run.smithi079.stdout:2520 punch from 0x94af242 to 0x94b9beb, (0xa9a9 bytes) 2024-09-11T07:06:52.885 INFO:teuthology.orchestra.run.smithi079.stdout:2521 clone 27 order 25 su 131072 sc 10 2024-09-11T07:06:52.943 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:52.943 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:52.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:52.943 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:52.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.943 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:52.944 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:52.944 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.874121840000001, 2024-09-11T07:06:52.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:06:52.944 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.944 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.944 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:52.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:06:52.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:52.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:06:52.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7525 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4898816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.243148228000003, 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058576490000000002, 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7525 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:52.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701087+0000", 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018042780000000001 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701093+0000", 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7880000000000003e-06 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701108+0000", 2024-09-11T07:06:52.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4409999999999999e-05 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701116+0000", 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2120000000000003e-06 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757734+0000", 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056618467999999998 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757798+0000", 2024-09-11T07:06:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3978000000000003e-05 2024-09-11T07:06:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757860+0000", 2024-09-11T07:06:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1356e-05 2024-09-11T07:06:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.447951345, 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:06:52.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:52.960 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:06:52.961 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.447895127999999, 2024-09-11T07:06:52.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:06:52.961 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.961 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.961 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.961 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.961 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.961 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.961 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:06:52.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:06:52.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:06:52.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:06:52.965 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.965 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.965 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.965 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26245 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 88064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:52.965 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444896497999999, 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058494675000000003, 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26245 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497536+0000", 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.035e-06 2024-09-11T07:06:52.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497541+0000", 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9740000000000001e-06 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497557+0000", 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5794000000000002e-05 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497568+0000", 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0879999999999999e-05 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555887+0000", 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058319353999999997 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555952+0000", 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4875999999999993e-05 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556030+0000", 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7762000000000005e-05 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444847967000001, 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.970 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.971 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.971 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.971 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.971 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:06:52.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.971 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:06:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:06:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:06:52.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:06:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:06:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:06:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:06:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.975 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:06:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444794866999999, 2024-09-11T07:06:52.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:06:52.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:06:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:06:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:06:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444695962000001, 2024-09-11T07:06:52.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:06:52.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:06:52.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444628093999999, 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.986 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:06:52.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:06:52.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:06:52.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:06:52.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.44457156, 2024-09-11T07:06:52.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:52.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:06:52.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:52.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444519100000001, 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:52.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:53.000 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:53.000 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:53.000 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:06:53.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.000 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:53.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:53.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:06:53.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:53.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:06:53.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:06:53.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:53.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:06:53.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:06:53.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444467471999999, 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:06:53.005 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:06:53.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:06:53.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:06:53.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.010 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:52.937+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:53.011 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.011 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.011 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:53.011 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:06:53.011 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444416050000001, 2024-09-11T07:06:53.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:06:53.011 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:53.012 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:53.012 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:53.012 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:53.012 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:53.012 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:53.012 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:06:53.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.012 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:53.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:53.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:06:53.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:53.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:06:53.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:53.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:06:53.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.016 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444364956000001, 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:53.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:06:53.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:53.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.021 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.022 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.022 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:53.022 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:06:53.022 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444312996000001, 2024-09-11T07:06:53.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:06:53.022 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:53.022 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:53.022 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:06:53.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444213482999999, 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:06:53.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:53.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:06:53.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:53.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:06:53.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:06:53.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:53.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:06:53.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:06:53.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.031 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444154678, 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:53.032 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:53.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:06:53.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:06:53.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:53.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:06:53.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:06:53.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:53.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.036 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444103523999999, 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:53.037 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:06:53.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:06:53.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.444047218000001, 2024-09-11T07:06:53.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:06:53.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.437247703000001, 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:53.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:06:53.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:06:53.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:06:53.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:53.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:53.050 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:53.050 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:53.052 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:53.049+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:53.152 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:53.149+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:53.172 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:53.172 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:53.172 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:53.172 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:53.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:53.186 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:53.280 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:53.278+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:53.320 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:53.321 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:53.338 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:53.338 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:53.349 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:53.349 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:53.354 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:53.354 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:53.355 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:53.353+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:53.363 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:53.371 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:53.371 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:53.392 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:53.392 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:53.412 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:53.412 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:53.433 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:53.433 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:53.454 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:53.454 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:53.455 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:53.450+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:53.488 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:53.488 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:53.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:53.557 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:53.553+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:53.657 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:53.654+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:53.660 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:53.660 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:53.674 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:53.760 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:53.758+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:53.837 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:06:53.842 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:53.842 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:53.860 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:53.857+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:53.862 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:53.961 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:53.957+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:54.027 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:54.027 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:54.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:54.062 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:54.057+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:54.142 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone26 from 0xa0852f7 (overlap 0x332cef) to 0x23d2a7 2024-09-11T07:06:54.163 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:54.158+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:54.177 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:54.178 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:54.192 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:54.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:54.282+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:54.360 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:54.360 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:54.364 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:54.361+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:54.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:54.465 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:54.461+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:54.546 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:54.546 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:54.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:54.599 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #25, image image_client.0-clone25 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent26 2024-09-11T07:06:54.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:54.598+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:54.616 INFO:teuthology.orchestra.run.smithi079.stdout:2522 writesame 0x65a2902 thru 0x65a7854 data_size 0x7(0x4f53 bytes) 2024-09-11T07:06:54.657 INFO:teuthology.orchestra.run.smithi079.stdout:2523 writesame 0x6259915 thru 0x6263280 data_size 0x12(0x996c bytes) 2024-09-11T07:06:54.668 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:54.666+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:54.688 INFO:teuthology.orchestra.run.smithi079.stdout:2524 read 0x1c339ab thru 0x1c39c6f (0x62c5 bytes) 2024-09-11T07:06:54.688 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:54.688 INFO:teuthology.orchestra.run.smithi079.stdout:2526 punch from 0x9303829 to 0x93092f6, (0x5acd bytes) 2024-09-11T07:06:54.698 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:54.698 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:54.712 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:54.713 INFO:teuthology.orchestra.run.smithi079.stdout:2528 write 0xec85224 thru 0xec943c7 (0xf1a4 bytes) 2024-09-11T07:06:54.737 INFO:teuthology.orchestra.run.smithi079.stdout:2529 read 0xc4d0157 thru 0xc4d09c2 (0x86c bytes) 2024-09-11T07:06:54.737 INFO:teuthology.orchestra.run.smithi079.stdout:2531 writesame 0xb5d955b thru 0xb5e6494 data_size 0x19(0xcf3a bytes) 2024-09-11T07:06:54.762 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:54.762 INFO:teuthology.orchestra.run.smithi079.stdout:2534 writesame 0xc1a2d1d thru 0xc1a4c8e data_size 0x1(0x1f72 bytes) 2024-09-11T07:06:54.769 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:54.765+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:54.784 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:54.784 INFO:teuthology.orchestra.run.smithi079.stdout:2536 write 0x9c26a7f thru 0x9c29e70 (0x33f2 bytes) 2024-09-11T07:06:54.787 INFO:teuthology.orchestra.run.smithi079.stdout:2537 read 0x7b76d2a thru 0x7b7ffde (0x92b5 bytes) 2024-09-11T07:06:54.787 INFO:teuthology.orchestra.run.smithi079.stdout:2539 punch from 0xec56af8 to 0xec59d95, (0x329d bytes) 2024-09-11T07:06:54.788 INFO:teuthology.orchestra.run.smithi079.stdout:2540 read 0xd400327 thru 0xd4010d1 (0xdab bytes) 2024-09-11T07:06:54.814 INFO:teuthology.orchestra.run.smithi079.stdout:2541 trunc from 0xec943c8 to 0x3891386 2024-09-11T07:06:54.869 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:54.866+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:54.874 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:54.874 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:54.897 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:54.907 INFO:teuthology.orchestra.run.smithi079.stdout:2544 write 0xe356d48 thru 0xe364eff (0xe1b8 bytes) 2024-09-11T07:06:54.933 INFO:teuthology.orchestra.run.smithi079.stdout:2545 trunc from 0xe364f00 to 0x43eefd7 2024-09-11T07:06:54.970 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:54.965+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:54.978 INFO:teuthology.orchestra.run.smithi079.stdout:2546 writesame 0xa2bbc0e thru 0xa2bfb36 data_size 0x17(0x3f29 bytes) 2024-09-11T07:06:54.989 INFO:teuthology.orchestra.run.smithi079.stdout:2547 trunc from 0xa2bfb37 to 0x68b4473 2024-09-11T07:06:55.021 INFO:teuthology.orchestra.run.smithi079.stdout:2549 trunc from 0x68b4473 to 0xcf56968 2024-09-11T07:06:55.035 INFO:teuthology.orchestra.run.smithi079.stdout:2550 writesame 0xb33f724 thru 0xb3484e4 data_size 0x1(0x8dc1 bytes) 2024-09-11T07:06:55.052 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:55.052 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:55.064 INFO:teuthology.orchestra.run.smithi079.stdout:2552 read 0x465bd thru 0x4c8e6 (0x632a bytes) 2024-09-11T07:06:55.066 INFO:teuthology.orchestra.run.smithi079.stdout:2553 read 0xec50f9 thru 0xecafe4 (0x5eec bytes) 2024-09-11T07:06:55.067 INFO:teuthology.orchestra.run.smithi079.stdout:2554 writesame 0x6ec7536 thru 0x6ed380d data_size 0x56(0xc2d8 bytes) 2024-09-11T07:06:55.071 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:55.071 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:55.066+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:55.072 INFO:teuthology.orchestra.run.smithi079.stdout:2555 writesame 0x93094a1 thru 0x930e955 data_size 0x1(0x54b5 bytes) 2024-09-11T07:06:55.079 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:55.079 INFO:teuthology.orchestra.run.smithi079.stdout:2557 read 0xb16163c thru 0xb16a094 (0x8a59 bytes) 2024-09-11T07:06:55.080 INFO:teuthology.orchestra.run.smithi079.stdout:2558 punch from 0xcdc377c to 0xcdc811f, (0x49a3 bytes) 2024-09-11T07:06:55.082 INFO:teuthology.orchestra.run.smithi079.stdout:2562 trunc from 0xcf56968 to 0xe199878 2024-09-11T07:06:55.093 INFO:teuthology.orchestra.run.smithi079.stdout:2564 read 0x3e80a85 thru 0x3e83471 (0x29ed bytes) 2024-09-11T07:06:55.114 INFO:teuthology.orchestra.run.smithi079.stdout:2565 trunc from 0xe199878 to 0x58249d9 2024-09-11T07:06:55.136 INFO:teuthology.orchestra.run.smithi079.stdout:2566 trunc from 0x58249d9 to 0x683c4e 2024-09-11T07:06:55.149 INFO:teuthology.orchestra.run.smithi079.stdout:2568 punch from 0x27da30 to 0x28d034, (0xf604 bytes) 2024-09-11T07:06:55.171 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:55.165+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:55.173 INFO:teuthology.orchestra.run.smithi079.stdout:2570 writesame 0x584afd2 thru 0x584ce82 data_size 0x1b(0x1eb1 bytes) 2024-09-11T07:06:55.175 INFO:teuthology.orchestra.run.smithi079.stdout:2571 punch from 0x4c1785f to 0x4c1a7c2, (0x2f63 bytes) 2024-09-11T07:06:55.175 INFO:teuthology.orchestra.run.smithi079.stdout:2572 read 0x514a9d thru 0x5219c1 (0xcf25 bytes) 2024-09-11T07:06:55.176 INFO:teuthology.orchestra.run.smithi079.stdout:2573 clone 28 order 19 su 32768 sc 9 2024-09-11T07:06:55.206 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:55.206 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:55.220 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:55.308 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:55.305+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:55.373 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:55.370+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:55.385 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:55.385 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:55.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:55.472 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:06:55.475 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:55.470+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:55.561 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:55.562 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:55.574 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:55.569+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:55.575 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:06:55.628 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:55.628 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:55.644 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:55.644 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:55.661 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:55.661 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:55.675 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:55.669+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:55.677 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:55.677 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:55.697 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:55.698 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:55.718 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:55.718 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:55.735 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:55.736 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:55.736 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:55.736 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:55.738 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:55.739 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:55.750 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:06:55.756 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:55.757 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:55.776 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:55.774+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:55.866 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:06:55.877 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:55.873+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:55.919 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:55.919 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:55.919 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:55.934 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:06:55.978 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:55.974+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:56.079 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:56.074+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:56.107 INFO:teuthology.orchestra.run.smithi079.stdout:flattening image image_client.0-clone27 2024-09-11T07:06:56.116 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:56.116 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:56.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:56.116 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:56.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:56.116 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.805376533999997, 2024-09-11T07:06:56.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:06:56.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.122 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.122 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:56.122 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.80530898, 2024-09-11T07:06:56.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:06:56.122 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.122 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:56.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:06:56.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:06:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:06:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:06:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:06:56.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:06:56.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:06:56.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:06:56.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:06:56.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.805228143000001, 2024-09-11T07:06:56.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:06:56.129 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.129 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.129 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:06:56.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.129 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:06:56.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.805184797000003, 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:06:56.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.805114672000002, 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:06:56.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:56.144 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.805046548, 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:06:56.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:06:56.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.149 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.805006081999998, 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.150 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:06:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:06:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:06:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:06:56.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:06:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:06:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:06:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:06:56.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.804968041000002, 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:06:56.155 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:06:56.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:06:56.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.160 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.804929070999997, 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.161 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:56.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:56.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:06:56.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:06:56.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:06:56.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.804888196999997, 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.166 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:06:56.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:06:56.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:06:56.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:06:56.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:06:56.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:06:56.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:06:56.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:06:56.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:06:56.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:06:56.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:06:56.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:06:56.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:06:56.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:06:56.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:06:56.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.174 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.174 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.175 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:56.175 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.804560424000002, 2024-09-11T07:06:56.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:06:56.175 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.175 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.175 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.176 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.176 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:06:56.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.177 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:56.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:06:56.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:06:56.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:06:56.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:06:56.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:06:56.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:06:56.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:06:56.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:06:56.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:06:56.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:06:56.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:06:56.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:06:56.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:06:56.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:06:56.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:06:56.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.185 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.185 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.186 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:56.186 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.804493913999998, 2024-09-11T07:06:56.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:06:56.186 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.186 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.187 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.187 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:06:56.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.188 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:56.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:06:56.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:06:56.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:06:56.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:06:56.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:06:56.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:06:56.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:06:56.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:06:56.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:06:56.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:06:56.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:06:56.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:06:56.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:06:56.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:06:56.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:06:56.196 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.196 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.196 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.197 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.197 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:56.197 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.804426194999998, 2024-09-11T07:06:56.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:06:56.197 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.198 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.198 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.199 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:06:56.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.199 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:56.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:06:56.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:06:56.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:06:56.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:06:56.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:06:56.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:06:56.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:06:56.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:06:56.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:06:56.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:06:56.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:06:56.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:06:56.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:06:56.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:06:56.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:06:56.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.207 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.208 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.208 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.208 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:56.208 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.804381257000003, 2024-09-11T07:06:56.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:06:56.209 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.209 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.209 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.209 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.210 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.210 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.210 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:06:56.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.210 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:56.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:06:56.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:06:56.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:06:56.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:06:56.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.215 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.803581631999997, 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.216 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:06:56.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.803547289999997, 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:06:56.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:06:56.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:06:56.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.803184614999999, 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:06:56.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:06:56.230 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.801921589999999, 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.231 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:06:56.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:06:56.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:06:56.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:06:56.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:06:56.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:56.236 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 35.801889091, 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:06:56.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.241 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 27.865283664, 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:06:56.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:06:56.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:06:56.248 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.248 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.248 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.248 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.248 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.248 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:56.250 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:06:56.250 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:56.246+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:56.298 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:06:56.298 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:06:56.298 INFO:tasks.thrashosds.thrasher:Removing osd 0, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:06:56.298 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 0 2024-09-11T07:06:56.351 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:56.345+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:56.384 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:56.384 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:56.384 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:06:56.384 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:56.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:06:56.437 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #26, image image_client.0-clone26 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent27 2024-09-11T07:06:56.451 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:56.446+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:56.476 INFO:teuthology.orchestra.run.smithi079.stdout:2574 write 0xdbac1c8 thru 0xdbbb0d5 (0xef0e bytes) 2024-09-11T07:06:56.482 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:56.482 INFO:teuthology.orchestra.run.smithi079.stdout:2578 punch from 0x8d2a25b to 0x8d338ab, (0x9650 bytes) 2024-09-11T07:06:56.482 INFO:teuthology.orchestra.run.smithi079.stdout:2580 punch from 0xd857843 to 0xd85ca61, (0x521e bytes) 2024-09-11T07:06:56.486 INFO:teuthology.orchestra.run.smithi079.stdout:2581 trunc from 0xdbbb0d6 to 0xb87f2e1 2024-09-11T07:06:56.499 INFO:teuthology.orchestra.run.smithi079.stdout:2582 read 0x90e91de thru 0x90f8d61 (0xfb84 bytes) 2024-09-11T07:06:56.499 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:56.499 INFO:teuthology.orchestra.run.smithi079.stdout:2584 read 0x280dc90 thru 0x280f110 (0x1481 bytes) 2024-09-11T07:06:56.499 INFO:teuthology.orchestra.run.smithi079.stdout:2586 write 0x3e871e7 thru 0x3e89d66 (0x2b80 bytes) 2024-09-11T07:06:56.505 INFO:teuthology.orchestra.run.smithi079.stdout:2587 writesame 0x1527bf9 thru 0x15363cd data_size 0x49(0xe7d5 bytes) 2024-09-11T07:06:56.514 INFO:teuthology.orchestra.run.smithi079.stdout:2588 write 0xa56fdbb thru 0xa573364 (0x35aa bytes) 2024-09-11T07:06:56.518 INFO:teuthology.orchestra.run.smithi079.stdout:2589 writesame 0x396601 thru 0x39d5b6 data_size 0x4f(0x6fb6 bytes) 2024-09-11T07:06:56.527 INFO:teuthology.orchestra.run.smithi079.stdout:2590 read 0xcc9331 thru 0xcd3fcc (0xac9c bytes) 2024-09-11T07:06:56.528 INFO:teuthology.orchestra.run.smithi079.stdout:2591 read 0x3d66227 thru 0x3d6d8c1 (0x769b bytes) 2024-09-11T07:06:56.528 INFO:teuthology.orchestra.run.smithi079.stdout:2592 write 0x4d1a200 thru 0x4d213c6 (0x71c7 bytes) 2024-09-11T07:06:56.536 INFO:teuthology.orchestra.run.smithi079.stdout:2596 read 0x8849ce4 thru 0x8855df7 (0xc114 bytes) 2024-09-11T07:06:56.536 INFO:teuthology.orchestra.run.smithi079.stdout:2597 clone 29 order 24 su 524288 sc 7 2024-09-11T07:06:56.552 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:56.549+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:56.576 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:56.577 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:56.577 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:56.577 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:56.577 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:56.590 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:06:56.641 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-11T07:06:56.638+0000 7f4290681640 -1 mon.a@0(leader).osd e69 definitely_dead 0 2024-09-11T07:06:56.676 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:56.673+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:56.754 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:56.754+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:56.758 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.433880098000003, 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:56.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:06:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:56.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:06:56.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9997 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 180224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:56.765 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.131265126999999, 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010421191999999999, 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9997 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:56.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624848+0000", 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624854+0000", 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2330000000000003e-06 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624873+0000", 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8770000000000002e-05 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624887+0000", 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.437e-05 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.634868+0000", 2024-09-11T07:06:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0099809489999999994 2024-09-11T07:06:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635065+0000", 2024-09-11T07:06:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196622 2024-09-11T07:06:56.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635268+0000", 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020319500000000001 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10000 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.131204668000002, 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010963796, 2024-09-11T07:06:56.770 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10000 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624909+0000", 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.68e-06 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624915+0000", 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.003e-06 2024-09-11T07:06:56.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624939+0000", 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4386999999999999e-05 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624953+0000", 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.419e-05 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635384+0000", 2024-09-11T07:06:56.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010430356 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635653+0000", 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026916499999999998 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635871+0000", 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021801500000000001 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10002 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.131138651999997, 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011381399, 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10002 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624974+0000", 2024-09-11T07:06:56.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2640000000000001e-06 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624994+0000", 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9826e-05 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625015+0000", 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0724e-05 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625031+0000", 2024-09-11T07:06:56.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6089000000000001e-05 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635948+0000", 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010917349 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636143+0000", 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019470199999999999 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636355+0000", 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021144499999999999 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10004 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.131013733000003, 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011952765000000001, 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10004 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625099+0000", 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625118+0000", 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625135+0000", 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7669999999999999e-05 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625150+0000", 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4504e-05 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636471+0000", 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011321278000000001 2024-09-11T07:06:56.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636726+0000", 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025507200000000001 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637051+0000", 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032463099999999998 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130941002999997, 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:56.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:06:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:06:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:06:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:06:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130877886999997, 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:06:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:06:56.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:06:56.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130802893999999, 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:06:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:06:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:06:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:06:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:06:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:06:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:06:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:06:56.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:06:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:06:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:06:56.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130738338, 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:06:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:06:56.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130683109000003, 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.804 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:06:56.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130629212000002, 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:06:56.808 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.812 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130568713000002, 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:06:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130512699999997, 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:06:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:06:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130433347, 2024-09-11T07:06:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:06:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:06:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130377043999999, 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130304604999999, 2024-09-11T07:06:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130248485000003, 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:06:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130175018999999, 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.130096625999997, 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.220920612, 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:06:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:06:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:06:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:56.853 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:56.854 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:06:56.858 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:06:56.858 INFO:teuthology.orchestra.run.smithi079.stderr:marked out osd.0. 2024-09-11T07:06:56.896 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:56.893+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:56.956 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:56.953+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:57.026 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:57.026 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:57.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.026 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:55457 3.12 3.fed32bb2 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e70)", 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:56.923937+0000", 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.102428361, 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.10247022, 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for peered", 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 55457 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:56.923937+0000", 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:56.923937+0000", 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:56.923938+0000", 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8800000000000001e-07 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:56.923941+0000", 2024-09-11T07:06:57.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.7840000000000001e-06 2024-09-11T07:06:57.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:56.923952+0000", 2024-09-11T07:06:57.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0754000000000001e-05 2024-09-11T07:06:57.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:56.923958+0000", 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.733e-06 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:56.924062+0000", 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000104149 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:56.924079+0000", 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7418000000000002e-05 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.030 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.031 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.031 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-11T07:06:57.031 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-09-11T07:06:57.031 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:57.040 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:06:57.085 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:57.085+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:57.158 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:57.154+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:57.208 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:57.208 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:06:57.208 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:06:57.208 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:06:57.208 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:57.222 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:06:57.268 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:57.265+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:57.347 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:06:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:06:57.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.276307277000001, 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:06:57.348 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:06:57.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:06:57.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7525 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4898816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.645333665000003, 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058576490000000002, 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7525 2024-09-11T07:06:57.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.356 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:57.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701087+0000", 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018042780000000001 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701093+0000", 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7880000000000003e-06 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701108+0000", 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4409999999999999e-05 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701116+0000", 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2120000000000003e-06 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757734+0000", 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056618467999999998 2024-09-11T07:06:57.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757798+0000", 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3978000000000003e-05 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757860+0000", 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1356e-05 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.850136782, 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.360 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.850080564999999, 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.364 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:06:57.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.368 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26245 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 88064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.847081934999999, 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058494675000000003, 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.369 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26245 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497536+0000", 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.035e-06 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497541+0000", 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9740000000000001e-06 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497557+0000", 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5794000000000002e-05 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497568+0000", 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0879999999999999e-05 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555887+0000", 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058319353999999997 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555952+0000", 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4875999999999993e-05 2024-09-11T07:06:57.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556030+0000", 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7762000000000005e-05 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.847033404000001, 2024-09-11T07:06:57.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:06:57.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:06:57.377 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846980303999999, 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.378 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:06:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846881398999997, 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:06:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846813531000002, 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:06:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:06:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846756997, 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:06:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846704537000001, 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846652908999999, 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:06:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:06:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:06:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846601487000001, 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:06:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:06:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846550393000001, 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:06:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846498433000001, 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:06:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846398919999999, 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:06:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:06:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846340114999997, 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:06:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:06:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846288960999999, 2024-09-11T07:06:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.846232655000001, 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:06:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.839433139999997, 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:06:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:06:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:06:57.440 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:06:57.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:06:57.442 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:57.442+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:57.543 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:57.537+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:57.574 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:57.574 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:06:57.574 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:57.588 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:06:57.644 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:57.641+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:57.707 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:57.707 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:06:57.707 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:06:57.707 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:06:57.707 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:57.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:06:57.744 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:57.745+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:57.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:06:57.846 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:06:57.841+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:06:57.848 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.1764929, 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.849 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:57.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:06:57.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:06:57.853 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.176480759999997, 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:06:57.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:06:57.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:06:57.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.175829809, 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.858 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:06:57.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:06:57.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.175772913000003, 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.862 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:06:57.866 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.175745878999997, 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.867 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:06:57.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.871 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.173202017000001, 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:06:57.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.173179908999998, 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.876 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:06:57.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.173160293999999, 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.885 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.173137388999997, 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:06:57.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:06:57.890 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.172758627999997, 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:06:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:06:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:06:57.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:06:57.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.172727125999998, 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.896 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.900 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.172209850999998, 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:06:57.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:06:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.172185722000002, 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.905 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:06:57.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.909 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.172172396000001, 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.910 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:06:57.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.914 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.171752468000001, 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:06:57.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:06:57.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.171725059000003, 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:06:57.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.923 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.170946055000002, 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:06:57.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.165845926999999, 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.928 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:06:57.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 11.407968594, 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.933 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:06:57.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:06:57.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 11.407794781, 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.941 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:06:57.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:06:57.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:06:57.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:06:57.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:06:57.948 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:06:57.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:06:57.950 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:06:57.951 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:06:57.951 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:06:57.951 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:06:57.952 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:06:57.952 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:06:57.952 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:57.945+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:57.966 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:06:57.967 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:06:57.987 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:06:57.987 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:06:58.008 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:06:58.008 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:06:58.028 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:06:58.028 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:06:58.048 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:06:58.049 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:06:58.051 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:58.046+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:58.066 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:58.067 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:58.081 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:06:58.152 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:58.149+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:58.246 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:58.246 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:58.252 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:58.253+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:58.260 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:06:58.353 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:58.350+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:58.377 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:58.377 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:58.391 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:06:58.476 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:58.474+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:58.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:58.554+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:58.557 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:58.557 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:58.572 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:06:58.657 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:06:58.656+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:06:58.739 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:58.739 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:58.753 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:06:58.800 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:58.798+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:58.859 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:58.854+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:58.888 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:58.888 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:58.892 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:06:58.914 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:06:58.959 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone28 from 0xb87f2e1 (overlap 0x584ce83) to 0x46a3ecf 2024-09-11T07:06:58.959 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:06:58.954+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:06:59.061 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:59.056+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:59.142 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #27, image image_client.0-clone27 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent28 2024-09-11T07:06:59.155 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:59.155 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:59.161 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:59.158+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:06:59.178 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:06:59.268 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:06:59.266+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:06:59.328 INFO:teuthology.orchestra.run.smithi079.stdout:2598 writesame 0xd72db04 thru 0xd73398d data_size 0x1(0x5e8a bytes) 2024-09-11T07:06:59.336 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:59.336 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:59.343 INFO:teuthology.orchestra.run.smithi079.stdout:2601 trunc from 0xd73398e to 0x7a16c54 2024-09-11T07:06:59.355 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:59.355 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:59.364 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:59.360+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:59.366 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:59.366 INFO:teuthology.orchestra.run.smithi079.stdout:2604 write 0x7335c59 thru 0x7342f14 (0xd2bc bytes) 2024-09-11T07:06:59.369 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:06:59.370 INFO:teuthology.orchestra.run.smithi079.stdout:2605 write 0x59c9c8 thru 0x5a359a (0x6bd3 bytes) 2024-09-11T07:06:59.418 INFO:teuthology.orchestra.run.smithi079.stdout:2606 punch from 0x1007207 to 0x100d672, (0x646b bytes) 2024-09-11T07:06:59.418 INFO:teuthology.orchestra.run.smithi079.stdout:2607 read 0x620b7c6 thru 0x621590c (0xa147 bytes) 2024-09-11T07:06:59.418 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:59.427 INFO:teuthology.orchestra.run.smithi079.stdout:2609 writesame 0x911b1be thru 0x9126cbf data_size 0x6(0xbb02 bytes) 2024-09-11T07:06:59.429 INFO:teuthology.orchestra.run.smithi079.stdout:2611 write 0x2475ee2 thru 0x24843fa (0xe519 bytes) 2024-09-11T07:06:59.464 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:59.464+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:59.496 INFO:teuthology.orchestra.run.smithi079.stdout:2613 punch from 0x6e7302d to 0x6e7df36, (0xaf09 bytes) 2024-09-11T07:06:59.496 INFO:teuthology.orchestra.run.smithi079.stdout:2614 read 0x8d75415 thru 0x8d7ce8c (0x7a78 bytes) 2024-09-11T07:06:59.499 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:59.500 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:59.507 INFO:teuthology.orchestra.run.smithi079.stdout:2615 writesame 0xd436689 thru 0xd438281 data_size 0x15(0x1bf9 bytes) 2024-09-11T07:06:59.508 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:59.509 INFO:teuthology.orchestra.run.smithi079.stdout:2619 write 0x9c8a1e3 thru 0x9c91ee9 (0x7d07 bytes) 2024-09-11T07:06:59.510 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:59.510 INFO:teuthology.orchestra.run.smithi079.stdout:2622 read 0x481a339 thru 0x48223b1 (0x8079 bytes) 2024-09-11T07:06:59.511 INFO:teuthology.orchestra.run.smithi079.stdout:2623 punch from 0x340436e to 0x340f1fb, (0xae8d bytes) 2024-09-11T07:06:59.511 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:06:59.511 INFO:teuthology.orchestra.run.smithi079.stdout:2626 read 0x894f75c thru 0x895b6cf (0xbf74 bytes) 2024-09-11T07:06:59.511 INFO:teuthology.orchestra.run.smithi079.stdout:2627 writesame 0x1a1d19d thru 0x1a1f268 data_size 0x2(0x20cc bytes) 2024-09-11T07:06:59.514 INFO:teuthology.orchestra.run.smithi079.stdout:2629 write 0xcf0e92f thru 0xcf14281 (0x5953 bytes) 2024-09-11T07:06:59.516 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:06:59.516 INFO:teuthology.orchestra.run.smithi079.stdout:2631 write 0x6c08505 thru 0x6c17290 (0xed8c bytes) 2024-09-11T07:06:59.565 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:06:59.564+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:06:59.575 INFO:teuthology.orchestra.run.smithi079.stdout:2635 read 0x5c6561 thru 0x5cae90 (0x4930 bytes) 2024-09-11T07:06:59.575 INFO:teuthology.orchestra.run.smithi079.stdout:2636 punch from 0x47773ed to 0x4781c5d, (0xa870 bytes) 2024-09-11T07:06:59.575 INFO:teuthology.orchestra.run.smithi079.stdout:2637 read 0xcba573b thru 0xcbaedfd (0x96c3 bytes) 2024-09-11T07:06:59.584 INFO:teuthology.orchestra.run.smithi079.stdout:2639 write 0xde017b8 thru 0xde0c513 (0xad5c bytes) 2024-09-11T07:06:59.586 INFO:teuthology.orchestra.run.smithi079.stdout:2640 read 0xb74bb48 thru 0xb75b909 (0xfdc2 bytes) 2024-09-11T07:06:59.586 INFO:teuthology.orchestra.run.smithi079.stdout:2641 write 0x3ad97e8 thru 0x3adcb20 (0x3339 bytes) 2024-09-11T07:06:59.650 INFO:teuthology.orchestra.run.smithi079.stdout:2642 read 0x3cbb753 thru 0x3cbe851 (0x30ff bytes) 2024-09-11T07:06:59.650 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:59.651 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:59.651 INFO:teuthology.orchestra.run.smithi079.stdout:2643 punch from 0x4688ba to 0x46dcb5, (0x53fb bytes) 2024-09-11T07:06:59.651 INFO:teuthology.orchestra.run.smithi079.stdout:2644 write 0x62e2f9 thru 0x63d6ab (0xf3b3 bytes) 2024-09-11T07:06:59.654 INFO:teuthology.orchestra.run.smithi079.stdout:2645 clone 30 order 19 su 16384 sc 4 2024-09-11T07:06:59.665 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:06:59.666 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:59.662+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:59.767 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:06:59.764+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:06:59.826 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:06:59.826 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:06:59.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:06:59.869 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:06:59.866+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:06:59.895 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:06:59.976 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:06:59.974+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:00.012 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:00.012 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:00.027 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:00.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:00.076 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:00.076+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:00.156 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:00.171 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:00.166+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:00.206 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:00.207 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:00.223 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:00.223 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:00.239 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:00.239 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:00.255 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:00.256 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:00.272 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:00.272+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:00.273 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:00.274 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:00.290 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:00.291 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:00.311 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:00.311 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:00.328 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:00.328 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:00.328 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:00.328 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:00.329 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:00.331 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:00.331 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:00.343 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:00.384 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:00.384+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:00.474 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:00.470+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:00.507 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.195462532999997, 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.508 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:07:00.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:07:00.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.512 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.195394979, 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.513 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:07:00.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:07:00.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.517 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.195314142000001, 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:07:00.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:07:00.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.195270796000003, 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:07:00.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:07:00.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.526 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.195200671000002, 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:07:00.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:07:00.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:00.531 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.195132547, 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:07:00.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.195092080999999, 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.536 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:07:00.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.540 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.195054040000002, 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:07:00.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.195015069999997, 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.545 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:07:00.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.194974195999997, 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:00.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:00.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:07:00.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.194646423000002, 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:00.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:07:00.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.194579912999998, 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:07:00.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:07:00.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.194512193999998, 2024-09-11T07:07:00.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:07:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.566 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:07:00.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.572 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.194467256000003, 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.573 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:07:00.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:07:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:07:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:07:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:07:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:07:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:07:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:07:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:07:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.579 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.193667630999997, 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:07:00.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:07:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:07:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:07:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:07:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.193633288999997, 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:07:00.585 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:07:00.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:07:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:07:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:07:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:07:00.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:07:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:07:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:07:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:07:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.590 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.193270613999999, 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:07:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:07:00.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:00.596 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.192007588999999, 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:07:00.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:07:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:07:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:07:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:07:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.601 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.19197509, 2024-09-11T07:07:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:07:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.602 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:07:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:07:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:07:00.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:07:00.607 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.255369663000003, 2024-09-11T07:07:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:07:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:07:00.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:07:00.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:07:00.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:07:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:07:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:07:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:07:00.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:00.615 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:00.615 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:00.617 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:00.617 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:00.616+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:00.717 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:00.714+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:00.787 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:00.787 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:00.787 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:00.801 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:00.848 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:00.848+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:00.919 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:00.916+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:00.928 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:00.928 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:00.928 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:00.928 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:00.929 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:00.943 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:00.973 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone29 from 0xde0c514 (overlap 0x7a16c54) to 0x4940dcc 2024-09-11T07:07:01.029 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:01.028+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:01.121 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:01.120+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.809656183000001, 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.133 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:07:01.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:07:01.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:07:01.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9997 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 180224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.507041211999997, 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010421191999999999, 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9997 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:07:01.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624848+0000", 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624854+0000", 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2330000000000003e-06 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624873+0000", 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8770000000000002e-05 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624887+0000", 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.437e-05 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.634868+0000", 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0099809489999999994 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635065+0000", 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196622 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635268+0000", 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020319500000000001 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10000 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:07:01.143 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506980753000001, 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010963796, 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10000 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624909+0000", 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.68e-06 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624915+0000", 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.003e-06 2024-09-11T07:07:01.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624939+0000", 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4386999999999999e-05 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624953+0000", 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.419e-05 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635384+0000", 2024-09-11T07:07:01.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010430356 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635653+0000", 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026916499999999998 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635871+0000", 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021801500000000001 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.147 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10002 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506914737000002, 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011381399, 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10002 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624974+0000", 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2640000000000001e-06 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624994+0000", 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9826e-05 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625015+0000", 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0724e-05 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625031+0000", 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6089000000000001e-05 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635948+0000", 2024-09-11T07:07:01.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010917349 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636143+0000", 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019470199999999999 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636355+0000", 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021144499999999999 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.151 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10004 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506789818000001, 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011952765000000001, 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10004 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625099+0000", 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625118+0000", 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625135+0000", 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7669999999999999e-05 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625150+0000", 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4504e-05 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636471+0000", 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011321278000000001 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636726+0000", 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025507200000000001 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637051+0000", 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032463099999999998 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506717088000002, 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:01.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506653972000002, 2024-09-11T07:07:01.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:07:01.164 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506578978999997, 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.165 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:07:01.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.169 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506514422999999, 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:01.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:07:01.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506459194000001, 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.174 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:01.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506405297000001, 2024-09-11T07:07:01.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:07:01.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:07:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:07:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:07:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:07:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:07:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:07:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.184 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506344798000001, 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.185 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:07:01.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506288785000002, 2024-09-11T07:07:01.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:01.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.193 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506209431999999, 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:07:01.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506153128999998, 2024-09-11T07:07:01.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:07:01.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.202 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506080689999997, 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.203 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:01.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.506024570000001, 2024-09-11T07:07:01.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:07:01.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:07:01.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.505951103999998, 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:07:01.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:07:01.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.505872711000002, 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.596696696999999, 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:07:01.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.224 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.225 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.225 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:01.226 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:01.227 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:01.224+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:01.327 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #28, image image_client.0-clone28 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent29 2024-09-11T07:07:01.328 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:01.322+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:01.416 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:01.416 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:01.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.416 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59863 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409243+0000", 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0034724349999999998, 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035009899999999998, 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59863 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409243+0000", 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409243+0000", 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409244+0000", 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.097e-06 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409249+0000", 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6269999999999997e-06 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409268+0000", 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8473000000000001e-05 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409282+0000", 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3862e-05 2024-09-11T07:07:01.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59864 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409301+0000", 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0034140260000000001, 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035101289999999999, 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59864 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409301+0000", 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409301+0000", 2024-09-11T07:07:01.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409302+0000", 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409308+0000", 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2900000000000002e-06 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409324+0000", 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6855999999999999e-05 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409339+0000", 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4343e-05 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59865 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.423 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409355+0000", 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0033601709999999999, 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035157000000000001, 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59865 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409355+0000", 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409355+0000", 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409356+0000", 2024-09-11T07:07:01.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.017e-06 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409361+0000", 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9130000000000002e-06 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409378+0000", 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7350000000000002e-05 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409392+0000", 2024-09-11T07:07:01.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3540000000000001e-05 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59872 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409461+0000", 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0032546760000000002, 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034699610000000001, 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59872 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409461+0000", 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409461+0000", 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409462+0000", 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.826e-06 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409473+0000", 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0467e-05 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409506+0000", 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3321999999999997e-05 2024-09-11T07:07:01.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409527+0000", 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1138999999999999e-05 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59888 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409559+0000", 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0031560960000000002, 2024-09-11T07:07:01.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034420050000000002, 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59888 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409559+0000", 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409559+0000", 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409561+0000", 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5799999999999999e-06 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409568+0000", 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4900000000000003e-06 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409589+0000", 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0780000000000001e-05 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409605+0000", 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5749000000000001e-05 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59891 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409626+0000", 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0030891099999999999, 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003436326, 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59891 2024-09-11T07:07:01.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409626+0000", 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409626+0000", 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409627+0000", 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3060000000000001e-06 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409634+0000", 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1369999999999999e-06 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409654+0000", 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0146e-05 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409668+0000", 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4800000000000001e-05 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59893 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409687+0000", 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.003027919, 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034327450000000001, 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.437 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59893 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409687+0000", 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409687+0000", 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409689+0000", 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3430000000000001e-06 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409721+0000", 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2802999999999997e-05 2024-09-11T07:07:01.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409742+0000", 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0423000000000001e-05 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409757+0000", 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5420000000000001e-05 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59898 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409778+0000", 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0029367939999999999, 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033997070000000001, 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59898 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.441 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409778+0000", 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409778+0000", 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409780+0000", 2024-09-11T07:07:01.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3200000000000001e-06 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409786+0000", 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3330000000000002e-06 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409805+0000", 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9312000000000001e-05 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409820+0000", 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4440000000000001e-05 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59899 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409869+0000", 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0028463799999999999, 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033669390000000002, 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59899 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409869+0000", 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409869+0000", 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409870+0000", 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5e-06 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409877+0000", 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3430000000000001e-06 2024-09-11T07:07:01.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409897+0000", 2024-09-11T07:07:01.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.995e-05 2024-09-11T07:07:01.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409926+0000", 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9669e-05 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59910 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409949+0000", 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.002765942, 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033464179999999999, 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.448 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59910 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409949+0000", 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409949+0000", 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409951+0000", 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5069999999999999e-06 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409957+0000", 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5400000000000001e-06 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409977+0000", 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9956e-05 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409992+0000", 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4506e-05 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59915 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.451 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410011+0000", 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00270397, 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003342416, 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59915 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410011+0000", 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410011+0000", 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410013+0000", 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3659999999999999e-06 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410019+0000", 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1500000000000004e-06 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410037+0000", 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8677000000000001e-05 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410051+0000", 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3382e-05 2024-09-11T07:07:01.454 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59916 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410069+0000", 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0026464879999999998, 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003343553, 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59916 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410069+0000", 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410069+0000", 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410070+0000", 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3400000000000001e-06 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410076+0000", 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8629999999999996e-06 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410095+0000", 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8986000000000001e-05 2024-09-11T07:07:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410109+0000", 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4127e-05 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59925 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410127+0000", 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0025884229999999999, 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003342505, 2024-09-11T07:07:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59925 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410127+0000", 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410127+0000", 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410128+0000", 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.22e-06 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410134+0000", 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1129999999999997e-06 2024-09-11T07:07:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410153+0000", 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8536999999999999e-05 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410166+0000", 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3556e-05 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59772 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408039+0000", 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0046757580000000003, 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054878720000000004, 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59772 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408039+0000", 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408039+0000", 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408040+0000", 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.47e-07 2024-09-11T07:07:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408046+0000", 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2830000000000001e-06 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408063+0000", 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6855999999999999e-05 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408076+0000", 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3756e-05 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59926 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410185+0000", 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0025301780000000001, 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003399867, 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59926 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410185+0000", 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410185+0000", 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410186+0000", 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410192+0000", 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8830000000000003e-06 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410211+0000", 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8885999999999998e-05 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410225+0000", 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3617e-05 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59931 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410305+0000", 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0024103610000000002, 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033375620000000001, 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59931 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410305+0000", 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410305+0000", 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410306+0000", 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4470000000000001e-06 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410313+0000", 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5470000000000002e-06 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410334+0000", 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1505000000000002e-05 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410350+0000", 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5673999999999999e-05 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59777 3.d 3:b7706042:::rbd_data.11616c31e2ad.0000000000000002:1e [read 1835008~32768] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408173+0000", 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0045420149999999999, 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055328399999999998, 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59777 2024-09-11T07:07:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408173+0000", 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408173+0000", 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408175+0000", 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5069999999999999e-06 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408202+0000", 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6849e-05 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408222+0000", 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0055999999999999e-05 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408237+0000", 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.52e-05 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.413576+0000", 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0053391300000000001 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59932 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410371+0000", 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0023439989999999998, 2024-09-11T07:07:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034103480000000001, 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59932 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410371+0000", 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410371+0000", 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410373+0000", 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8729999999999999e-06 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410379+0000", 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9699999999999996e-06 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410398+0000", 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9357000000000001e-05 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410412+0000", 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4076e-05 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59787 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408257+0000", 2024-09-11T07:07:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0044584730000000001, 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0055834120000000003, 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59787 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408257+0000", 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408257+0000", 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408258+0000", 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408264+0000", 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6869999999999999e-06 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408282+0000", 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8255999999999999e-05 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408295+0000", 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3403e-05 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59942 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410443+0000", 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0022719440000000001, 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034548460000000001, 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59942 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410443+0000", 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410443+0000", 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410445+0000", 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3170000000000001e-06 2024-09-11T07:07:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410450+0000", 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8590000000000001e-06 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410473+0000", 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2169999999999999e-05 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410487+0000", 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4005999999999999e-05 2024-09-11T07:07:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59788 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408313+0000", 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0044017650000000002, 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0056421580000000004, 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59788 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408313+0000", 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408313+0000", 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408315+0000", 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1370000000000001e-06 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408321+0000", 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408339+0000", 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8669999999999999e-05 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408353+0000", 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3699e-05 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59944 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410506+0000", 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0022095320000000002, 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035078230000000002, 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59944 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410506+0000", 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410506+0000", 2024-09-11T07:07:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410507+0000", 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1659999999999999e-06 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410513+0000", 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8900000000000004e-06 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410532+0000", 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9156000000000001e-05 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410546+0000", 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4250000000000001e-05 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59798 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408370+0000", 2024-09-11T07:07:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0043451560000000002, 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0057016419999999998, 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59798 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408370+0000", 2024-09-11T07:07:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408370+0000", 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408371+0000", 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0669999999999999e-06 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408378+0000", 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5629999999999997e-06 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408395+0000", 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7408999999999999e-05 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408409+0000", 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3953e-05 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59946 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410565+0000", 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.002150374, 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0035642389999999999, 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59946 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410565+0000", 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410565+0000", 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410566+0000", 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.217e-06 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410597+0000", 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1083e-05 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410643+0000", 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6254999999999997e-05 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410700+0000", 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6388000000000003e-05 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59799 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408426+0000", 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0042895540000000001, 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.005761614, 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59799 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408426+0000", 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408426+0000", 2024-09-11T07:07:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408427+0000", 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0130000000000001e-06 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408431+0000", 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6630000000000001e-06 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408449+0000", 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7822999999999999e-05 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408463+0000", 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3550000000000001e-05 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59951 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410802+0000", 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0019132890000000001, 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00344276, 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59951 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410802+0000", 2024-09-11T07:07:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410802+0000", 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410804+0000", 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0930000000000001e-06 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410812+0000", 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9699999999999999e-06 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410834+0000", 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2169000000000001e-05 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410861+0000", 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6721999999999999e-05 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59803 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408479+0000", 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0042364519999999999, 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058237219999999999, 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59803 2024-09-11T07:07:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408479+0000", 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408479+0000", 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408480+0000", 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408486+0000", 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7699999999999998e-06 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408504+0000", 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8410000000000002e-05 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408519+0000", 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5203e-05 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59967 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.410876+0000", 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001838711, 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034845140000000002, 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59967 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410876+0000", 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410876+0000", 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410878+0000", 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0759999999999999e-06 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410883+0000", 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5339999999999999e-06 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410923+0000", 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.0164999999999999e-05 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.410991+0000", 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7387999999999999e-05 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59804 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408589+0000", 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0041257150000000003, 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058291489999999996, 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59804 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408589+0000", 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408589+0000", 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408591+0000", 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.336e-06 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408597+0000", 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3239999999999999e-06 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408617+0000", 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9673e-05 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408632+0000", 2024-09-11T07:07:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5189e-05 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59969 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.411033+0000", 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001682469, 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034432379999999999, 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59969 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411033+0000", 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411033+0000", 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411034+0000", 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4470000000000001e-06 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411101+0000", 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6911999999999999e-05 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411137+0000", 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6219e-05 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411169+0000", 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1983000000000002e-05 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59810 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408651+0000", 2024-09-11T07:07:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0040644000000000001, 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0058833829999999998, 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59810 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408651+0000", 2024-09-11T07:07:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408651+0000", 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408652+0000", 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3340000000000001e-06 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408658+0000", 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8699999999999997e-06 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408675+0000", 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7105e-05 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408693+0000", 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7839999999999999e-05 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59971 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.411212+0000", 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0015028999999999999, 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033791820000000001, 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59971 2024-09-11T07:07:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411212+0000", 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411212+0000", 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411214+0000", 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6139999999999999e-06 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411221+0000", 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4259999999999997e-06 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411261+0000", 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9481999999999999e-05 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411277+0000", 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6597000000000001e-05 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59812 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408709+0000", 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0040062250000000004, 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.005940295, 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59812 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408709+0000", 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408709+0000", 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408710+0000", 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.11e-06 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408715+0000", 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9230000000000001e-06 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408731+0000", 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6480000000000001e-05 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408746+0000", 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4197e-05 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59973 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.411322+0000", 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001393055, 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0033846340000000001, 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59973 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411322+0000", 2024-09-11T07:07:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411322+0000", 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411324+0000", 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.809e-06 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411330+0000", 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0399999999999998e-06 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411348+0000", 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8434e-05 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411363+0000", 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4562000000000001e-05 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59824 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408763+0000", 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0039521529999999999, 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060492230000000003, 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59824 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408763+0000", 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408763+0000", 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408764+0000", 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.17e-06 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408770+0000", 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.48e-06 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408787+0000", 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.715e-05 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408799+0000", 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2133000000000001e-05 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59979 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.411396+0000", 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0013188360000000001, 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.003475377, 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "no flag points reached", 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59979 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411396+0000", 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411396+0000", 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411398+0000", 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3939999999999999e-06 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411403+0000", 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6509999999999998e-06 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.411423+0000", 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0034000000000002e-05 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59828 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408816+0000", 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0038989340000000002, 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.006107169, 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59828 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408816+0000", 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408816+0000", 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408817+0000", 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1170000000000001e-06 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408823+0000", 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5060000000000003e-06 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408840+0000", 2024-09-11T07:07:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7153e-05 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408857+0000", 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7142999999999998e-05 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59836 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408873+0000", 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.003841732, 2024-09-11T07:07:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0061143480000000004, 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59836 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408873+0000", 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408873+0000", 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408875+0000", 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1230000000000001e-06 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408880+0000", 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4399999999999996e-06 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408897+0000", 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6793e-05 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408911+0000", 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.375e-05 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59837 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.408948+0000", 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0037674900000000001, 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060978020000000003, 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59837 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408948+0000", 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408948+0000", 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408949+0000", 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.449e-06 2024-09-11T07:07:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408955+0000", 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.408973+0000", 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7856e-05 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409005+0000", 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2085999999999997e-05 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59839 3.d 3.42060eed (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409024+0000", 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.003691106, 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060819239999999998, 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59839 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409024+0000", 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409024+0000", 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409025+0000", 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2240000000000001e-06 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409031+0000", 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0360000000000003e-06 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409050+0000", 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8953e-05 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409065+0000", 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.484e-05 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59856 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409083+0000", 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0036318840000000002, 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060812399999999999, 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59856 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409083+0000", 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409083+0000", 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409085+0000", 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2270000000000001e-06 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409090+0000", 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409108+0000", 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7408999999999999e-05 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409122+0000", 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.378e-05 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59857 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409137+0000", 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0035777579999999999, 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060878670000000003, 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59857 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409137+0000", 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409137+0000", 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409139+0000", 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0729999999999999e-06 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409143+0000", 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6929999999999998e-06 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409161+0000", 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7336000000000001e-05 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409174+0000", 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3033e-05 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.557 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:59861 3.15 3.b6dd7a95 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:01.409190+0000", 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0035252299999999999, 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0060927619999999998, 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.558 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 59861 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409190+0000", 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409190+0000", 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409191+0000", 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409196+0000", 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9899999999999997e-06 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409213+0000", 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7102999999999999e-05 2024-09-11T07:07:01.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:01.409226+0000", 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3152999999999999e-05 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 43 2024-09-11T07:07:01.561 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:01.563 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:01.563 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:01.558+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:01.629 INFO:teuthology.orchestra.run.smithi079.stdout:2646 trunc from 0xde0c514 to 0x8ae5034 2024-09-11T07:07:01.663 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:01.658+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:01.666 INFO:teuthology.orchestra.run.smithi079.stdout:2647 punch from 0x1ee9534 to 0x1eecec3, (0x398f bytes) 2024-09-11T07:07:01.684 INFO:teuthology.orchestra.run.smithi079.stdout:2649 write 0xd3c75ec thru 0xd3d45be (0xcfd3 bytes) 2024-09-11T07:07:01.696 INFO:teuthology.orchestra.run.smithi079.stdout:2650 write 0xbd25a9 thru 0xbda0e8 (0x7b40 bytes) 2024-09-11T07:07:01.697 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:01.697 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:01.697 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:01.697 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:01.697 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:01.716 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:01.723 INFO:teuthology.orchestra.run.smithi079.stdout:2651 punch from 0x699951f to 0x69a4d91, (0xb872 bytes) 2024-09-11T07:07:01.723 INFO:teuthology.orchestra.run.smithi079.stdout:2652 writesame 0x6dfba4 thru 0x6e8e22 data_size 0x1b(0x927f bytes) 2024-09-11T07:07:01.751 INFO:teuthology.orchestra.run.smithi079.stdout:2653 write 0xbbbb8f5 thru 0xbbca40b (0xeb17 bytes) 2024-09-11T07:07:01.763 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:01.758+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:01.785 INFO:teuthology.orchestra.run.smithi079.stdout:2656 trunc from 0xd3d45bf to 0x173060d 2024-09-11T07:07:01.825 INFO:teuthology.orchestra.run.smithi079.stdout:2657 punch from 0xa38b5e to 0xa40687, (0x7b29 bytes) 2024-09-11T07:07:01.825 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:01.850 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:01.850 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.780962251999995, 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:07:01.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:07:01.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:07:01.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:01.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:01.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7525 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4898816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.149988639999997, 2024-09-11T07:07:01.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058576490000000002, 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7525 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701087+0000", 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018042780000000001 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701093+0000", 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7880000000000003e-06 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701108+0000", 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4409999999999999e-05 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701116+0000", 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2120000000000003e-06 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757734+0000", 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056618467999999998 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757798+0000", 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3978000000000003e-05 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757860+0000", 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1356e-05 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.354791757000001, 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:07:01.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.35473554, 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26245 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 88064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.35173691, 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058494675000000003, 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26245 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.871 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497536+0000", 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.035e-06 2024-09-11T07:07:01.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497541+0000", 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9740000000000001e-06 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497557+0000", 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5794000000000002e-05 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497568+0000", 2024-09-11T07:07:01.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0879999999999999e-05 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555887+0000", 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058319353999999997 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555952+0000", 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4875999999999993e-05 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556030+0000", 2024-09-11T07:07:01.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7762000000000005e-05 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351688379000002, 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.875 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:07:01.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.879 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351635279, 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:07:01.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351536373999998, 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.884 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:07:01.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351468506000003, 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.892 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351411972000001, 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:07:01.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:07:01.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:07:01.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:07:01.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351359512000002, 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.901 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351307884000001, 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:07:01.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.905 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351256462000002, 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.906 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:07:01.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:07:01.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351205368000002, 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:07:01.910 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:07:01.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351153408000002, 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.915 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:07:01.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.351053895, 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.919 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:07:01.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:07:01.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.350995089999998, 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:07:01.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:07:01.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:07:01.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.350943936, 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:07:01.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.350887630000003, 2024-09-11T07:07:01.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:07:01.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.344088114999998, 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.937 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.940 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:01.941 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:01.941 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:01.941 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:07:01.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T07:07:01.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:07:01.943 INFO:teuthology.orchestra.run.smithi079.stdout:2659 write 0xa72ce01 thru 0xa7395b3 (0xc7b3 bytes) 2024-09-11T07:07:01.943 INFO:teuthology.orchestra.run.smithi079.stdout:2660 trunc from 0xa7395b4 to 0x340dd1a 2024-09-11T07:07:01.943 INFO:teuthology.orchestra.run.smithi079.stdout:2661 write 0xe21b34b thru 0xe220f4b (0x5c01 bytes) 2024-09-11T07:07:01.943 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:01.938+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:01.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:01.946 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:01.946 INFO:teuthology.orchestra.run.smithi079.stdout:2663 write 0x5344bcf thru 0x534d197 (0x85c9 bytes) 2024-09-11T07:07:01.956 INFO:teuthology.orchestra.run.smithi079.stdout:2664 read 0xc2f9be thru 0xc37a89 (0x80cc bytes) 2024-09-11T07:07:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:01.958 INFO:teuthology.orchestra.run.smithi079.stdout:2666 writesame 0xa8bd689 thru 0xa8c9940 data_size 0x86(0xc2b8 bytes) 2024-09-11T07:07:01.968 INFO:teuthology.orchestra.run.smithi079.stdout:2667 read 0x56f3fac thru 0x56f7ea6 (0x3efb bytes) 2024-09-11T07:07:01.968 INFO:teuthology.orchestra.run.smithi079.stdout:2669 write 0xaeb8d4e thru 0xaec37a6 (0xaa59 bytes) 2024-09-11T07:07:01.978 INFO:teuthology.orchestra.run.smithi079.stdout:2670 read 0x48a4ceb thru 0x48a4f86 (0x29c bytes) 2024-09-11T07:07:01.978 INFO:teuthology.orchestra.run.smithi079.stdout:2671 write 0x4a6a9 thru 0x53c13 (0x956b bytes) 2024-09-11T07:07:02.003 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.011 INFO:teuthology.orchestra.run.smithi079.stdout:2675 trunc from 0xe220f4c to 0x94661f0 2024-09-11T07:07:02.037 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.038 INFO:teuthology.orchestra.run.smithi079.stdout:2678 trunc from 0x94661f0 to 0xa23565d 2024-09-11T07:07:02.043 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:02.038+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:02.050 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.051 INFO:teuthology.orchestra.run.smithi079.stdout:2680 read 0x1ce6bdd thru 0x1cf44a5 (0xd8c9 bytes) 2024-09-11T07:07:02.070 INFO:teuthology.orchestra.run.smithi079.stdout:2682 write 0xe2d9abb thru 0xe2dce72 (0x33b8 bytes) 2024-09-11T07:07:02.077 INFO:teuthology.orchestra.run.smithi079.stdout:2684 read 0xb8b53f8 thru 0xb8c392f (0xe538 bytes) 2024-09-11T07:07:02.077 INFO:teuthology.orchestra.run.smithi079.stdout:2687 read 0xc7b5274 thru 0xc7bfe19 (0xaba6 bytes) 2024-09-11T07:07:02.077 INFO:teuthology.orchestra.run.smithi079.stdout:2688 writesame 0xc6bb925 thru 0xc6c37de data_size 0x3(0x7eba bytes) 2024-09-11T07:07:02.088 INFO:teuthology.orchestra.run.smithi079.stdout:2689 writesame 0x8c148a8 thru 0x8c14f01 data_size 0x3(0x65a bytes) 2024-09-11T07:07:02.094 INFO:teuthology.orchestra.run.smithi079.stdout:2690 read 0xb0df920 thru 0xb0e3a01 (0x40e2 bytes) 2024-09-11T07:07:02.094 INFO:teuthology.orchestra.run.smithi079.stdout:2691 punch from 0x3951b79 to 0x395d07d, (0xb504 bytes) 2024-09-11T07:07:02.094 INFO:teuthology.orchestra.run.smithi079.stdout:2692 punch from 0x7c0435a to 0x7c04517, (0x1bd bytes) 2024-09-11T07:07:02.094 INFO:teuthology.orchestra.run.smithi079.stdout:2693 punch from 0x2ed1f0 to 0x2edc5e, (0xa6e bytes) 2024-09-11T07:07:02.094 INFO:teuthology.orchestra.run.smithi079.stdout:2694 writesame 0x1584863 thru 0x15912f3 data_size 0x1(0xca91 bytes) 2024-09-11T07:07:02.110 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:02.110 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:02.110 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:02.110 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:02.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:02.145 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:02.144+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:02.170 INFO:teuthology.orchestra.run.smithi079.stdout:2696 read 0x5a10ace thru 0x5a1757f (0x6ab2 bytes) 2024-09-11T07:07:02.170 INFO:teuthology.orchestra.run.smithi079.stdout:2698 punch from 0x2410562 to 0x241ad5f, (0xa7fd bytes) 2024-09-11T07:07:02.170 INFO:teuthology.orchestra.run.smithi079.stdout:2699 write 0x8500e3f thru 0x85032fa (0x24bc bytes) 2024-09-11T07:07:02.175 INFO:teuthology.orchestra.run.smithi079.stdout:2700 writesame 0x3100381 thru 0x3102940 data_size 0x20(0x25c0 bytes) 2024-09-11T07:07:02.181 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.181 INFO:teuthology.orchestra.run.smithi079.stdout:2702 writesame 0x995515c thru 0x99590ea data_size 0x1(0x3f8f bytes) 2024-09-11T07:07:02.201 INFO:teuthology.orchestra.run.smithi079.stdout:2703 punch from 0x759865 to 0x75c607, (0x2da2 bytes) 2024-09-11T07:07:02.201 INFO:teuthology.orchestra.run.smithi079.stdout:2704 read 0x19b0deb thru 0x19b4312 (0x3528 bytes) 2024-09-11T07:07:02.201 INFO:teuthology.orchestra.run.smithi079.stdout:2705 write 0x9e1a6e0 thru 0x9e24ce1 (0xa602 bytes) 2024-09-11T07:07:02.212 INFO:teuthology.orchestra.run.smithi079.stdout:2706 read 0xafe4729 thru 0xafe9f59 (0x5831 bytes) 2024-09-11T07:07:02.212 INFO:teuthology.orchestra.run.smithi079.stdout:2707 punch from 0xaf07782 to 0xaf13310, (0xbb8e bytes) 2024-09-11T07:07:02.212 INFO:teuthology.orchestra.run.smithi079.stdout:2709 writesame 0x5cea69a thru 0x5cf5a72 data_size 0x67(0xb3d9 bytes) 2024-09-11T07:07:02.219 INFO:teuthology.orchestra.run.smithi079.stdout:2710 write 0xb38a828 thru 0xb38b2be (0xa97 bytes) 2024-09-11T07:07:02.225 INFO:teuthology.orchestra.run.smithi079.stdout:2711 punch from 0x56a0ccf to 0x56a4303, (0x3634 bytes) 2024-09-11T07:07:02.225 INFO:teuthology.orchestra.run.smithi079.stdout:2712 read 0xba76f94 thru 0xba7cd5e (0x5dcb bytes) 2024-09-11T07:07:02.225 INFO:teuthology.orchestra.run.smithi079.stdout:2713 read 0x2b06e25 thru 0x2b0bbc8 (0x4da4 bytes) 2024-09-11T07:07:02.225 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.225 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.225 INFO:teuthology.orchestra.run.smithi079.stdout:2717 read 0x65f0474 thru 0x65f8590 (0x811d bytes) 2024-09-11T07:07:02.225 INFO:teuthology.orchestra.run.smithi079.stdout:2718 write 0x8e241a7 thru 0x8e314b6 (0xd310 bytes) 2024-09-11T07:07:02.236 INFO:teuthology.orchestra.run.smithi079.stdout:2720 trunc from 0xe2dce73 to 0xd0aa860 2024-09-11T07:07:02.245 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:02.242+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:02.255 INFO:teuthology.orchestra.run.smithi079.stdout:2721 write 0x187138d thru 0x18715e2 (0x256 bytes) 2024-09-11T07:07:02.260 INFO:teuthology.orchestra.run.smithi079.stdout:2722 read 0x50ecd5c thru 0x50fb078 (0xe31d bytes) 2024-09-11T07:07:02.260 INFO:teuthology.orchestra.run.smithi079.stdout:2724 read 0x87f4c30 thru 0x87fe0d6 (0x94a7 bytes) 2024-09-11T07:07:02.260 INFO:teuthology.orchestra.run.smithi079.stdout:2726 write 0x14b9bec thru 0x14bd252 (0x3667 bytes) 2024-09-11T07:07:02.263 INFO:teuthology.orchestra.run.smithi079.stdout:2727 read 0x5a570a1 thru 0x5a577ec (0x74c bytes) 2024-09-11T07:07:02.263 INFO:teuthology.orchestra.run.smithi079.stdout:2728 writesame 0x94c232c thru 0x94c5b16 data_size 0x7(0x37eb bytes) 2024-09-11T07:07:02.269 INFO:teuthology.orchestra.run.smithi079.stdout:2729 writesame 0x3c1bac6 thru 0x3c21e67 data_size 0x4e(0x63a2 bytes) 2024-09-11T07:07:02.278 INFO:teuthology.orchestra.run.smithi079.stdout:2731 punch from 0x510bc98 to 0x5112217, (0x657f bytes) 2024-09-11T07:07:02.291 INFO:teuthology.orchestra.run.smithi079.stdout:2732 write 0xd6f4321 thru 0xd6fd14a (0x8e2a bytes) 2024-09-11T07:07:02.299 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:02.299 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:02.299 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:02.299 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:02.299 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:02.314 INFO:teuthology.orchestra.run.smithi079.stdout:2733 write 0xebd5c00 thru 0xebe2d5c (0xd15d bytes) 2024-09-11T07:07:02.316 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:02.324 INFO:teuthology.orchestra.run.smithi079.stdout:2734 read 0xbe656f4 thru 0xbe6fed5 (0xa7e2 bytes) 2024-09-11T07:07:02.324 INFO:teuthology.orchestra.run.smithi079.stdout:2735 read 0xbde6b5c thru 0xbdf4e82 (0xe327 bytes) 2024-09-11T07:07:02.333 INFO:teuthology.orchestra.run.smithi079.stdout:2736 trunc from 0xebe2d5d to 0x8aef1d5 2024-09-11T07:07:02.346 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:02.344+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:02.349 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:02.363 INFO:teuthology.orchestra.run.smithi079.stdout:2738 punch from 0x844c836 to 0x8450038, (0x3802 bytes) 2024-09-11T07:07:02.363 INFO:teuthology.orchestra.run.smithi079.stdout:2739 read 0x2ae9175 thru 0x2af7856 (0xe6e2 bytes) 2024-09-11T07:07:02.363 INFO:teuthology.orchestra.run.smithi079.stdout:2740 write 0x250e0f thru 0x2537bd (0x29af bytes) 2024-09-11T07:07:02.386 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.386 INFO:teuthology.orchestra.run.smithi079.stdout:2746 write 0x630a425 thru 0x630f229 (0x4e05 bytes) 2024-09-11T07:07:02.395 INFO:teuthology.orchestra.run.smithi079.stdout:2748 read 0x740da7b thru 0x741a79f (0xcd25 bytes) 2024-09-11T07:07:02.417 INFO:teuthology.orchestra.run.smithi079.stdout:2750 writesame 0xe8470bc thru 0xe848f7b data_size 0x18(0x1ec0 bytes) 2024-09-11T07:07:02.417 INFO:teuthology.orchestra.run.smithi079.stdout:2751 punch from 0xd819ef8 to 0xd827368, (0xd470 bytes) 2024-09-11T07:07:02.417 INFO:teuthology.orchestra.run.smithi079.stdout:2752 write 0xbf5d457 thru 0xbf60f93 (0x3b3d bytes) 2024-09-11T07:07:02.427 INFO:teuthology.orchestra.run.smithi079.stdout:2753 writesame 0x790f072 thru 0x79161e9 data_size 0x4(0x7178 bytes) 2024-09-11T07:07:02.437 INFO:teuthology.orchestra.run.smithi079.stdout:2755 read 0x3356f64 thru 0x335e6e4 (0x7781 bytes) 2024-09-11T07:07:02.437 INFO:teuthology.orchestra.run.smithi079.stdout:2756 read 0xe74255b thru 0xe74da7c (0xb522 bytes) 2024-09-11T07:07:02.438 INFO:teuthology.orchestra.run.smithi079.stdout:2757 read 0x637be90 thru 0x637e9b2 (0x2b23 bytes) 2024-09-11T07:07:02.438 INFO:teuthology.orchestra.run.smithi079.stdout:2759 write 0x53dca87 thru 0x53e385a (0x6dd4 bytes) 2024-09-11T07:07:02.445 INFO:teuthology.orchestra.run.smithi079.stdout:2760 write 0xb3be0db thru 0xb3cc2d5 (0xe1fb bytes) 2024-09-11T07:07:02.447 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:02.444+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:02.454 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.782056791000002, 2024-09-11T07:07:02.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:07:02.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.782044651, 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.459 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:07:02.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:02.463 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.781393700000002, 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:02.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.467 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.781336803999999, 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.468 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:02.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:07:02.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.78130977, 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:07:02.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:07:02.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.778765907999997, 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.477 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:07:02.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.481 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.778743800000001, 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.485 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.778724185000002, 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:07:02.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.77870128, 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.490 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:07:02.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.778322519, 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:07:02.494 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:07:02.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:07:02.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.778291017000001, 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:07:02.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:07:02.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.777773742000001, 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:07:02.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.507 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.777749612999997, 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.508 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:02.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:07:02.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.777736287000003, 2024-09-11T07:07:02.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:02.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:07:02.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.516 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.777316358999997, 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:07:02.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.521 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.777288949999999, 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:07:02.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:07:02.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.526 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.776509945999997, 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:07:02.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.771409818000002, 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.531 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:02.535 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.013532484999999, 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:07:02.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:07:02.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 16.013358671999999, 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:02.543 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:02.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:07:02.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:07:02.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:07:02.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.551 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:02.551 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:02.551 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:02.552 INFO:teuthology.orchestra.run.smithi079.stdout:2761 punch from 0x9595da0 to 0x959e78f, (0x89ef bytes) 2024-09-11T07:07:02.552 INFO:teuthology.orchestra.run.smithi079.stdout:2762 write 0xbf2bfcd thru 0xbf30f77 (0x4fab bytes) 2024-09-11T07:07:02.552 INFO:teuthology.orchestra.run.smithi079.stdout:2763 write 0xa5ca26a thru 0xa5d267b (0x8412 bytes) 2024-09-11T07:07:02.553 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:02.554 INFO:teuthology.orchestra.run.smithi079.stdout:2764 write 0x934a075 thru 0x9355429 (0xb3b5 bytes) 2024-09-11T07:07:02.554 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.554 INFO:teuthology.orchestra.run.smithi079.stdout:2767 read 0xe4b561f thru 0xe4c0769 (0xb14b bytes) 2024-09-11T07:07:02.554 INFO:teuthology.orchestra.run.smithi079.stdout:2768 write 0xd7935e5 thru 0xd7a0ead (0xd8c9 bytes) 2024-09-11T07:07:02.554 INFO:teuthology.orchestra.run.smithi079.stdout:2769 write 0xac4ed76 thru 0xac5b723 (0xc9ae bytes) 2024-09-11T07:07:02.555 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:02.555 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:02.555 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.556 INFO:teuthology.orchestra.run.smithi079.stdout:2772 punch from 0xa8dd235 to 0xa8e24db, (0x52a6 bytes) 2024-09-11T07:07:02.556 INFO:teuthology.orchestra.run.smithi079.stdout:2773 read 0x871b72f thru 0x871f670 (0x3f42 bytes) 2024-09-11T07:07:02.556 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.556 INFO:teuthology.orchestra.run.smithi079.stdout:2776 trunc from 0xe848f7c to 0xaf9dce7 2024-09-11T07:07:02.556 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:02.556 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:02.557 INFO:teuthology.orchestra.run.smithi079.stdout:2777 write 0x78ddd66 thru 0x78e29de (0x4c79 bytes) 2024-09-11T07:07:02.557 INFO:teuthology.orchestra.run.smithi079.stdout:2779 read 0x20512c thru 0x212ba8 (0xda7d bytes) 2024-09-11T07:07:02.557 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:02.557 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:02.558 INFO:teuthology.orchestra.run.smithi079.stdout:2780 read 0x13b488a thru 0x13bb9bb (0x7132 bytes) 2024-09-11T07:07:02.558 INFO:teuthology.orchestra.run.smithi079.stdout:2781 writesame 0xb061fe2 thru 0xb069cb0 data_size 0x1(0x7ccf bytes) 2024-09-11T07:07:02.558 INFO:teuthology.orchestra.run.smithi079.stdout:2782 punch from 0x415f1db to 0x41617f6, (0x261b bytes) 2024-09-11T07:07:02.558 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.558 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:02.559 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:02.559 INFO:teuthology.orchestra.run.smithi079.stdout:2784 trunc from 0xb069cb1 to 0x7416829 2024-09-11T07:07:02.560 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:02.552+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:02.582 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:02.582 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:02.582 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.582 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.583 INFO:teuthology.orchestra.run.smithi079.stdout:2788 write 0x97a71a thru 0x97e063 (0x394a bytes) 2024-09-11T07:07:02.603 INFO:teuthology.orchestra.run.smithi079.stdout:2790 read 0x16db824 thru 0x16ea37c (0xeb59 bytes) 2024-09-11T07:07:02.606 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:02.606 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:02.616 INFO:teuthology.orchestra.run.smithi079.stdout:2791 writesame 0x86058a5 thru 0x860a8ae data_size 0xf(0x500a bytes) 2024-09-11T07:07:02.617 INFO:teuthology.orchestra.run.smithi079.stdout:2792 read 0x2435157 thru 0x24385a8 (0x3452 bytes) 2024-09-11T07:07:02.617 INFO:teuthology.orchestra.run.smithi079.stdout:2795 write 0x3fe6782 thru 0x3fe9b57 (0x33d6 bytes) 2024-09-11T07:07:02.629 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:02.629 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:02.636 INFO:teuthology.orchestra.run.smithi079.stdout:2796 write 0xa04eb9a thru 0xa053c71 (0x50d8 bytes) 2024-09-11T07:07:02.642 INFO:teuthology.orchestra.run.smithi079.stdout:2797 read 0x4ec3a13 thru 0x4ece838 (0xae26 bytes) 2024-09-11T07:07:02.642 INFO:teuthology.orchestra.run.smithi079.stdout:2798 punch from 0x76f02f4 to 0x76f7960, (0x766c bytes) 2024-09-11T07:07:02.653 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:02.652+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:02.655 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:02.655 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:02.661 INFO:teuthology.orchestra.run.smithi079.stdout:2799 writesame 0xe70f907 thru 0xe7199d1 data_size 0x1(0xa0cb bytes) 2024-09-11T07:07:02.661 INFO:teuthology.orchestra.run.smithi079.stdout:2800 writesame 0x4f85e2c thru 0x4f8e358 data_size 0x1(0x852d bytes) 2024-09-11T07:07:02.680 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:02.681 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:02.689 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.689 INFO:teuthology.orchestra.run.smithi079.stdout:2803 read 0x5052c21 thru 0x5062800 (0xfbe0 bytes) 2024-09-11T07:07:02.689 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.690 INFO:teuthology.orchestra.run.smithi079.stdout:2806 write 0x470239a thru 0x47079d3 (0x563a bytes) 2024-09-11T07:07:02.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:02.698 INFO:teuthology.orchestra.run.smithi079.stdout:2807 read 0x42979cd thru 0x42a6e4a (0xf47e bytes) 2024-09-11T07:07:02.698 INFO:teuthology.orchestra.run.smithi079.stdout:2808 write 0x9bb5c80 thru 0x9bc0abc (0xae3d bytes) 2024-09-11T07:07:02.708 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.721 INFO:teuthology.orchestra.run.smithi079.stdout:2811 trunc from 0xe7199d2 to 0x5962ece 2024-09-11T07:07:02.745 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.752 INFO:teuthology.orchestra.run.smithi079.stdout:2814 trunc from 0x5962ece to 0x11614a8 2024-09-11T07:07:02.754 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:02.750+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:02.834 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:02.834 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:02.843 INFO:teuthology.orchestra.run.smithi079.stdout:2815 writesame 0x64f3ff2 thru 0x64fe31c data_size 0x1(0xa32b bytes) 2024-09-11T07:07:02.844 INFO:teuthology.orchestra.run.smithi079.stdout:2818 read 0x9d53b7 thru 0x9d7baa (0x27f4 bytes) 2024-09-11T07:07:02.844 INFO:teuthology.orchestra.run.smithi079.stdout:2819 punch from 0x13057aa to 0x1307c00, (0x2456 bytes) 2024-09-11T07:07:02.844 INFO:teuthology.orchestra.run.smithi079.stdout:2820 writesame 0x500da6d thru 0x5013a05 data_size 0x1(0x5f99 bytes) 2024-09-11T07:07:02.848 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:02.873 INFO:teuthology.orchestra.run.smithi079.stdout:2821 read 0x36e3cfa thru 0x36ee882 (0xab89 bytes) 2024-09-11T07:07:02.873 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:02.870+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:02.888 INFO:teuthology.orchestra.run.smithi079.stdout:2822 writesame 0x91c5178 thru 0x91d4c5b data_size 0x2(0xfae4 bytes) 2024-09-11T07:07:02.888 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.888 INFO:teuthology.orchestra.run.smithi079.stdout:2824 write 0x72b7427 thru 0x72b817a (0xd54 bytes) 2024-09-11T07:07:02.898 INFO:teuthology.orchestra.run.smithi079.stdout:2826 trunc from 0x91d4c5c to 0xad42ceb 2024-09-11T07:07:02.912 INFO:teuthology.orchestra.run.smithi079.stdout:2828 read 0x5643e21 thru 0x56503a5 (0xc585 bytes) 2024-09-11T07:07:02.912 INFO:teuthology.orchestra.run.smithi079.stdout:2829 write 0x274f1ab thru 0x2758005 (0x8e5b bytes) 2024-09-11T07:07:02.923 INFO:teuthology.orchestra.run.smithi079.stdout:2831 trunc from 0xad42ceb to 0xa71b37a 2024-09-11T07:07:02.924 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:07:02.924 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T07:07:02.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T07:07:02.956 INFO:teuthology.orchestra.run.smithi079.stdout:2833 trunc from 0xa71b37a to 0x1d9e12b 2024-09-11T07:07:02.957 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:02.954+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:02.981 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.981 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.981 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:02.981 INFO:teuthology.orchestra.run.smithi079.stdout:2838 read 0xe3d885 thru 0xe42f06 (0x5682 bytes) 2024-09-11T07:07:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:2839 writesame 0xe9b9e96 thru 0xe9bea8f data_size 0x19(0x4bfa bytes) 2024-09-11T07:07:03.013 INFO:teuthology.orchestra.run.smithi079.stdout:2840 write 0xa70f95e thru 0xa7142a4 (0x4947 bytes) 2024-09-11T07:07:03.020 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:03.020 INFO:teuthology.orchestra.run.smithi079.stdout:2843 punch from 0x58648b3 to 0x5871065, (0xc7b2 bytes) 2024-09-11T07:07:03.020 INFO:teuthology.orchestra.run.smithi079.stdout:2844 write 0xec6c3a thru 0xecc0ae (0x5475 bytes) 2024-09-11T07:07:03.023 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:03.023 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:03.041 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:03.042 INFO:teuthology.orchestra.run.smithi079.stdout:2845 write 0x1d3c056 thru 0x1d3fa4e (0x39f9 bytes) 2024-09-11T07:07:03.046 INFO:teuthology.orchestra.run.smithi079.stdout:2846 write 0xdb0c44 thru 0xdbafa8 (0xa365 bytes) 2024-09-11T07:07:03.056 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:03.056+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:03.077 INFO:teuthology.orchestra.run.smithi079.stdout:2847 trunc from 0xe9bea90 to 0x648b330 2024-09-11T07:07:03.097 INFO:teuthology.orchestra.run.smithi079.stdout:2848 punch from 0x30c37c6 to 0x30cc9b3, (0x91ed bytes) 2024-09-11T07:07:03.097 INFO:teuthology.orchestra.run.smithi079.stdout:2849 read 0x1f7e0c5 thru 0x1f86cbd (0x8bf9 bytes) 2024-09-11T07:07:03.097 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:03.097 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:03.097 INFO:teuthology.orchestra.run.smithi079.stdout:2852 read 0x3f25fb0 thru 0x3f30c24 (0xac75 bytes) 2024-09-11T07:07:03.097 INFO:teuthology.orchestra.run.smithi079.stdout:2853 punch from 0x139af56 to 0x13a61db, (0xb285 bytes) 2024-09-11T07:07:03.097 INFO:teuthology.orchestra.run.smithi079.stdout:2854 read 0x278fe7d thru 0x27978ce (0x7a52 bytes) 2024-09-11T07:07:03.097 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:03.097 INFO:teuthology.orchestra.run.smithi079.stdout:2856 read 0x147e1ae thru 0x1488eb7 (0xad0a bytes) 2024-09-11T07:07:03.097 INFO:teuthology.orchestra.run.smithi079.stdout:2857 trunc from 0x648b330 to 0x5d5ba35 2024-09-11T07:07:03.108 INFO:teuthology.orchestra.run.smithi079.stdout:2858 trunc from 0x5d5ba35 to 0x52239a2 2024-09-11T07:07:03.119 INFO:teuthology.orchestra.run.smithi079.stdout:2859 read 0x4f1d1fd thru 0x4f2c10b (0xef0f bytes) 2024-09-11T07:07:03.137 INFO:teuthology.orchestra.run.smithi079.stdout:2861 writesame 0x9d8911d thru 0x9d9017e data_size 0x46(0x7062 bytes) 2024-09-11T07:07:03.137 INFO:teuthology.orchestra.run.smithi079.stdout:2862 writesame 0x7209a5a thru 0x720f092 data_size 0x1(0x5639 bytes) 2024-09-11T07:07:03.153 INFO:teuthology.orchestra.run.smithi079.stdout:2866 punch from 0x6d39682 to 0x6d45c48, (0xc5c6 bytes) 2024-09-11T07:07:03.157 INFO:teuthology.orchestra.run.smithi079.stdout:2867 trunc from 0x9d9017f to 0xc788e02 2024-09-11T07:07:03.157 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:03.156+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:03.163 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:03.163 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:03.168 INFO:teuthology.orchestra.run.smithi079.stdout:2868 trunc from 0xc788e02 to 0xbf6e6ac 2024-09-11T07:07:03.179 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:03.180 INFO:teuthology.orchestra.run.smithi079.stdout:2869 read 0x34808f2 thru 0x348fe66 (0xf575 bytes) 2024-09-11T07:07:03.192 INFO:teuthology.orchestra.run.smithi079.stdout:2870 trunc from 0xbf6e6ac to 0x35e340f 2024-09-11T07:07:03.212 INFO:teuthology.orchestra.run.smithi079.stdout:2874 read 0x12a87a1 thru 0x12b788c (0xf0ec bytes) 2024-09-11T07:07:03.212 INFO:teuthology.orchestra.run.smithi079.stdout:2875 punch from 0xd163fb to 0xd1d16d, (0x6d72 bytes) 2024-09-11T07:07:03.212 INFO:teuthology.orchestra.run.smithi079.stdout:2876 read 0x332ca58 thru 0x33307f7 (0x3da0 bytes) 2024-09-11T07:07:03.212 INFO:teuthology.orchestra.run.smithi079.stdout:2877 read 0x50f1e6 thru 0x50f7b1 (0x5cc bytes) 2024-09-11T07:07:03.212 INFO:teuthology.orchestra.run.smithi079.stdout:2878 read 0x2394c12 thru 0x23955ed (0x9dc bytes) 2024-09-11T07:07:03.213 INFO:teuthology.orchestra.run.smithi079.stdout:2880 punch from 0xcfe2c0 to 0xd0b054, (0xcd94 bytes) 2024-09-11T07:07:03.227 INFO:teuthology.orchestra.run.smithi079.stdout:2883 write 0x5590335 thru 0x559beae (0xbb7a bytes) 2024-09-11T07:07:03.235 INFO:teuthology.orchestra.run.smithi079.stdout:2884 read 0x2d31efe thru 0x2d3e236 (0xc339 bytes) 2024-09-11T07:07:03.236 INFO:teuthology.orchestra.run.smithi079.stdout:2885 read 0x4687bee thru 0x468b91e (0x3d31 bytes) 2024-09-11T07:07:03.236 INFO:teuthology.orchestra.run.smithi079.stdout:2886 write 0x1c61547 thru 0x1c6fa03 (0xe4bd bytes) 2024-09-11T07:07:03.243 INFO:teuthology.orchestra.run.smithi079.stdout:2887 punch from 0x499fa26 to 0x49ae911, (0xeeeb bytes) 2024-09-11T07:07:03.243 INFO:teuthology.orchestra.run.smithi079.stdout:2888 clone 31 order 20 su 524288 sc 2 2024-09-11T07:07:03.258 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:03.256+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:03.296 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:03.296 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:03.309 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:03.359 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:03.356+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:03.460 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:03.458+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:03.467 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:03.467 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:03.480 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:03.568 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:03.566+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:03.638 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:03.638 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:03.650 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:03.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:03.690+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:03.763 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:03.760+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:03.810 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:03.811 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:03.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:03.864 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:03.864+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:03.936 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T07:07:03.943 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:03.943 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:03.958 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T07:07:03.959 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:04.004 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:04.004+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:04.057 INFO:teuthology.orchestra.run.smithi079.stdout:flattening image image_client.0-clone30 2024-09-11T07:07:04.067 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:04.064+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:04.115 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:04.115 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:04.129 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:04.165 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:04.162+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:04.216 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #29, image image_client.0-clone29 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent30 2024-09-11T07:07:04.267 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:04.262+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:04.306 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:04.306 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:04.320 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:04.368 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:04.368+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:04.442 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:04.442 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:04.456 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:04.457 INFO:teuthology.orchestra.run.smithi079.stdout:2889 trunc from 0x559beaf to 0x1e87422 2024-09-11T07:07:04.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:04.465+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:04.479 INFO:teuthology.orchestra.run.smithi079.stdout:2890 read 0xc2b011 thru 0xc2c3f8 (0x13e8 bytes) 2024-09-11T07:07:04.505 INFO:teuthology.orchestra.run.smithi079.stdout:2892 writesame 0x93e885f thru 0x93e8988 data_size 0x1(0x12a bytes) 2024-09-11T07:07:04.506 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:04.506 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:04.526 INFO:teuthology.orchestra.run.smithi079.stdout:2896 writesame 0xe7e7cea thru 0xe7e8f9d data_size 0x15(0x12b4 bytes) 2024-09-11T07:07:04.526 INFO:teuthology.orchestra.run.smithi079.stdout:2897 write 0x2822ed2 thru 0x282c704 (0x9833 bytes) 2024-09-11T07:07:04.532 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:04.532 INFO:teuthology.orchestra.run.smithi079.stdout:2900 read 0xbfbe2c6 thru 0xbfcb417 (0xd152 bytes) 2024-09-11T07:07:04.532 INFO:teuthology.orchestra.run.smithi079.stdout:2904 read 0x8e92462 thru 0x8e97363 (0x4f02 bytes) 2024-09-11T07:07:04.557 INFO:teuthology.orchestra.run.smithi079.stdout:2905 trunc from 0xe7e8f9e to 0x1094660 2024-09-11T07:07:04.570 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:04.568+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:04.620 INFO:teuthology.orchestra.run.smithi079.stdout:2906 write 0xb149922 thru 0xb14bd3d (0x241c bytes) 2024-09-11T07:07:04.626 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:04.626 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:04.627 INFO:teuthology.orchestra.run.smithi079.stdout:2907 punch from 0x4f5cc39 to 0x4f68d96, (0xc15d bytes) 2024-09-11T07:07:04.627 INFO:teuthology.orchestra.run.smithi079.stdout:2909 read 0xd6af53 thru 0xd760e2 (0xb190 bytes) 2024-09-11T07:07:04.629 INFO:teuthology.orchestra.run.smithi079.stdout:2910 read 0x837c1ab thru 0x8389adc (0xd932 bytes) 2024-09-11T07:07:04.629 INFO:teuthology.orchestra.run.smithi079.stdout:2912 read 0x5135e1b thru 0x513962e (0x3814 bytes) 2024-09-11T07:07:04.629 INFO:teuthology.orchestra.run.smithi079.stdout:2913 write 0x3a2f897 thru 0x3a36319 (0x6a83 bytes) 2024-09-11T07:07:04.637 INFO:teuthology.orchestra.run.smithi079.stdout:2914 write 0xaf06560 thru 0xaf0c40e (0x5eaf bytes) 2024-09-11T07:07:04.643 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:04.643 INFO:teuthology.orchestra.run.smithi079.stdout:2915 read 0xa36c500 thru 0xa37b2c3 (0xedc4 bytes) 2024-09-11T07:07:04.644 INFO:teuthology.orchestra.run.smithi079.stdout:2916 write 0x1e9590a thru 0x1e9cbf1 (0x72e8 bytes) 2024-09-11T07:07:04.669 INFO:teuthology.orchestra.run.smithi079.stdout:2918 writesame 0xd2d4283 thru 0xd2e3560 data_size 0x7(0xf2de bytes) 2024-09-11T07:07:04.669 INFO:teuthology.orchestra.run.smithi079.stdout:2919 writesame 0x8407c5e thru 0x8412b12 data_size 0x1(0xaeb5 bytes) 2024-09-11T07:07:04.675 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:04.684 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:04.684+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:04.740 INFO:teuthology.orchestra.run.smithi079.stdout:2920 trunc from 0xd2e3561 to 0x28d8c7c 2024-09-11T07:07:04.755 INFO:teuthology.orchestra.run.smithi079.stdout:2921 read 0x74dda6 thru 0x757268 (0x94c3 bytes) 2024-09-11T07:07:04.756 INFO:teuthology.orchestra.run.smithi079.stdout:2922 read 0xb3b7 thru 0xc0ad (0xcf7 bytes) 2024-09-11T07:07:04.771 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:04.765+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:04.775 INFO:teuthology.orchestra.run.smithi079.stdout:2923 write 0x70a5cab thru 0x70b1030 (0xb386 bytes) 2024-09-11T07:07:04.805 INFO:teuthology.orchestra.run.smithi079.stdout:2924 writesame 0xd424f72 thru 0xd434baa data_size 0x1(0xfc39 bytes) 2024-09-11T07:07:04.805 INFO:teuthology.orchestra.run.smithi079.stdout:2925 write 0x41058a8 thru 0x410bb88 (0x62e1 bytes) 2024-09-11T07:07:04.811 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:04.811 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:04.812 INFO:teuthology.orchestra.run.smithi079.stdout:2926 flatten 2024-09-11T07:07:04.840 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:04.849 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:04.849 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:04.852 INFO:teuthology.orchestra.run.smithi079.stdout:2928 punch from 0xecdef3 to 0xedbe3c, (0xdf49 bytes) 2024-09-11T07:07:04.852 INFO:teuthology.orchestra.run.smithi079.stdout:2929 write 0x496e5b2 thru 0x4974d8c (0x67db bytes) 2024-09-11T07:07:04.857 INFO:teuthology.orchestra.run.smithi079.stdout:2930 trunc from 0xd434bab to 0xc174d97 2024-09-11T07:07:04.862 INFO:teuthology.orchestra.run.smithi079.stdout:2931 read 0x33a7c7a thru 0x33acf8e (0x5315 bytes) 2024-09-11T07:07:04.862 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:04.862 INFO:teuthology.orchestra.run.smithi079.stdout:2934 punch from 0x452ac7d to 0x452e0df, (0x3462 bytes) 2024-09-11T07:07:04.862 INFO:teuthology.orchestra.run.smithi079.stdout:2935 write 0x94a2613 thru 0x94a3851 (0x123f bytes) 2024-09-11T07:07:04.869 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:04.869 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:04.872 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:04.869+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:04.876 INFO:teuthology.orchestra.run.smithi079.stdout:2936 writesame 0xd09760c thru 0xd0a57ed data_size 0x1d(0xe1e2 bytes) 2024-09-11T07:07:04.876 INFO:teuthology.orchestra.run.smithi079.stdout:2938 punch from 0x59c142e to 0x59cf06c, (0xdc3e bytes) 2024-09-11T07:07:04.876 INFO:teuthology.orchestra.run.smithi079.stdout:2939 punch from 0x540c297 to 0x54142e5, (0x804e bytes) 2024-09-11T07:07:04.876 INFO:teuthology.orchestra.run.smithi079.stdout:2940 write 0x1b38587 thru 0x1b44c80 (0xc6fa bytes) 2024-09-11T07:07:04.877 INFO:teuthology.orchestra.run.smithi079.stdout:2941 write 0x1d2ef30 thru 0x1d3af23 (0xbff4 bytes) 2024-09-11T07:07:04.881 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:04.887 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:04.888 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:04.888 INFO:teuthology.orchestra.run.smithi079.stdout:2943 write 0xddade73 thru 0xddb5b85 (0x7d13 bytes) 2024-09-11T07:07:04.896 INFO:teuthology.orchestra.run.smithi079.stdout:2944 trunc from 0xddb5b86 to 0xb01272b 2024-09-11T07:07:04.906 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:04.907 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:04.913 INFO:teuthology.orchestra.run.smithi079.stdout:2945 write 0xbddef9d thru 0xbde90b5 (0xa119 bytes) 2024-09-11T07:07:04.917 INFO:teuthology.orchestra.run.smithi079.stdout:2948 read 0xb78ccd5 thru 0xb798816 (0xbb42 bytes) 2024-09-11T07:07:04.917 INFO:teuthology.orchestra.run.smithi079.stdout:2949 write 0xb4b588 thru 0xb4e655 (0x30ce bytes) 2024-09-11T07:07:04.921 INFO:teuthology.orchestra.run.smithi079.stdout:2950 writesame 0x426a682 thru 0x427831d data_size 0xe(0xdc9c bytes) 2024-09-11T07:07:04.925 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:04.935 INFO:teuthology.orchestra.run.smithi079.stdout:2951 write 0xc7b7c4b thru 0xc7c59a5 (0xdd5b bytes) 2024-09-11T07:07:04.939 INFO:teuthology.orchestra.run.smithi079.stdout:2952 write 0x6c16911 thru 0x6c1deb8 (0x75a8 bytes) 2024-09-11T07:07:04.942 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T07:07:04.946 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:04.946 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:04.947 INFO:teuthology.orchestra.run.smithi079.stdout:2954 write 0x1cd85c2 thru 0x1ce5431 (0xce70 bytes) 2024-09-11T07:07:04.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:07:04.953 INFO:teuthology.orchestra.run.smithi079.stdout:2956 punch from 0x59f6070 to 0x59f982c, (0x37bc bytes) 2024-09-11T07:07:04.964 INFO:teuthology.orchestra.run.smithi079.stdout:2957 write 0xeaf7ae9 thru 0xeb03b72 (0xc08a bytes) 2024-09-11T07:07:04.969 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-11T07:07:04.970 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:04.970 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:04.971 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:04.971 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:04.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:04.971 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:04.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.971 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:04.971 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:04.971 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.658624983999999, 2024-09-11T07:07:04.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:07:04.971 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:07:04.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.975 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.658557430000002, 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:04.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:07:04.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:07:04.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.980 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:04.980 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.980 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:04.980 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:04.980 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.658476593000003, 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:04.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:04.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.658433246999998, 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:04.985 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:04.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:07:04.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:07:04.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.990 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:04.990 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.990 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:04.990 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:04.990 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.658363121999997, 2024-09-11T07:07:04.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:07:04.990 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:07:04.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:07:04.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.658294998000002, 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:04.995 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:07:04.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:07:04.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.658254532000001, 2024-09-11T07:07:04.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:05.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.658216490999997, 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.004 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:07:05.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:07:05.007 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.658177520999999, 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.008 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:05.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.658136646999999, 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.012 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.657808873999997, 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.017 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:07:05.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:07:05.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.657742364000001, 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.021 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.025 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.657674645, 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:07:05.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:07:05.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.657629706999998, 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.030 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:07:05.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.656830081999999, 2024-09-11T07:07:05.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:07:05.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.038 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.65679574, 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:07:05.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.656433065000002, 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.043 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:07:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:07:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:07:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:07:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:07:05.047 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.655170040000002, 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.048 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:07:05.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 44.655137541000002, 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:07:05.052 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:07:05.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.718532113999999, 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.057 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:07:05.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:07:05.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:07:05.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:05.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.062 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:05.064 INFO:teuthology.orchestra.run.smithi079.stdout:2958 punch from 0xa3127a4 to 0xa315d40, (0x359c bytes) 2024-09-11T07:07:05.064 INFO:teuthology.orchestra.run.smithi079.stdout:2959 trunc from 0xeb03b73 to 0xb9bdb99 2024-09-11T07:07:05.064 INFO:teuthology.orchestra.run.smithi079.stdout:2960 write 0x3b7eb thru 0x47ead (0xc6c3 bytes) 2024-09-11T07:07:05.064 INFO:teuthology.orchestra.run.smithi079.stdout:2961 writesame 0x3461350 thru 0x34680fb data_size 0x2(0x6dac bytes) 2024-09-11T07:07:05.064 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:05.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:05.066 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:2962 writesame 0xdc5829d thru 0xdc6216c data_size 0x2(0x9ed0 bytes) 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:2963 read 0xaf5dbc1 thru 0xaf6003e (0x247e bytes) 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:2965 read 0x5315126 thru 0x531e603 (0x94de bytes) 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:2966 write 0xe066282 thru 0xe06ffbc (0x9d3b bytes) 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:2967 read 0x159267b thru 0x159e39e (0xbd24 bytes) 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:2968 writesame 0xb7b555c thru 0xb7bf05e data_size 0x1(0x9b03 bytes) 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:2970 write 0x4467f0 thru 0x450caf (0xa4c0 bytes) 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:2973 read 0x9796c8b thru 0x97a437c (0xd6f2 bytes) 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.067 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.068 INFO:teuthology.orchestra.run.smithi079.stdout:2977 write 0xa531436 thru 0xa53f137 (0xdd02 bytes) 2024-09-11T07:07:05.068 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:05.057+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:05.068 INFO:teuthology.orchestra.run.smithi079.stdout:2978 trunc from 0xe06ffbd to 0xce3c20e 2024-09-11T07:07:05.079 INFO:teuthology.orchestra.run.smithi079.stdout:2979 punch from 0x1082929 to 0x108bfa0, (0x9677 bytes) 2024-09-11T07:07:05.079 INFO:teuthology.orchestra.run.smithi079.stdout:2980 punch from 0x394301c to 0x39442ad, (0x1291 bytes) 2024-09-11T07:07:05.079 INFO:teuthology.orchestra.run.smithi079.stdout:2982 write 0x5c69728 thru 0x5c6f710 (0x5fe9 bytes) 2024-09-11T07:07:05.082 INFO:teuthology.orchestra.run.smithi079.stdout:2985 writesame 0x91e1d36 thru 0x91f00b3 data_size 0x25(0xe37e bytes) 2024-09-11T07:07:05.093 INFO:teuthology.orchestra.run.smithi079.stdout:2986 trunc from 0xce3c20e to 0x8c14527 2024-09-11T07:07:05.105 INFO:teuthology.orchestra.run.smithi079.stdout:2987 punch from 0x68833fb to 0x6885b1b, (0x2720 bytes) 2024-09-11T07:07:05.105 INFO:teuthology.orchestra.run.smithi079.stdout:2989 punch from 0x4c21dec to 0x4c2d0fb, (0xb30f bytes) 2024-09-11T07:07:05.106 INFO:teuthology.orchestra.run.smithi079.stdout:2990 write 0x290fc6c thru 0x2912d6f (0x3104 bytes) 2024-09-11T07:07:05.108 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.109 INFO:teuthology.orchestra.run.smithi079.stdout:2994 punch from 0x87766ad to 0x8780541, (0x9e94 bytes) 2024-09-11T07:07:05.109 INFO:teuthology.orchestra.run.smithi079.stdout:2995 writesame 0x43d5205 thru 0x43d72b7 data_size 0x1(0x20b3 bytes) 2024-09-11T07:07:05.117 INFO:teuthology.orchestra.run.smithi079.stdout:2998 read 0x79220a5 thru 0x79220dc (0x38 bytes) 2024-09-11T07:07:05.117 INFO:teuthology.orchestra.run.smithi079.stdout:2999 read 0x795f9dd thru 0x7960a82 (0x10a6 bytes) 2024-09-11T07:07:05.117 INFO:teuthology.orchestra.run.smithi079.stdout:3000 punch from 0x8534b24 to 0x853f938, (0xae14 bytes) 2024-09-11T07:07:05.128 INFO:teuthology.orchestra.run.smithi079.stdout:3002 writesame 0xc5e45aa thru 0xc5eb0b8 data_size 0x1(0x6b0f bytes) 2024-09-11T07:07:05.128 INFO:teuthology.orchestra.run.smithi079.stdout:3003 punch from 0xb0865 to 0xb4612, (0x3dad bytes) 2024-09-11T07:07:05.129 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.129 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.129 INFO:teuthology.orchestra.run.smithi079.stdout:3006 write 0x32e7292 thru 0x32ebd8f (0x4afe bytes) 2024-09-11T07:07:05.140 INFO:teuthology.orchestra.run.smithi079.stdout:3007 write 0xd97c14d thru 0xd98ab1b (0xe9cf bytes) 2024-09-11T07:07:05.147 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.147 INFO:teuthology.orchestra.run.smithi079.stdout:3010 read 0xc44b19f thru 0xc44c3a4 (0x1206 bytes) 2024-09-11T07:07:05.149 INFO:teuthology.orchestra.run.smithi079.stdout:3011 trunc from 0xd98ab1c to 0xc943e89 2024-09-11T07:07:05.164 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:05.161+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:05.175 INFO:teuthology.orchestra.run.smithi079.stdout:3012 trunc from 0xc943e89 to 0x2ace6f7 2024-09-11T07:07:05.190 INFO:teuthology.orchestra.run.smithi079.stdout:3013 read 0x1c964b3 thru 0x1c9babe (0x560c bytes) 2024-09-11T07:07:05.198 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:05.198 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:05.198 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:05.198 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:05.208 INFO:teuthology.orchestra.run.smithi079.stdout:3014 write 0xa90b9da thru 0xa914235 (0x885c bytes) 2024-09-11T07:07:05.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:05.218 INFO:teuthology.orchestra.run.smithi079.stdout:3015 writesame 0xaaf95d2 thru 0xaafe061 data_size 0x8(0x4a90 bytes) 2024-09-11T07:07:05.229 INFO:teuthology.orchestra.run.smithi079.stdout:3016 writesame 0xddad3c1 thru 0xddade9b data_size 0x1(0xadb bytes) 2024-09-11T07:07:05.239 INFO:teuthology.orchestra.run.smithi079.stdout:3017 trunc from 0xddade9c to 0x7432dac 2024-09-11T07:07:05.251 INFO:teuthology.orchestra.run.smithi079.stdout:3018 read 0x42a4265 thru 0x42b1fc2 (0xdd5e bytes) 2024-09-11T07:07:05.251 INFO:teuthology.orchestra.run.smithi079.stdout:3019 read 0x394527f thru 0x394f391 (0xa113 bytes) 2024-09-11T07:07:05.260 INFO:teuthology.orchestra.run.smithi079.stdout:3020 write 0x92d365c thru 0x92d656f (0x2f14 bytes) 2024-09-11T07:07:05.264 INFO:teuthology.orchestra.run.smithi079.stdout:3021 write 0x63cde1e thru 0x63d645a (0x863d bytes) 2024-09-11T07:07:05.264 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:05.261+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:05.267 INFO:teuthology.orchestra.run.smithi079.stdout:3022 punch from 0x779416d to 0x77a1c75, (0xdb08 bytes) 2024-09-11T07:07:05.270 INFO:teuthology.orchestra.run.smithi079.stdout:3023 trunc from 0x92d6570 to 0x7402953 2024-09-11T07:07:05.284 INFO:teuthology.orchestra.run.smithi079.stdout:3024 write 0x30d9a66 thru 0x30e2299 (0x8834 bytes) 2024-09-11T07:07:05.287 INFO:teuthology.orchestra.run.smithi079.stdout:3025 punch from 0x478d33b to 0x479c590, (0xf255 bytes) 2024-09-11T07:07:05.295 INFO:teuthology.orchestra.run.smithi079.stdout:3026 trunc from 0x7402953 to 0x200f6f0 2024-09-11T07:07:05.310 INFO:teuthology.orchestra.run.smithi079.stdout:3027 read 0x282cf1 thru 0x2869d4 (0x3ce4 bytes) 2024-09-11T07:07:05.310 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.330 INFO:teuthology.orchestra.run.smithi079.stdout:3029 write 0xa8777b3 thru 0xa878c77 (0x14c5 bytes) 2024-09-11T07:07:05.330 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:05.330 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:05.331 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:05.334 INFO:teuthology.orchestra.run.smithi079.stdout:3030 write 0x68b96d thru 0x696527 (0xabbb bytes) 2024-09-11T07:07:05.345 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:05.352 INFO:teuthology.orchestra.run.smithi079.stdout:3031 trunc from 0xa878c78 to 0x591e2 2024-09-11T07:07:05.392 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:05.392+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:05.399 INFO:teuthology.orchestra.run.smithi079.stdout:3033 write 0xd6971f5 thru 0xd6a50ff (0xdf0b bytes) 2024-09-11T07:07:05.403 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.403 INFO:teuthology.orchestra.run.smithi079.stdout:3035 punch from 0x4656bbd to 0x4665dd4, (0xf217 bytes) 2024-09-11T07:07:05.403 INFO:teuthology.orchestra.run.smithi079.stdout:3037 read 0xb2d76fe thru 0xb2e21a7 (0xaaaa bytes) 2024-09-11T07:07:05.403 INFO:teuthology.orchestra.run.smithi079.stdout:3038 write 0x3f5ee44 thru 0x3f66d7c (0x7f39 bytes) 2024-09-11T07:07:05.406 INFO:teuthology.orchestra.run.smithi079.stdout:3039 punch from 0xf4c4ae to 0xf4dcf7, (0x1849 bytes) 2024-09-11T07:07:05.407 INFO:teuthology.orchestra.run.smithi079.stdout:3040 read 0x4333746 thru 0x433e894 (0xb14f bytes) 2024-09-11T07:07:05.407 INFO:teuthology.orchestra.run.smithi079.stdout:3042 read 0x1f2e273 thru 0x1f3e16d (0xfefb bytes) 2024-09-11T07:07:05.407 INFO:teuthology.orchestra.run.smithi079.stdout:3043 write 0x34dca72 thru 0x34e3986 (0x6f15 bytes) 2024-09-11T07:07:05.409 INFO:teuthology.orchestra.run.smithi079.stdout:3044 write 0x3262013 thru 0x3270f4c (0xef3a bytes) 2024-09-11T07:07:05.413 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.414 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.414 INFO:teuthology.orchestra.run.smithi079.stdout:3048 read 0x64c77f0 thru 0x64cafdd (0x37ee bytes) 2024-09-11T07:07:05.414 INFO:teuthology.orchestra.run.smithi079.stdout:3049 write 0x5c0c3e8 thru 0x5c18457 (0xc070 bytes) 2024-09-11T07:07:05.417 INFO:teuthology.orchestra.run.smithi079.stdout:3050 write 0xc39197 thru 0xc3f531 (0x639b bytes) 2024-09-11T07:07:05.423 INFO:teuthology.orchestra.run.smithi079.stdout:3051 read 0x14795ed thru 0x147dde7 (0x47fb bytes) 2024-09-11T07:07:05.423 INFO:teuthology.orchestra.run.smithi079.stdout:3052 punch from 0xb707830 to 0xb70d9ad, (0x617d bytes) 2024-09-11T07:07:05.423 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:05.426 INFO:teuthology.orchestra.run.smithi079.stdout:3054 trunc from 0xd6a5100 to 0xafd1e5b 2024-09-11T07:07:05.442 INFO:teuthology.orchestra.run.smithi079.stdout:3055 punch from 0x561eb83 to 0x56285e5, (0x9a62 bytes) 2024-09-11T07:07:05.442 INFO:teuthology.orchestra.run.smithi079.stdout:3057 writesame 0x609eb9a thru 0x60ab142 data_size 0x3(0xc5a9 bytes) 2024-09-11T07:07:05.466 INFO:teuthology.orchestra.run.smithi079.stdout:3058 punch from 0xd4b554 to 0xd587db, (0xd287 bytes) 2024-09-11T07:07:05.466 INFO:teuthology.orchestra.run.smithi079.stdout:3059 write 0x2a8dc9e thru 0x2a924cd (0x4830 bytes) 2024-09-11T07:07:05.466 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:05.464+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:05.471 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.146367658999999, 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:05.472 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:07:05.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:05.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:07:05.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:07:05.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:07:05.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.478 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9997 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 180224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843752688000002, 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010421191999999999, 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9997 2024-09-11T07:07:05.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624848+0000", 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624854+0000", 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2330000000000003e-06 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624873+0000", 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8770000000000002e-05 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624887+0000", 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.437e-05 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.634868+0000", 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0099809489999999994 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635065+0000", 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196622 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635268+0000", 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020319500000000001 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10000 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843692228999998, 2024-09-11T07:07:05.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010963796, 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10000 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624909+0000", 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.68e-06 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624915+0000", 2024-09-11T07:07:05.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.003e-06 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624939+0000", 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4386999999999999e-05 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624953+0000", 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.419e-05 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635384+0000", 2024-09-11T07:07:05.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010430356 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635653+0000", 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026916499999999998 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635871+0000", 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021801500000000001 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10002 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843626213, 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011381399, 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10002 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624974+0000", 2024-09-11T07:07:05.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2640000000000001e-06 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624994+0000", 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9826e-05 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625015+0000", 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0724e-05 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625031+0000", 2024-09-11T07:07:05.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6089000000000001e-05 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635948+0000", 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010917349 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636143+0000", 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019470199999999999 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636355+0000", 2024-09-11T07:07:05.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021144499999999999 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10004 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843501293999999, 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011952765000000001, 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10004 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625099+0000", 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625118+0000", 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625135+0000", 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7669999999999999e-05 2024-09-11T07:07:05.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625150+0000", 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4504e-05 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636471+0000", 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011321278000000001 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636726+0000", 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025507200000000001 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637051+0000", 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032463099999999998 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843428564, 2024-09-11T07:07:05.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.500 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843365448, 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:05.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:07:05.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:07:05.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843290455000002, 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:07:05.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.509 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843225898999997, 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:05.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:07:05.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843170669999999, 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:07:05.514 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.518 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843116772999998, 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:07:05.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843056273999998, 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:05.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.843000261, 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:07:05.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:07:05.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.842920907999996, 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:07:05.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.842864605000003, 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.537 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:07:05.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.541 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.842792166000002, 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:07:05.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:07:05.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.842736045999999, 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:07:05.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.842662580000002, 2024-09-11T07:07:05.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:07:05.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:05.554 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.842584187, 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:05.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.558 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.933408173, 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:05.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:07:05.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:07:05.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:05.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:05.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:05.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:07:05.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:07:05.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.563 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:05.563 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:05.563 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:05.565 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:05.565 INFO:teuthology.orchestra.run.smithi079.stdout:3060 punch from 0x64c47a to 0x658a64, (0xc5ea bytes) 2024-09-11T07:07:05.565 INFO:teuthology.orchestra.run.smithi079.stdout:3064 trunc from 0xafd1e5b to 0x822593f 2024-09-11T07:07:05.566 INFO:teuthology.orchestra.run.smithi079.stdout:3065 write 0x3f0d889 thru 0x3f13273 (0x59eb bytes) 2024-09-11T07:07:05.566 INFO:teuthology.orchestra.run.smithi079.stdout:3067 read 0x13dd5f thru 0x146265 (0x8507 bytes) 2024-09-11T07:07:05.566 INFO:teuthology.orchestra.run.smithi079.stdout:3068 write 0xbef713e thru 0xbf0538d (0xe250 bytes) 2024-09-11T07:07:05.566 INFO:teuthology.orchestra.run.smithi079.stdout:3069 trunc from 0xbf0538e to 0x520aeeb 2024-09-11T07:07:05.566 INFO:teuthology.orchestra.run.smithi079.stdout:3070 read 0x4838cfe thru 0x484245d (0x9760 bytes) 2024-09-11T07:07:05.566 INFO:teuthology.orchestra.run.smithi079.stdout:3071 writesame 0xb76dd2f thru 0xb77bf72 data_size 0x12(0xe244 bytes) 2024-09-11T07:07:05.566 INFO:teuthology.orchestra.run.smithi079.stdout:3073 clone 32 order 20 su 32768 sc 11 2024-09-11T07:07:05.608 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:05.608+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:05.668 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:05.668+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:05.734 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:06.016 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:06.016 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:06.016 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:06.017 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:07:06.017 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.4 to 1 (10000) 2024-09-11T07:07:06.018 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:06.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T07:07:06.020 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:06.013+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:06.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:06.113+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:06.185 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #30, image image_client.0-clone30 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent31 2024-09-11T07:07:06.192 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:06.193 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:06.193 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:06.207 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:06.252 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:06.252+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:06.320 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:06.320+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:06.333 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.262365482000007, 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:06.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:07:06.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:07:06.340 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7525 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4898816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.631391870000002, 2024-09-11T07:07:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058576490000000002, 2024-09-11T07:07:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.341 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7525 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701087+0000", 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018042780000000001 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701093+0000", 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7880000000000003e-06 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701108+0000", 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4409999999999999e-05 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701116+0000", 2024-09-11T07:07:06.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2120000000000003e-06 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757734+0000", 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056618467999999998 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757798+0000", 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3978000000000003e-05 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757860+0000", 2024-09-11T07:07:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1356e-05 2024-09-11T07:07:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:06.346 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.836194986999999, 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:06.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.836138769999998, 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:07:06.351 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:06.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26245 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 88064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.833140139999998, 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058494675000000003, 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26245 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497536+0000", 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.035e-06 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497541+0000", 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9740000000000001e-06 2024-09-11T07:07:06.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497557+0000", 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5794000000000002e-05 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497568+0000", 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0879999999999999e-05 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555887+0000", 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058319353999999997 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555952+0000", 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4875999999999993e-05 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556030+0000", 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7762000000000005e-05 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.360 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.833091609, 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:06.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.365 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.833038508999998, 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.366 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:07:06.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.370 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832939604000003, 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.371 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:07:06.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832871736000001, 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:07:06.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:07:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:07:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:07:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:07:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:07:06.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.380 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832815201999999, 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:07:06.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.385 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832762742, 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:07:06.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:07:06.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832711113999999, 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.390 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:06.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:07:06.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:07:06.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:07:06.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:07:06.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.394 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832659692, 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.395 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:07:06.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:07:06.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:07:06.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:07:06.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832608598, 2024-09-11T07:07:06.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:06.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:06.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:07:06.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:07:06.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.405 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832556638, 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832457124999998, 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.410 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.411 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.411 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:07:06.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.411 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:07:06.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:07:06.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:07:06.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.415 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.415 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.416 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:06.416 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832398320000003, 2024-09-11T07:07:06.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:07:06.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:07:06.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832347165999998, 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:06.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:07:06.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:07:06.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:07:06.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:07:06.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.832290860000001, 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.426 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:07:06.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:06.431 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.825491345000003, 2024-09-11T07:07:06.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:07:06.432 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:06.432 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:06.432 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:06.432 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:06.432 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:06.432 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.432 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:07:06.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.433 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:06.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:06.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:06.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:06.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:06.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:06.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:06.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:07:06.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:06.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:06.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:07:06.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:07:06.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:06.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:07:06.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:07:06.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:07:06.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:07:06.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:06.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:07:06.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:07:06.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:06.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:07:06.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:07:06.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:06.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:06.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:06.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:07:06.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:07:06.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.438 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:06.438 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:06.439 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:06.442 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:06.440+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:06.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:06.443 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:06.443 INFO:teuthology.orchestra.run.smithi079.stdout:3076 punch from 0x587433e to 0x5880588, (0xc24a bytes) 2024-09-11T07:07:06.443 INFO:teuthology.orchestra.run.smithi079.stdout:3077 write 0x444361e thru 0x444eb1a (0xb4fd bytes) 2024-09-11T07:07:06.443 INFO:teuthology.orchestra.run.smithi079.stdout:3078 read 0x3e972fa thru 0x3e9e3c7 (0x70ce bytes) 2024-09-11T07:07:06.443 INFO:teuthology.orchestra.run.smithi079.stdout:3080 read 0x24ab693 thru 0x24afa3b (0x43a9 bytes) 2024-09-11T07:07:06.444 INFO:teuthology.orchestra.run.smithi079.stdout:3081 writesame 0x9dfa630 thru 0x9e053ac data_size 0x1(0xad7d bytes) 2024-09-11T07:07:06.444 INFO:teuthology.orchestra.run.smithi079.stdout:3082 write 0xe8c1a07 thru 0xe8c247d (0xa77 bytes) 2024-09-11T07:07:06.444 INFO:teuthology.orchestra.run.smithi079.stdout:3084 read 0x86cc8ff thru 0x86d1d48 (0x544a bytes) 2024-09-11T07:07:06.444 INFO:teuthology.orchestra.run.smithi079.stdout:3085 write 0x2398d10 thru 0x23a5abf (0xcdb0 bytes) 2024-09-11T07:07:06.444 INFO:teuthology.orchestra.run.smithi079.stdout:3087 read 0xe60e1d thru 0xe62f82 (0x2166 bytes) 2024-09-11T07:07:06.444 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:06.444 INFO:teuthology.orchestra.run.smithi079.stdout:3091 clone 33 order 22 su 16384 sc 9 2024-09-11T07:07:06.542 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:06.537+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:06.561 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:06.561 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:06.561 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:06.561 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:06.574 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:06.642 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:06.640+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:06.722 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:06.723 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:06.723 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:06.723 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:06.723 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:06.735 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:06.743 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:06.740+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:06.844 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:06.844+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:06.858 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.184722927999999, 2024-09-11T07:07:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:07:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:07:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.184710787999997, 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:07:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.184059837, 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:07:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.184002941000003, 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:07:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.183975906999997, 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:07:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.181432045000001, 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:07:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:07:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.181409936999998, 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.181390321999999, 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:07:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.181367416999997, 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.895 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.180988655999997, 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.899 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:07:06.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.903 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.180957153999998, 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:07:06.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:07:06.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:07:06.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.180439878999998, 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:06.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.912 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.180415750000002, 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:06.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:06.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:07:06.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:07:06.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.918 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.918 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:06.918 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.180402424, 2024-09-11T07:07:06.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:07:06.918 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.918 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.918 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:07:06.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.922 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.179982496000001, 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:07:06.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:07:06.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.179955087000003, 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:06.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:07:06.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.179176083000002, 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:07:06.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.174075954999999, 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.936 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:07:06.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:07:06.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.416198622, 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.941 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:07:06.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:07:06.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:07:06.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.416024809, 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:06.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:06.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:07:06.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:06.955 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:06.957 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:06.957 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:06.956+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:06.965 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T07:07:06.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T07:07:07.066 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone32 from 0xe8c247e (overlap 0xb77bf73) to 0x370b96f 2024-09-11T07:07:07.066 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:07.067 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:07.061+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:07.093 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:07.093 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:07.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:07.093 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "pg_update_log_missing(3.18 epoch 79/73 rep_tid 1527 entries 79'264 (0'0) error 3:1b53b7a0:::rbd_data.116152546b23.000000000000005e:head by client.4449.0:65369 0.000000 -2 [r=-2+0b, r=0+0b] ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 79'262)", 2024-09-11T07:07:07.093 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:07.093393+0000", 2024-09-11T07:07:07.093 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00031155000000000001, 2024-09-11T07:07:07.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00034975099999999998, 2024-09-11T07:07:07.093 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:07.093 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:07.093 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:07.093393+0000", 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:07.093393+0000", 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:07.093394+0000", 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:07.093404+0000", 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0022e-05 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:07.093428+0000", 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4221999999999999e-05 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:07.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:07.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:07.093446+0000", 2024-09-11T07:07:07.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7923000000000001e-05 2024-09-11T07:07:07.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:07.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:07.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:07.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:07.093529+0000", 2024-09-11T07:07:07.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3023999999999997e-05 2024-09-11T07:07:07.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:07.096 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:07.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:07.097 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:07.097 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:07.097 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 1 2024-09-11T07:07:07.097 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:07.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:07.158 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:07.156+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:07.245 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:07.246 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:07.258 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:07.253+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:07.278 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:07.278 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:07.297 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #31, image image_client.0-clone31 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent32 2024-09-11T07:07:07.298 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:07.298 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:07.309 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:07.310 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:07.315 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:07.316 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:07.329 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:07.337 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:07.338 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:07.359 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:07.359 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:07.360 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:07.356+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:07.394 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:07.395 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:07.423 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:07.423 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:07.461 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:07.460+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:07.488 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:07.488 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:07.503 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:07.562 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:07.560+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:07.621 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:07.621 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:07.635 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:07.636 INFO:teuthology.orchestra.run.smithi079.stdout:3093 read 0x7ff251b thru 0x7ffee64 (0xc94a bytes) 2024-09-11T07:07:07.637 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:07.637 INFO:teuthology.orchestra.run.smithi079.stdout:3096 writesame 0x7d43d59 thru 0x7d45fb5 data_size 0x1(0x225d bytes) 2024-09-11T07:07:07.663 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:07.660+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:07.664 INFO:teuthology.orchestra.run.smithi079.stdout:3097 write 0x3c056a5 thru 0x3c0a20f (0x4b6b bytes) 2024-09-11T07:07:07.716 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:07.717 INFO:teuthology.orchestra.run.smithi079.stdout:3099 read 0x67b8589 thru 0x67bf80f (0x7287 bytes) 2024-09-11T07:07:07.717 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:07.717 INFO:teuthology.orchestra.run.smithi079.stdout:3103 write 0xbb5c137 thru 0xbb62493 (0x635d bytes) 2024-09-11T07:07:07.728 INFO:teuthology.orchestra.run.smithi079.stdout:3105 writesame 0xd3789c1 thru 0xd388737 data_size 0x2b(0xfd77 bytes) 2024-09-11T07:07:07.746 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:07.747 INFO:teuthology.orchestra.run.smithi079.stdout:3108 writesame 0x41c4e6 thru 0x4285e1 data_size 0x8a(0xc0fc bytes) 2024-09-11T07:07:07.763 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:07.764 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:07.764 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:07.764+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:07.779 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:07.802 INFO:teuthology.orchestra.run.smithi079.stdout:3110 writesame 0x7cfd21d thru 0x7d03189 data_size 0x11(0x5f6d bytes) 2024-09-11T07:07:07.812 INFO:teuthology.orchestra.run.smithi079.stdout:3111 write 0xd22372e thru 0xd22b60b (0x7ede bytes) 2024-09-11T07:07:07.816 INFO:teuthology.orchestra.run.smithi079.stdout:3112 read 0x82a70eb thru 0x82ab53a (0x4450 bytes) 2024-09-11T07:07:07.816 INFO:teuthology.orchestra.run.smithi079.stdout:3113 read 0x3800fa5 thru 0x3809233 (0x828f bytes) 2024-09-11T07:07:07.816 INFO:teuthology.orchestra.run.smithi079.stdout:3114 write 0x89a1c73 thru 0x89a7168 (0x54f6 bytes) 2024-09-11T07:07:07.819 INFO:teuthology.orchestra.run.smithi079.stdout:3116 read 0xd612e79 thru 0xd61a28b (0x7413 bytes) 2024-09-11T07:07:07.820 INFO:teuthology.orchestra.run.smithi079.stdout:3117 write 0xd7610c7 thru 0xd76b939 (0xa873 bytes) 2024-09-11T07:07:07.833 INFO:teuthology.orchestra.run.smithi079.stdout:3118 read 0x12f51fa thru 0x1302459 (0xd260 bytes) 2024-09-11T07:07:07.833 INFO:teuthology.orchestra.run.smithi079.stdout:3119 write 0xe1cbed1 thru 0xe1d82ad (0xc3dd bytes) 2024-09-11T07:07:07.850 INFO:teuthology.orchestra.run.smithi079.stdout:3120 write 0xca82530 thru 0xca924ee (0xffbf bytes) 2024-09-11T07:07:07.854 INFO:teuthology.orchestra.run.smithi079.stdout:3121 write 0x713dab2 thru 0x71415d7 (0x3b26 bytes) 2024-09-11T07:07:07.864 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:07.861+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:07.865 INFO:teuthology.orchestra.run.smithi079.stdout:3122 writesame 0xaad79e9 thru 0xaad818d data_size 0x1(0x7a5 bytes) 2024-09-11T07:07:07.881 INFO:teuthology.orchestra.run.smithi079.stdout:3125 trunc from 0xe8c247e to 0xd855e2d 2024-09-11T07:07:07.910 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:07.911 INFO:teuthology.orchestra.run.smithi079.stdout:3127 read 0x9529280 thru 0x952b35b (0x20dc bytes) 2024-09-11T07:07:07.911 INFO:teuthology.orchestra.run.smithi079.stdout:3128 writesame 0x1d94bde thru 0x1d9a7fd data_size 0x2c(0x5c20 bytes) 2024-09-11T07:07:07.914 INFO:teuthology.orchestra.run.smithi079.stdout:3129 punch from 0x8478436 to 0x8484325, (0xbeef bytes) 2024-09-11T07:07:07.914 INFO:teuthology.orchestra.run.smithi079.stdout:3130 write 0x5805894 thru 0x580e5e8 (0x8d55 bytes) 2024-09-11T07:07:07.929 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:07.929 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:07.942 INFO:teuthology.orchestra.run.smithi079.stdout:3131 writesame 0xeac54c4 thru 0xead3d0c data_size 0x7(0xe849 bytes) 2024-09-11T07:07:07.944 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:07.945 INFO:teuthology.orchestra.run.smithi079.stdout:3132 read 0xa933122 thru 0xa941ee4 (0xedc3 bytes) 2024-09-11T07:07:07.945 INFO:teuthology.orchestra.run.smithi079.stdout:3133 punch from 0xc42bb2a to 0xc42d06c, (0x1542 bytes) 2024-09-11T07:07:07.945 INFO:teuthology.orchestra.run.smithi079.stdout:3134 punch from 0x821e3b to 0x822736, (0x8fb bytes) 2024-09-11T07:07:07.946 INFO:teuthology.orchestra.run.smithi079.stdout:3135 write 0x838a678 thru 0x8395618 (0xafa1 bytes) 2024-09-11T07:07:07.956 INFO:teuthology.orchestra.run.smithi079.stdout:3136 read 0x4268095 thru 0x427378c (0xb6f8 bytes) 2024-09-11T07:07:07.956 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:07.956 INFO:teuthology.orchestra.run.smithi079.stdout:3138 read 0xb277c22 thru 0xb287509 (0xf8e8 bytes) 2024-09-11T07:07:07.956 INFO:teuthology.orchestra.run.smithi079.stdout:3139 punch from 0xa564f36 to 0xa5650af, (0x179 bytes) 2024-09-11T07:07:07.956 INFO:teuthology.orchestra.run.smithi079.stdout:3140 write 0x307ac2e thru 0x307eed2 (0x42a5 bytes) 2024-09-11T07:07:07.965 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T07:07:07.965 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:07.961+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:07.981 INFO:teuthology.orchestra.run.smithi079.stdout:3141 read 0xc0b4cc4 thru 0xc0b6f3e (0x227b bytes) 2024-09-11T07:07:07.982 INFO:teuthology.orchestra.run.smithi079.stdout:3142 read 0x74cc1e9 thru 0x74d103d (0x4e55 bytes) 2024-09-11T07:07:07.983 INFO:teuthology.orchestra.run.smithi079.stdout:3143 write 0xe3bd600 thru 0xe3c6d58 (0x9759 bytes) 2024-09-11T07:07:07.988 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T07:07:08.002 INFO:teuthology.orchestra.run.smithi079.stdout:3145 trunc from 0xead3d0d to 0x1d1dbff 2024-09-11T07:07:08.019 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:07:08.075 INFO:teuthology.orchestra.run.smithi079.stdout:3146 write 0x9080d9 thru 0x91295f (0xa887 bytes) 2024-09-11T07:07:08.076 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:08.069+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:08.080 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:08.081 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:08.096 INFO:teuthology.orchestra.run.smithi079.stdout:3147 write 0x8dedfaa thru 0x8dfc6d3 (0xe72a bytes) 2024-09-11T07:07:08.100 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:08.108 INFO:teuthology.orchestra.run.smithi079.stdout:3152 punch from 0x7a2a96b to 0x7a2e0f1, (0x3786 bytes) 2024-09-11T07:07:08.117 INFO:teuthology.orchestra.run.smithi079.stdout:3153 trunc from 0x8dfc6d4 to 0x16a52a0 2024-09-11T07:07:08.138 INFO:teuthology.orchestra.run.smithi079.stdout:3154 punch from 0x1012b44 to 0x1016f16, (0x43d2 bytes) 2024-09-11T07:07:08.138 INFO:teuthology.orchestra.run.smithi079.stdout:3155 read 0x6e5fdb thru 0x6f1850 (0xb876 bytes) 2024-09-11T07:07:08.139 INFO:teuthology.orchestra.run.smithi079.stdout:3156 writesame 0x5304a2 thru 0x53cd53 data_size 0x3(0xc8b2 bytes) 2024-09-11T07:07:08.163 INFO:teuthology.orchestra.run.smithi079.stdout:3157 writesame 0x5610b92 thru 0x561127e data_size 0x3(0x6ed bytes) 2024-09-11T07:07:08.168 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:08.165+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:08.184 INFO:teuthology.orchestra.run.smithi079.stdout:3158 write 0xe195e06 thru 0xe197a54 (0x1c4f bytes) 2024-09-11T07:07:08.190 INFO:teuthology.orchestra.run.smithi079.stdout:3159 punch from 0xaedb552 to 0xaee43ac, (0x8e5a bytes) 2024-09-11T07:07:08.190 INFO:teuthology.orchestra.run.smithi079.stdout:3160 write 0xa291671 thru 0xa2953e7 (0x3d77 bytes) 2024-09-11T07:07:08.197 INFO:teuthology.orchestra.run.smithi079.stdout:3162 writesame 0x8ee95c2 thru 0x8ef18e4 data_size 0x1(0x8323 bytes) 2024-09-11T07:07:08.229 INFO:teuthology.orchestra.run.smithi079.stdout:3163 punch from 0x2a2f33 to 0x2aa911, (0x79de bytes) 2024-09-11T07:07:08.229 INFO:teuthology.orchestra.run.smithi079.stdout:3164 write 0xb5c9889 thru 0xb5d0e6e (0x75e6 bytes) 2024-09-11T07:07:08.234 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:08.234 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:08.240 INFO:teuthology.orchestra.run.smithi079.stdout:3168 write 0xb5a7df9 thru 0xb5aaead (0x30b5 bytes) 2024-09-11T07:07:08.243 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.243 INFO:teuthology.orchestra.run.smithi079.stdout:3170 punch from 0x6e70872 to 0x6e74dd5, (0x4563 bytes) 2024-09-11T07:07:08.243 INFO:teuthology.orchestra.run.smithi079.stdout:3171 read 0xc973bd2 thru 0xc97bc10 (0x803f bytes) 2024-09-11T07:07:08.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:08.261 INFO:teuthology.orchestra.run.smithi079.stdout:3172 trunc from 0xe197a55 to 0x13479eb 2024-09-11T07:07:08.269 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:08.268+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:08.292 INFO:teuthology.orchestra.run.smithi079.stdout:3174 read 0xad1e74 thru 0xadbee1 (0xa06e bytes) 2024-09-11T07:07:08.309 INFO:teuthology.orchestra.run.smithi079.stdout:3176 write 0x374c259 thru 0x37519dd (0x5785 bytes) 2024-09-11T07:07:08.317 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.335 INFO:teuthology.orchestra.run.smithi079.stdout:3178 writesame 0x7119f13 thru 0x711cac7 data_size 0x1(0x2bb5 bytes) 2024-09-11T07:07:08.335 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.335 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.337 INFO:teuthology.orchestra.run.smithi079.stdout:3182 trunc from 0x711cac8 to 0x8f5df03 2024-09-11T07:07:08.360 INFO:teuthology.orchestra.run.smithi079.stdout:3184 trunc from 0x8f5df03 to 0xe9a73f5 2024-09-11T07:07:08.369 INFO:teuthology.orchestra.run.smithi079.stdout:3188 write 0x265d78e thru 0x26695a9 (0xbe1c bytes) 2024-09-11T07:07:08.379 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:08.379 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:08.383 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.398 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:08.398 INFO:teuthology.orchestra.run.smithi079.stdout:3190 trunc from 0xe9a73f5 to 0x2d031eb 2024-09-11T07:07:08.403 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:08.368+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:08.416 INFO:teuthology.orchestra.run.smithi079.stdout:3192 punch from 0x2b7591a to 0x2b832d1, (0xd9b7 bytes) 2024-09-11T07:07:08.430 INFO:teuthology.orchestra.run.smithi079.stdout:3194 write 0x578231e thru 0x5787256 (0x4f39 bytes) 2024-09-11T07:07:08.445 INFO:teuthology.orchestra.run.smithi079.stdout:3195 trunc from 0x5787257 to 0xb9cad60 2024-09-11T07:07:08.453 INFO:teuthology.orchestra.run.smithi079.stdout:3196 read 0x2ed8625 thru 0x2ee222c (0x9c08 bytes) 2024-09-11T07:07:08.454 INFO:teuthology.orchestra.run.smithi079.stdout:3197 writesame 0x66d12ab thru 0x66d7cfb data_size 0x1(0x6a51 bytes) 2024-09-11T07:07:08.470 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:08.465+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:08.483 INFO:teuthology.orchestra.run.smithi079.stdout:3198 trunc from 0xb9cad60 to 0x3d09684 2024-09-11T07:07:08.506 INFO:teuthology.orchestra.run.smithi079.stdout:3200 read 0x21d1cb3 thru 0x21dd8bf (0xbc0d bytes) 2024-09-11T07:07:08.507 INFO:teuthology.orchestra.run.smithi079.stdout:3201 punch from 0x347b9ed to 0x348099d, (0x4fb0 bytes) 2024-09-11T07:07:08.520 INFO:teuthology.orchestra.run.smithi079.stdout:3202 writesame 0x4c3488a thru 0x4c34fd0 data_size 0x1(0x747 bytes) 2024-09-11T07:07:08.547 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:08.548 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:08.548 INFO:teuthology.orchestra.run.smithi079.stdout:3203 write 0xb61406d thru 0xb61ad49 (0x6cdd bytes) 2024-09-11T07:07:08.557 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.557 INFO:teuthology.orchestra.run.smithi079.stdout:3205 read 0x4a76fe thru 0x4b64fc (0xedff bytes) 2024-09-11T07:07:08.563 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:08.565 INFO:teuthology.orchestra.run.smithi079.stdout:3206 trunc from 0xb61ad4a to 0xd91ab8c 2024-09-11T07:07:08.575 INFO:teuthology.orchestra.run.smithi079.stdout:3208 write 0xb93005a thru 0xb93eb84 (0xeb2b bytes) 2024-09-11T07:07:08.582 INFO:teuthology.orchestra.run.smithi079.stdout:3209 punch from 0xbe32f12 to 0xbe3da91, (0xab7f bytes) 2024-09-11T07:07:08.582 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.583 INFO:teuthology.orchestra.run.smithi079.stdout:3211 read 0x761743e thru 0x7622307 (0xaeca bytes) 2024-09-11T07:07:08.593 INFO:teuthology.orchestra.run.smithi079.stdout:3212 write 0xed5e70b thru 0xed63969 (0x525f bytes) 2024-09-11T07:07:08.599 INFO:teuthology.orchestra.run.smithi079.stdout:3213 writesame 0x8ebb16d thru 0x8ebcf68 data_size 0x13(0x1dfc bytes) 2024-09-11T07:07:08.608 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:08.608+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:08.627 INFO:teuthology.orchestra.run.smithi079.stdout:3216 trunc from 0xed6396a to 0x6a02c15 2024-09-11T07:07:08.645 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.645 INFO:teuthology.orchestra.run.smithi079.stdout:3218 writesame 0x29229e4 thru 0x2927bda data_size 0x1(0x51f7 bytes) 2024-09-11T07:07:08.668 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.672 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:08.669+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:08.693 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:08.693 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:08.695 INFO:teuthology.orchestra.run.smithi079.stdout:3220 write 0xc64233e thru 0xc64a5b3 (0x8276 bytes) 2024-09-11T07:07:08.708 INFO:teuthology.orchestra.run.smithi079.stdout:3222 writesame 0x4716bf4 thru 0x4723eb4 data_size 0x1(0xd2c1 bytes) 2024-09-11T07:07:08.710 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:08.730 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.730 INFO:teuthology.orchestra.run.smithi079.stdout:3226 punch from 0x47d8e6e to 0x47deab4, (0x5c46 bytes) 2024-09-11T07:07:08.730 INFO:teuthology.orchestra.run.smithi079.stdout:3228 write 0x1faf440 thru 0x1fb5383 (0x5f44 bytes) 2024-09-11T07:07:08.733 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.733 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.733 INFO:teuthology.orchestra.run.smithi079.stdout:3231 read 0x3f11588 thru 0x3f1f21d (0xdc96 bytes) 2024-09-11T07:07:08.745 INFO:teuthology.orchestra.run.smithi079.stdout:3232 write 0xc6edc59 thru 0xc6f0f47 (0x32ef bytes) 2024-09-11T07:07:08.752 INFO:teuthology.orchestra.run.smithi079.stdout:3233 read 0x1bdc2a thru 0x1c6535 (0x890c bytes) 2024-09-11T07:07:08.769 INFO:teuthology.orchestra.run.smithi079.stdout:3235 write 0xed91bb8 thru 0xeda149d (0xf8e6 bytes) 2024-09-11T07:07:08.780 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.780 INFO:teuthology.orchestra.run.smithi079.stdout:3238 writesame 0x9d46a6b thru 0x9d5569e data_size 0x6(0xec34 bytes) 2024-09-11T07:07:08.796 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:08.796+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:08.798 INFO:teuthology.orchestra.run.smithi079.stdout:3239 read 0x78b4a78 thru 0x78c4802 (0xfd8b bytes) 2024-09-11T07:07:08.828 INFO:teuthology.orchestra.run.smithi079.stdout:3241 trunc from 0xeda149e to 0x3264350 2024-09-11T07:07:08.874 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:08.869+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:08.877 INFO:teuthology.orchestra.run.smithi079.stdout:3242 write 0x4eab586 thru 0x4eac789 (0x1204 bytes) 2024-09-11T07:07:08.884 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:08.886 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:08.886 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:08.900 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:08.909 INFO:teuthology.orchestra.run.smithi079.stdout:3245 trunc from 0x4eac78a to 0xeda1d65 2024-09-11T07:07:08.949 INFO:teuthology.orchestra.run.smithi079.stdout:3246 trunc from 0xeda1d65 to 0x110ebcb 2024-09-11T07:07:08.970 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T07:07:08.975 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:08.969+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:08.976 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:07:08.990 INFO:teuthology.orchestra.run.smithi079.stdout:3247 write 0x130da04 thru 0x1313b6d (0x616a bytes) 2024-09-11T07:07:08.992 INFO:teuthology.orchestra.run.smithi079.stdout:3248 read 0xf741b4 thru 0xf7c044 (0x7e91 bytes) 2024-09-11T07:07:08.993 INFO:teuthology.orchestra.run.smithi079.stdout:3251 read 0x6765ba thru 0x67ab28 (0x456f bytes) 2024-09-11T07:07:08.994 INFO:teuthology.orchestra.run.smithi079.stdout:3252 read 0xdcfbb1 thru 0xddab7e (0xafce bytes) 2024-09-11T07:07:09.006 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T07:07:09.006 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:07:09.024 INFO:teuthology.orchestra.run.smithi079.stdout:3253 writesame 0xd0da1fd thru 0xd0e288a data_size 0x3(0x868e bytes) 2024-09-11T07:07:09.024 INFO:teuthology.orchestra.run.smithi079.stdout:3254 read 0xea6177 thru 0xeae497 (0x8321 bytes) 2024-09-11T07:07:09.025 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.031 INFO:teuthology.orchestra.run.smithi079.stdout:3257 trunc from 0xd0e288b to 0x8fcc468 2024-09-11T07:07:09.055 INFO:teuthology.orchestra.run.smithi079.stdout:3258 writesame 0x9b4ee19 thru 0x9b5a42e data_size 0x33(0xb616 bytes) 2024-09-11T07:07:09.071 INFO:teuthology.orchestra.run.smithi079.stdout:3261 writesame 0xbf31f85 thru 0xbf40852 data_size 0x4d(0xe8ce bytes) 2024-09-11T07:07:09.071 INFO:teuthology.orchestra.run.smithi079.stdout:3263 flatten 2024-09-11T07:07:09.075 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:09.069+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:09.084 INFO:teuthology.orchestra.run.smithi079.stdout:3264 read 0x48598d thru 0x48b2e3 (0x5957 bytes) 2024-09-11T07:07:09.086 INFO:teuthology.orchestra.run.smithi079.stdout:3265 punch from 0xe8ee2e to 0xe9aa17, (0xbbe9 bytes) 2024-09-11T07:07:09.086 INFO:teuthology.orchestra.run.smithi079.stdout:3267 punch from 0x67b6456 to 0x67b7e3f, (0x19e9 bytes) 2024-09-11T07:07:09.086 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.086 INFO:teuthology.orchestra.run.smithi079.stdout:3269 writesame 0x4eb2b2c thru 0x4ec25b4 data_size 0x1(0xfa89 bytes) 2024-09-11T07:07:09.087 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:09.087 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:09.107 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:09.113 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.113 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.113 INFO:teuthology.orchestra.run.smithi079.stdout:3273 write 0xb71ac68 thru 0xb7252fb (0xa694 bytes) 2024-09-11T07:07:09.122 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.122 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.122 INFO:teuthology.orchestra.run.smithi079.stdout:3276 writesame 0x3729e4b thru 0x372b2c7 data_size 0x1(0x147d bytes) 2024-09-11T07:07:09.129 INFO:teuthology.orchestra.run.smithi079.stdout:3277 read 0x85a7489 thru 0x85b7243 (0xfdbb bytes) 2024-09-11T07:07:09.129 INFO:teuthology.orchestra.run.smithi079.stdout:3278 punch from 0x5c10c94 to 0x5c1576f, (0x4adb bytes) 2024-09-11T07:07:09.129 INFO:teuthology.orchestra.run.smithi079.stdout:3279 read 0x3accd28 thru 0x3adbff4 (0xf2cd bytes) 2024-09-11T07:07:09.142 INFO:teuthology.orchestra.run.smithi079.stdout:3282 write 0xe5145b2 thru 0xe51be22 (0x7871 bytes) 2024-09-11T07:07:09.148 INFO:teuthology.orchestra.run.smithi079.stdout:3283 read 0xd028ec3 thru 0xd0291fa (0x338 bytes) 2024-09-11T07:07:09.148 INFO:teuthology.orchestra.run.smithi079.stdout:3284 read 0x295b2f6 thru 0x29647c0 (0x94cb bytes) 2024-09-11T07:07:09.149 INFO:teuthology.orchestra.run.smithi079.stdout:3285 writesame 0xc41a4f7 thru 0xc429532 data_size 0xcd(0xf03c bytes) 2024-09-11T07:07:09.164 INFO:teuthology.orchestra.run.smithi079.stdout:3286 writesame 0xe791c23 thru 0xe791f6e data_size 0x2(0x34c bytes) 2024-09-11T07:07:09.164 INFO:teuthology.orchestra.run.smithi079.stdout:3287 writesame 0x43cd7e6 thru 0x43cf075 data_size 0x18(0x1890 bytes) 2024-09-11T07:07:09.172 INFO:teuthology.orchestra.run.smithi079.stdout:3288 trunc from 0xe791f6f to 0xcb8effe 2024-09-11T07:07:09.176 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:09.176+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:09.184 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.184 INFO:teuthology.orchestra.run.smithi079.stdout:3293 write 0x1eb8215 thru 0x1ec2364 (0xa150 bytes) 2024-09-11T07:07:09.186 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.186 INFO:teuthology.orchestra.run.smithi079.stdout:3296 punch from 0x48956e0 to 0x48a015d, (0xaa7d bytes) 2024-09-11T07:07:09.187 INFO:teuthology.orchestra.run.smithi079.stdout:3297 punch from 0x84b79bc to 0x84c6e28, (0xf46c bytes) 2024-09-11T07:07:09.187 INFO:teuthology.orchestra.run.smithi079.stdout:3298 write 0x8096e7f thru 0x80a3cd5 (0xce57 bytes) 2024-09-11T07:07:09.194 INFO:teuthology.orchestra.run.smithi079.stdout:3299 writesame 0x4bbd0f8 thru 0x4bbe1a5 data_size 0x23(0x10ae bytes) 2024-09-11T07:07:09.196 INFO:teuthology.orchestra.run.smithi079.stdout:3302 punch from 0x1ece6cc to 0x1ed2fac, (0x48e0 bytes) 2024-09-11T07:07:09.196 INFO:teuthology.orchestra.run.smithi079.stdout:3303 read 0x7f9c8ef thru 0x7fa4bda (0x82ec bytes) 2024-09-11T07:07:09.197 INFO:teuthology.orchestra.run.smithi079.stdout:3304 writesame 0x89d3ef3 thru 0x89e04c4 data_size 0x1(0xc5d2 bytes) 2024-09-11T07:07:09.222 INFO:teuthology.orchestra.run.smithi079.stdout:3305 write 0x851affc thru 0x8527d0c (0xcd11 bytes) 2024-09-11T07:07:09.246 INFO:teuthology.orchestra.run.smithi079.stdout:3306 trunc from 0xcb8effe to 0x202caa4 2024-09-11T07:07:09.246 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:09.246 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:09.266 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:09.281 INFO:teuthology.orchestra.run.smithi079.stdout:3308 writesame 0x29c0e30 thru 0x29cb753 data_size 0x32(0xa924 bytes) 2024-09-11T07:07:09.281 INFO:teuthology.orchestra.run.smithi079.stdout:3309 writesame 0x22b0cff thru 0x22b8575 data_size 0x1(0x7877 bytes) 2024-09-11T07:07:09.303 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.308 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:09.308+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:09.322 INFO:teuthology.orchestra.run.smithi079.stdout:3313 write 0x79e9216 thru 0x79efe82 (0x6c6d bytes) 2024-09-11T07:07:09.328 INFO:teuthology.orchestra.run.smithi079.stdout:3314 read 0x78f0e73 thru 0x78ff7f5 (0xe983 bytes) 2024-09-11T07:07:09.329 INFO:teuthology.orchestra.run.smithi079.stdout:3315 punch from 0x6257892 to 0x6261438, (0x9ba6 bytes) 2024-09-11T07:07:09.329 INFO:teuthology.orchestra.run.smithi079.stdout:3316 read 0x6556276 thru 0x655d1f8 (0x6f83 bytes) 2024-09-11T07:07:09.329 INFO:teuthology.orchestra.run.smithi079.stdout:3317 writesame 0x48b20f5 thru 0x48bc3bd data_size 0x1d(0xa2c9 bytes) 2024-09-11T07:07:09.345 INFO:teuthology.orchestra.run.smithi079.stdout:3318 trunc from 0x79efe83 to 0xb416079 2024-09-11T07:07:09.353 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.353 INFO:teuthology.orchestra.run.smithi079.stdout:3320 write 0x71114cc thru 0x7113be1 (0x2716 bytes) 2024-09-11T07:07:09.355 INFO:teuthology.orchestra.run.smithi079.stdout:3321 write 0x2b78635 thru 0x2b7f42f (0x6dfb bytes) 2024-09-11T07:07:09.358 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:07:09.359 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:07:09.360 INFO:teuthology.orchestra.run.smithi079.stdout:3322 read 0xa950ce9 thru 0xa957330 (0x6648 bytes) 2024-09-11T07:07:09.360 INFO:teuthology.orchestra.run.smithi079.stdout:3324 punch from 0xadb753d to 0xadc69f7, (0xf4ba bytes) 2024-09-11T07:07:09.360 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.360 INFO:teuthology.orchestra.run.smithi079.stdout:3326 punch from 0x8728f31 to 0x872d522, (0x45f1 bytes) 2024-09-11T07:07:09.361 INFO:teuthology.orchestra.run.smithi079.stdout:3327 writesame 0x57fe9c0 thru 0x580474b data_size 0x2(0x5d8c bytes) 2024-09-11T07:07:09.377 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:09.373+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:09.379 INFO:teuthology.orchestra.run.smithi079.stdout:3328 write 0xbd2ad12 thru 0xbd32332 (0x7621 bytes) 2024-09-11T07:07:09.380 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-11T07:07:08.975705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811401059,"num_objects":1180,"num_object_clones":269,"num_object_copies":2360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":357,"num_read":92302,"num_read_kb":438185,"num_write":10065,"num_write_kb":298644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":49495571,"num_keys_recovered":130,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8077,"ondisk_log_size":8077,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":278744,"kb_used_data":43752,"kb_used_omap":10,"kb_used_meta":234805,"kb_avail":660324136,"statfs":{"total":676457349120,"available":676171915264,"internally_reserved":0,"allocated":44802048,"data_stored":597005696,"data_compressed":11699892,"data_compressed_allocated":32616448,"data_compressed_original":590769686,"omap_allocated":11164,"internal_metadata":240440420},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14413676,"num_objects":52,"num_object_clones":6,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":5284,"num_read_kb":85306,"num_write":1155,"num_write_kb":17538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029142"},"pg_stats":[{"pgid":"3.1f","version":"77'299","reported_seq":2380,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971858+0000","last_change":"2024-09-11T07:07:00.913312+0000","last_active":"2024-09-11T07:07:05.971858+0000","last_peered":"2024-09-11T07:07:05.971858+0000","last_clean":"2024-09-11T07:07:05.971858+0000","last_became_active":"2024-09-11T07:07:00.912449+0000","last_became_peered":"2024-09-11T07:07:00.912449+0000","last_unstale":"2024-09-11T07:07:05.971858+0000","last_undegraded":"2024-09-11T07:07:05.971858+0000","last_fullsized":"2024-09-11T07:07:05.971858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:49.246508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097647200000000004,"stat_sum":{"num_bytes":9416788,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":18,"num_read":2478,"num_read_kb":4566,"num_write":406,"num_write_kb":16504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1716442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"77'181","reported_seq":1351,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.225655+0000","last_change":"2024-09-11T07:06:00.970173+0000","last_active":"2024-09-11T07:07:06.225655+0000","last_peered":"2024-09-11T07:07:06.225655+0000","last_clean":"2024-09-11T07:07:06.225655+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:07:06.225655+0000","last_undegraded":"2024-09-11T07:07:06.225655+0000","last_fullsized":"2024-09-11T07:07:06.225655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:44.996277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084787600000000001,"stat_sum":{"num_bytes":24848135,"num_objects":35,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":8,"num_read":1399,"num_read_kb":15041,"num_write":220,"num_write_kb":8269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"77'148","reported_seq":4176,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971820+0000","last_change":"2024-09-11T07:06:00.825433+0000","last_active":"2024-09-11T07:07:05.971820+0000","last_peered":"2024-09-11T07:07:05.971820+0000","last_clean":"2024-09-11T07:07:05.971820+0000","last_became_active":"2024-09-11T07:05:58.827234+0000","last_became_peered":"2024-09-11T07:05:58.827234+0000","last_unstale":"2024-09-11T07:07:05.971820+0000","last_undegraded":"2024-09-11T07:07:05.971820+0000","last_fullsized":"2024-09-11T07:07:05.971820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:03.606750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550473,"stat_sum":{"num_bytes":50369827,"num_objects":36,"num_object_clones":9,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":4839,"num_read_kb":28064,"num_write":142,"num_write_kb":6031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"78'154","reported_seq":2009,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.224123+0000","last_change":"2024-09-11T07:06:00.827149+0000","last_active":"2024-09-11T07:07:06.224123+0000","last_peered":"2024-09-11T07:07:06.224123+0000","last_clean":"2024-09-11T07:07:06.224123+0000","last_became_active":"2024-09-11T07:05:58.826843+0000","last_became_peered":"2024-09-11T07:05:58.826843+0000","last_unstale":"2024-09-11T07:07:06.224123+0000","last_undegraded":"2024-09-11T07:07:06.224123+0000","last_fullsized":"2024-09-11T07:07:06.224123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:20:29.070443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022332319999999999,"stat_sum":{"num_bytes":29112401,"num_objects":47,"num_object_clones":12,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":1851,"num_read_kb":12516,"num_write":157,"num_write_kb":8873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'231","reported_seq":1179,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.950366+0000","last_change":"2024-09-11T07:07:00.905220+0000","last_active":"2024-09-11T07:07:05.950366+0000","last_peered":"2024-09-11T07:07:05.950366+0000","last_clean":"2024-09-11T07:07:05.950366+0000","last_became_active":"2024-09-11T07:07:00.904412+0000","last_became_peered":"2024-09-11T07:07:00.904412+0000","last_unstale":"2024-09-11T07:07:05.950366+0000","last_undegraded":"2024-09-11T07:07:05.950366+0000","last_fullsized":"2024-09-11T07:07:05.950366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:18.928946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001182787,"stat_sum":{"num_bytes":7007482,"num_objects":30,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":2145,"num_read_kb":4919,"num_write":295,"num_write_kb":3012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":1396946,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"74'242","reported_seq":2595,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.223941+0000","last_change":"2024-09-11T07:06:00.813235+0000","last_active":"2024-09-11T07:07:06.223941+0000","last_peered":"2024-09-11T07:07:06.223941+0000","last_clean":"2024-09-11T07:07:06.223941+0000","last_became_active":"2024-09-11T07:05:58.808656+0000","last_became_peered":"2024-09-11T07:05:58.808656+0000","last_unstale":"2024-09-11T07:07:06.223941+0000","last_undegraded":"2024-09-11T07:07:06.223941+0000","last_fullsized":"2024-09-11T07:07:06.223941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:22:48.767867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059322499999999996,"stat_sum":{"num_bytes":8775313,"num_objects":29,"num_object_clones":7,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":10,"num_read":4436,"num_read_kb":7568,"num_write":297,"num_write_kb":3131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"78'246","reported_seq":1355,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.152189+0000","last_change":"2024-09-11T07:06:00.820857+0000","last_active":"2024-09-11T07:07:06.152189+0000","last_peered":"2024-09-11T07:07:06.152189+0000","last_clean":"2024-09-11T07:07:06.152189+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:07:06.152189+0000","last_undegraded":"2024-09-11T07:07:06.152189+0000","last_fullsized":"2024-09-11T07:07:06.152189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:34.793311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076385799999999996,"stat_sum":{"num_bytes":22673269,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":9,"num_read":1694,"num_read_kb":5119,"num_write":331,"num_write_kb":3504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"78'261","reported_seq":2704,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.420029+0000","last_change":"2024-09-11T07:07:00.913189+0000","last_active":"2024-09-11T07:07:06.420029+0000","last_peered":"2024-09-11T07:07:06.420029+0000","last_clean":"2024-09-11T07:07:06.420029+0000","last_became_active":"2024-09-11T07:07:00.911170+0000","last_became_peered":"2024-09-11T07:07:00.911170+0000","last_unstale":"2024-09-11T07:07:06.420029+0000","last_undegraded":"2024-09-11T07:07:06.420029+0000","last_fullsized":"2024-09-11T07:07:06.420029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:55.282280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001212451,"stat_sum":{"num_bytes":18298607,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":13,"num_read":3682,"num_read_kb":10993,"num_write":291,"num_write_kb":20228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":4844589,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"78'192","reported_seq":2021,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.228012+0000","last_change":"2024-09-11T07:07:00.915270+0000","last_active":"2024-09-11T07:07:06.228012+0000","last_peered":"2024-09-11T07:07:06.228012+0000","last_clean":"2024-09-11T07:07:06.228012+0000","last_became_active":"2024-09-11T07:07:00.912592+0000","last_became_peered":"2024-09-11T07:07:00.912592+0000","last_unstale":"2024-09-11T07:07:06.228012+0000","last_undegraded":"2024-09-11T07:07:06.228012+0000","last_fullsized":"2024-09-11T07:07:06.228012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:56.354447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093584899999999999,"stat_sum":{"num_bytes":24633303,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":8,"num_read":2552,"num_read_kb":24440,"num_write":206,"num_write_kb":19813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":7459303,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"77'363","reported_seq":1943,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971728+0000","last_change":"2024-09-11T07:06:00.825499+0000","last_active":"2024-09-11T07:07:05.971728+0000","last_peered":"2024-09-11T07:07:05.971728+0000","last_clean":"2024-09-11T07:07:05.971728+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:07:05.971728+0000","last_undegraded":"2024-09-11T07:07:05.971728+0000","last_fullsized":"2024-09-11T07:07:05.971728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:57.400219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056977600000000003,"stat_sum":{"num_bytes":25328542,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":12,"num_read":2787,"num_read_kb":7253,"num_write":470,"num_write_kb":3322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"74'105","reported_seq":1840,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.949362+0000","last_change":"2024-09-11T07:06:00.837150+0000","last_active":"2024-09-11T07:07:05.949362+0000","last_peered":"2024-09-11T07:07:05.949362+0000","last_clean":"2024-09-11T07:07:05.949362+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:07:05.949362+0000","last_undegraded":"2024-09-11T07:07:05.949362+0000","last_fullsized":"2024-09-11T07:07:05.949362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:39.863779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184086,"stat_sum":{"num_bytes":16530436,"num_objects":34,"num_object_clones":9,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":1703,"num_read_kb":12809,"num_write":103,"num_write_kb":7635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"77'264","reported_seq":2035,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.417833+0000","last_change":"2024-09-11T07:06:00.812896+0000","last_active":"2024-09-11T07:07:06.417833+0000","last_peered":"2024-09-11T07:07:06.417833+0000","last_clean":"2024-09-11T07:07:06.417833+0000","last_became_active":"2024-09-11T07:05:58.814550+0000","last_became_peered":"2024-09-11T07:05:58.814550+0000","last_unstale":"2024-09-11T07:07:06.417833+0000","last_undegraded":"2024-09-11T07:07:06.417833+0000","last_fullsized":"2024-09-11T07:07:06.417833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:21.898369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046265999999999999,"stat_sum":{"num_bytes":14738924,"num_objects":41,"num_object_clones":9,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":14,"num_read":3700,"num_read_kb":11786,"num_write":303,"num_write_kb":5927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.950050+0000","last_change":"2024-09-11T07:06:26.962907+0000","last_active":"2024-09-11T07:07:05.950050+0000","last_peered":"2024-09-11T07:07:05.950050+0000","last_clean":"2024-09-11T07:07:05.950050+0000","last_became_active":"2024-09-11T07:06:26.962135+0000","last_became_peered":"2024-09-11T07:06:26.962135+0000","last_unstale":"2024-09-11T07:07:05.950050+0000","last_undegraded":"2024-09-11T07:07:05.950050+0000","last_fullsized":"2024-09-11T07:07:05.950050+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:32.560330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"78'262","reported_seq":2283,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.158009+0000","last_change":"2024-09-11T07:07:00.914196+0000","last_active":"2024-09-11T07:07:06.158009+0000","last_peered":"2024-09-11T07:07:06.158009+0000","last_clean":"2024-09-11T07:07:06.158009+0000","last_became_active":"2024-09-11T07:07:00.912070+0000","last_became_peered":"2024-09-11T07:07:00.912070+0000","last_unstale":"2024-09-11T07:07:06.158009+0000","last_undegraded":"2024-09-11T07:07:06.158009+0000","last_fullsized":"2024-09-11T07:07:06.158009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:45:33.416393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056190700000000005,"stat_sum":{"num_bytes":44185825,"num_objects":44,"num_object_clones":13,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":13,"num_read":2322,"num_read_kb":12198,"num_write":312,"num_write_kb":7858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":5329407,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.956322+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:07:05.956322+0000","last_peered":"2024-09-11T07:07:05.956322+0000","last_clean":"2024-09-11T07:07:05.956322+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:07:05.956322+0000","last_undegraded":"2024-09-11T07:07:05.956322+0000","last_fullsized":"2024-09-11T07:07:05.956322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"77'484","reported_seq":1772,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.224428+0000","last_change":"2024-09-11T07:06:00.969789+0000","last_active":"2024-09-11T07:07:06.224428+0000","last_peered":"2024-09-11T07:07:06.224428+0000","last_clean":"2024-09-11T07:07:06.224428+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:07:06.224428+0000","last_undegraded":"2024-09-11T07:07:06.224428+0000","last_fullsized":"2024-09-11T07:07:06.224428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:19.893099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068823799999999998,"stat_sum":{"num_bytes":15670804,"num_objects":48,"num_object_clones":13,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":18,"num_read":3555,"num_read_kb":10993,"num_write":715,"num_write_kb":5060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.949505+0000","last_change":"2024-09-11T07:06:57.876106+0000","last_active":"2024-09-11T07:07:05.949505+0000","last_peered":"2024-09-11T07:07:05.949505+0000","last_clean":"2024-09-11T07:07:05.949505+0000","last_became_active":"2024-09-11T07:06:57.875190+0000","last_became_peered":"2024-09-11T07:06:57.875190+0000","last_unstale":"2024-09-11T07:07:05.949505+0000","last_undegraded":"2024-09-11T07:07:05.949505+0000","last_fullsized":"2024-09-11T07:07:05.949505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:44:24.573352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"75'134","reported_seq":3273,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.956450+0000","last_change":"2024-09-11T07:06:00.821584+0000","last_active":"2024-09-11T07:07:05.956450+0000","last_peered":"2024-09-11T07:07:05.956450+0000","last_clean":"2024-09-11T07:07:05.956450+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:07:05.956450+0000","last_undegraded":"2024-09-11T07:07:05.956450+0000","last_fullsized":"2024-09-11T07:07:05.956450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:13:58.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001413975,"stat_sum":{"num_bytes":22852498,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":9,"num_read":3276,"num_read_kb":22145,"num_write":129,"num_write_kb":5011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.956498+0000","last_change":"2024-09-11T07:06:57.872595+0000","last_active":"2024-09-11T07:07:05.956498+0000","last_peered":"2024-09-11T07:07:05.956498+0000","last_clean":"2024-09-11T07:07:05.956498+0000","last_became_active":"2024-09-11T07:06:57.872268+0000","last_became_peered":"2024-09-11T07:06:57.872268+0000","last_unstale":"2024-09-11T07:07:05.956498+0000","last_undegraded":"2024-09-11T07:07:05.956498+0000","last_fullsized":"2024-09-11T07:07:05.956498+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:51.009453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"77'353","reported_seq":1781,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971769+0000","last_change":"2024-09-11T07:06:00.827482+0000","last_active":"2024-09-11T07:07:05.971769+0000","last_peered":"2024-09-11T07:07:05.971769+0000","last_clean":"2024-09-11T07:07:05.971769+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:07:05.971769+0000","last_undegraded":"2024-09-11T07:07:05.971769+0000","last_fullsized":"2024-09-11T07:07:05.971769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:43:17.878538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002494839,"stat_sum":{"num_bytes":23727463,"num_objects":38,"num_object_clones":6,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":2430,"num_read_kb":5079,"num_write":492,"num_write_kb":3437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"77'250","reported_seq":2319,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.950426+0000","last_change":"2024-09-11T07:07:00.910232+0000","last_active":"2024-09-11T07:07:05.950426+0000","last_peered":"2024-09-11T07:07:05.950426+0000","last_clean":"2024-09-11T07:07:05.950426+0000","last_became_active":"2024-09-11T07:07:00.907922+0000","last_became_peered":"2024-09-11T07:07:00.907922+0000","last_unstale":"2024-09-11T07:07:05.950426+0000","last_undegraded":"2024-09-11T07:07:05.950426+0000","last_fullsized":"2024-09-11T07:07:05.950426+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:45:52.605093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040103300000000002,"stat_sum":{"num_bytes":23666581,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":2289,"num_read_kb":9165,"num_write":319,"num_write_kb":6890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":2632451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971297+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:07:05.971297+0000","last_peered":"2024-09-11T07:07:05.971297+0000","last_clean":"2024-09-11T07:07:05.971297+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:07:05.971297+0000","last_undegraded":"2024-09-11T07:07:05.971297+0000","last_fullsized":"2024-09-11T07:07:05.971297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"78'327","reported_seq":3554,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.170417+0000","last_change":"2024-09-11T07:06:00.820656+0000","last_active":"2024-09-11T07:07:06.170417+0000","last_peered":"2024-09-11T07:07:06.170417+0000","last_clean":"2024-09-11T07:07:06.170417+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:07:06.170417+0000","last_undegraded":"2024-09-11T07:07:06.170417+0000","last_fullsized":"2024-09-11T07:07:06.170417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:43.102443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058463999999999999,"stat_sum":{"num_bytes":84898488,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":10,"num_read":4230,"num_read_kb":35305,"num_write":387,"num_write_kb":25718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.949623+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:07:05.949623+0000","last_peered":"2024-09-11T07:07:05.949623+0000","last_clean":"2024-09-11T07:07:05.949623+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:07:05.949623+0000","last_undegraded":"2024-09-11T07:07:05.949623+0000","last_fullsized":"2024-09-11T07:07:05.949623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"78'206","reported_seq":3132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.400120+0000","last_change":"2024-09-11T07:07:00.913625+0000","last_active":"2024-09-11T07:07:06.400120+0000","last_peered":"2024-09-11T07:07:06.400120+0000","last_clean":"2024-09-11T07:07:06.400120+0000","last_became_active":"2024-09-11T07:07:00.912106+0000","last_became_peered":"2024-09-11T07:07:00.912106+0000","last_unstale":"2024-09-11T07:07:06.400120+0000","last_undegraded":"2024-09-11T07:07:06.400120+0000","last_fullsized":"2024-09-11T07:07:06.400120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:40.219417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070404599999999995,"stat_sum":{"num_bytes":36256976,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":8,"num_read":3765,"num_read_kb":26275,"num_write":224,"num_write_kb":20917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":15817603,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.949034+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:07:05.949034+0000","last_peered":"2024-09-11T07:07:05.949034+0000","last_clean":"2024-09-11T07:07:05.949034+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:07:05.949034+0000","last_undegraded":"2024-09-11T07:07:05.949034+0000","last_fullsized":"2024-09-11T07:07:05.949034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"78'201","reported_seq":563,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.953570+0000","last_change":"2024-09-11T07:06:00.970754+0000","last_active":"2024-09-11T07:07:05.953570+0000","last_peered":"2024-09-11T07:07:05.953570+0000","last_clean":"2024-09-11T07:07:05.953570+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:07:05.953570+0000","last_undegraded":"2024-09-11T07:07:05.953570+0000","last_fullsized":"2024-09-11T07:07:05.953570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:02:03.547902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013822890000000001,"stat_sum":{"num_bytes":5315041,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":759,"num_read_kb":3026,"num_write":270,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971276+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:07:05.971276+0000","last_peered":"2024-09-11T07:07:05.971276+0000","last_clean":"2024-09-11T07:07:05.971276+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:07:05.971276+0000","last_undegraded":"2024-09-11T07:07:05.971276+0000","last_fullsized":"2024-09-11T07:07:05.971276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":299,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.948199+0000","last_change":"2024-09-11T07:07:00.907608+0000","last_active":"2024-09-11T07:07:05.948199+0000","last_peered":"2024-09-11T07:07:05.948199+0000","last_clean":"2024-09-11T07:07:05.948199+0000","last_became_active":"2024-09-11T07:07:00.907199+0000","last_became_peered":"2024-09-11T07:07:00.907199+0000","last_unstale":"2024-09-11T07:07:05.948199+0000","last_undegraded":"2024-09-11T07:07:05.948199+0000","last_fullsized":"2024-09-11T07:07:05.948199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:37.571030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"77'173","reported_seq":2288,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.224548+0000","last_change":"2024-09-11T07:06:00.970646+0000","last_active":"2024-09-11T07:07:06.224548+0000","last_peered":"2024-09-11T07:07:06.224548+0000","last_clean":"2024-09-11T07:07:06.224548+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:07:06.224548+0000","last_undegraded":"2024-09-11T07:07:06.224548+0000","last_fullsized":"2024-09-11T07:07:06.224548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:46:16.919051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012611810000000001,"stat_sum":{"num_bytes":18784168,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":14,"num_read":2059,"num_read_kb":10154,"num_write":177,"num_write_kb":5366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"78'132","reported_seq":1181,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.226210+0000","last_change":"2024-09-11T07:06:00.813164+0000","last_active":"2024-09-11T07:07:06.226210+0000","last_peered":"2024-09-11T07:07:06.226210+0000","last_clean":"2024-09-11T07:07:06.226210+0000","last_became_active":"2024-09-11T07:05:59.016079+0000","last_became_peered":"2024-09-11T07:05:59.016079+0000","last_unstale":"2024-09-11T07:07:06.226210+0000","last_undegraded":"2024-09-11T07:07:06.226210+0000","last_fullsized":"2024-09-11T07:07:06.226210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:41.872303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062012700000000005,"stat_sum":{"num_bytes":25933903,"num_objects":35,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":1163,"num_read_kb":7678,"num_write":116,"num_write_kb":2623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"78'312","reported_seq":1263,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.226446+0000","last_change":"2024-09-11T07:06:26.964107+0000","last_active":"2024-09-11T07:07:06.226446+0000","last_peered":"2024-09-11T07:07:06.226446+0000","last_clean":"2024-09-11T07:07:06.226446+0000","last_became_active":"2024-09-11T07:06:26.960126+0000","last_became_peered":"2024-09-11T07:06:26.960126+0000","last_unstale":"2024-09-11T07:07:06.226446+0000","last_undegraded":"2024-09-11T07:07:06.226446+0000","last_fullsized":"2024-09-11T07:07:06.226446+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:07.772779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046764000000000002,"stat_sum":{"num_bytes":16399990,"num_objects":32,"num_object_clones":4,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":11,"num_read":2315,"num_read_kb":5768,"num_write":412,"num_write_kb":2894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"78'258","reported_seq":1895,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.424183+0000","last_change":"2024-09-11T07:07:00.915151+0000","last_active":"2024-09-11T07:07:06.424183+0000","last_peered":"2024-09-11T07:07:06.424183+0000","last_clean":"2024-09-11T07:07:06.424183+0000","last_became_active":"2024-09-11T07:07:00.913932+0000","last_became_peered":"2024-09-11T07:07:00.913932+0000","last_unstale":"2024-09-11T07:07:06.424183+0000","last_undegraded":"2024-09-11T07:07:06.424183+0000","last_fullsized":"2024-09-11T07:07:06.424183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:38.408140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021149200000000002,"stat_sum":{"num_bytes":21612175,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":8,"num_read":3591,"num_read_kb":19534,"num_write":327,"num_write_kb":13958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":886826,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"77'150","reported_seq":2332,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971803+0000","last_change":"2024-09-11T07:06:00.827407+0000","last_active":"2024-09-11T07:07:05.971803+0000","last_peered":"2024-09-11T07:07:05.971803+0000","last_clean":"2024-09-11T07:07:05.971803+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:07:05.971803+0000","last_undegraded":"2024-09-11T07:07:05.971803+0000","last_fullsized":"2024-09-11T07:07:05.971803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:51.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024738579999999998,"stat_sum":{"num_bytes":19372726,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":2096,"num_read_kb":6437,"num_write":139,"num_write_kb":4669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"74'213","reported_seq":3056,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.224109+0000","last_change":"2024-09-11T07:06:00.838531+0000","last_active":"2024-09-11T07:07:06.224109+0000","last_peered":"2024-09-11T07:07:06.224109+0000","last_clean":"2024-09-11T07:07:06.224109+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:07:06.224109+0000","last_undegraded":"2024-09-11T07:07:06.224109+0000","last_fullsized":"2024-09-11T07:07:06.224109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:25:30.146045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022638789999999999,"stat_sum":{"num_bytes":28944835,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":11,"num_read":4257,"num_read_kb":18613,"num_write":244,"num_write_kb":8517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"77'252","reported_seq":2247,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.949930+0000","last_change":"2024-09-11T07:06:00.837799+0000","last_active":"2024-09-11T07:07:05.949930+0000","last_peered":"2024-09-11T07:07:05.949930+0000","last_clean":"2024-09-11T07:07:05.949930+0000","last_became_active":"2024-09-11T07:05:58.825160+0000","last_became_peered":"2024-09-11T07:05:58.825160+0000","last_unstale":"2024-09-11T07:07:05.949930+0000","last_undegraded":"2024-09-11T07:07:05.949930+0000","last_fullsized":"2024-09-11T07:07:05.949930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:38.644913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017910619999999999,"stat_sum":{"num_bytes":51428424,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":4458,"num_read_kb":40035,"num_write":292,"num_write_kb":33011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"75'462","reported_seq":3909,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.950334+0000","last_change":"2024-09-11T07:06:00.838063+0000","last_active":"2024-09-11T07:07:05.950334+0000","last_peered":"2024-09-11T07:07:05.950334+0000","last_clean":"2024-09-11T07:07:05.950334+0000","last_became_active":"2024-09-11T07:05:58.822422+0000","last_became_peered":"2024-09-11T07:05:58.822422+0000","last_unstale":"2024-09-11T07:07:05.950334+0000","last_undegraded":"2024-09-11T07:07:05.950334+0000","last_fullsized":"2024-09-11T07:07:05.950334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:59.648675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020506280000000001,"stat_sum":{"num_bytes":35869010,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":10,"num_read":5921,"num_read_kb":20406,"num_write":653,"num_write_kb":14110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"77'505","reported_seq":1660,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.175533+0000","last_change":"2024-09-11T07:07:00.913705+0000","last_active":"2024-09-11T07:07:06.175533+0000","last_peered":"2024-09-11T07:07:06.175533+0000","last_clean":"2024-09-11T07:07:06.175533+0000","last_became_active":"2024-09-11T07:07:00.912031+0000","last_became_peered":"2024-09-11T07:07:00.912031+0000","last_unstale":"2024-09-11T07:07:06.175533+0000","last_undegraded":"2024-09-11T07:07:06.175533+0000","last_fullsized":"2024-09-11T07:07:06.175533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:22:52.682316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049279100000000002,"stat_sum":{"num_bytes":18132026,"num_objects":38,"num_object_clones":6,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":13,"num_read":3493,"num_read_kb":9399,"num_write":794,"num_write_kb":9461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":2516909,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"77'140","reported_seq":2631,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.225504+0000","last_change":"2024-09-11T07:06:00.836320+0000","last_active":"2024-09-11T07:07:06.225504+0000","last_peered":"2024-09-11T07:07:06.225504+0000","last_clean":"2024-09-11T07:07:06.225504+0000","last_became_active":"2024-09-11T07:05:58.822373+0000","last_became_peered":"2024-09-11T07:05:58.822373+0000","last_unstale":"2024-09-11T07:07:06.225504+0000","last_undegraded":"2024-09-11T07:07:06.225504+0000","last_fullsized":"2024-09-11T07:07:06.225504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:41:09.729082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089665299999999997,"stat_sum":{"num_bytes":27202966,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":13,"num_read":2386,"num_read_kb":7723,"num_write":138,"num_write_kb":5469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"77'225","reported_seq":2342,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.225116+0000","last_change":"2024-09-11T07:07:00.911244+0000","last_active":"2024-09-11T07:07:06.225116+0000","last_peered":"2024-09-11T07:07:06.225116+0000","last_clean":"2024-09-11T07:07:06.225116+0000","last_became_active":"2024-09-11T07:07:00.910054+0000","last_became_peered":"2024-09-11T07:07:00.910054+0000","last_unstale":"2024-09-11T07:07:06.225116+0000","last_undegraded":"2024-09-11T07:07:06.225116+0000","last_fullsized":"2024-09-11T07:07:06.225116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:53:26.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086507200000000004,"stat_sum":{"num_bytes":30700409,"num_objects":41,"num_object_clones":10,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":2415,"num_read_kb":20162,"num_write":298,"num_write_kb":9364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":6304727,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"78'232","reported_seq":1500,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.279937+0000","last_change":"2024-09-11T07:06:00.836900+0000","last_active":"2024-09-11T07:07:06.279937+0000","last_peered":"2024-09-11T07:07:06.279937+0000","last_clean":"2024-09-11T07:07:06.279937+0000","last_became_active":"2024-09-11T07:05:58.823540+0000","last_became_peered":"2024-09-11T07:05:58.823540+0000","last_unstale":"2024-09-11T07:07:06.279937+0000","last_undegraded":"2024-09-11T07:07:06.279937+0000","last_fullsized":"2024-09-11T07:07:06.279937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:14.138757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012764899999999999,"stat_sum":{"num_bytes":8123337,"num_objects":29,"num_object_clones":3,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":9,"num_read":2140,"num_read_kb":2916,"num_write":245,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":810810672,"num_objects":1176,"num_object_clones":269,"num_object_copies":2352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1176,"num_whiteouts":357,"num_read":92186,"num_read_kb":438085,"num_write":9904,"num_write_kb":296226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":528,"num_bytes_recovered":48905203,"num_keys_recovered":130,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43032576,"data_stored":660190807,"data_compressed":13288986,"data_compressed_allocated":36569088,"data_compressed_original":656524821,"omap_allocated":0,"internal_metadata":0},"log_size":7957,"ondisk_log_size":7957,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":18293,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34808,"kb_used_data":7784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337032,"statfs":{"total":96636764160,"available":96601120768,"internally_reserved":0,"allocated":7970816,"data_stored":110906010,"data_compressed":1821383,"data_compressed_allocated":5996544,"data_compressed_original":109858742,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37836,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334004,"statfs":{"total":96636764160,"available":96598020096,"internally_reserved":0,"allocated":2543616,"data_stored":18930408,"data_compressed":541752,"data_compressed_allocated":1253376,"data_compressed_original":18283926,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43908,"kb_used_data":4400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327932,"statfs":{"total":96636764160,"available":96591802368,"internally_reserved":0,"allocated":4505600,"data_stored":32710860,"data_compressed":1385764,"data_compressed_allocated":2789376,"data_compressed_original":31844646,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37488,"kb_used_data":10460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334352,"statfs":{"total":96636764160,"available":96598376448,"internally_reserved":0,"allocated":10711040,"data_stored":165790264,"data_compressed":2711982,"data_compressed_allocated":8441856,"data_compressed_original":164552629,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48084,"kb_used_data":8580,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323756,"statfs":{"total":96636764160,"available":96587526144,"internally_reserved":0,"allocated":8785920,"data_stored":132431470,"data_compressed":2276226,"data_compressed_allocated":6750208,"data_compressed_original":131417345,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36112,"kb_used_data":4920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335728,"statfs":{"total":96636764160,"available":96599785472,"internally_reserved":0,"allocated":5038080,"data_stored":75086998,"data_compressed":1358566,"data_compressed_allocated":3735552,"data_compressed_original":74445068,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":5124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":5246976,"data_stored":61149686,"data_compressed":1604219,"data_compressed_allocated":3649536,"data_compressed_original":60367330,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":55834574868,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4644864,"data_stored":67162937,"data_compressed":1534910,"data_compressed_allocated":3944448,"data_compressed_original":66791423,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4325376,"data_stored":60729800,"data_compressed":1604219,"data_compressed_allocated":3649536,"data_compressed_original":60367330,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":74713464,"data_compressed":1384213,"data_compressed_allocated":3764224,"data_compressed_original":74486028,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7946240,"data_stored":132107287,"data_compressed":2317237,"data_compressed_allocated":6803456,"data_compressed_original":131503361,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9793536,"data_stored":165370397,"data_compressed":2711982,"data_compressed_allocated":8441856,"data_compressed_original":164552629,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3584000,"data_stored":32290974,"data_compressed":1385764,"data_compressed_allocated":2789376,"data_compressed_original":31844646,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1585152,"data_stored":17920173,"data_compressed":535097,"data_compressed_allocated":1216512,"data_compressed_original":17694102,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6995968,"data_stored":109895775,"data_compressed":1815564,"data_compressed_allocated":5959680,"data_compressed_original":109285302,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:07:09.383 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:07:09.388 INFO:teuthology.orchestra.run.smithi079.stdout:3329 trunc from 0xbd32333 to 0xe1b9eea 2024-09-11T07:07:09.394 INFO:teuthology.orchestra.run.smithi079.stdout:3330 read 0xa748177 thru 0xa75446c (0xc2f6 bytes) 2024-09-11T07:07:09.394 INFO:teuthology.orchestra.run.smithi079.stdout:3331 write 0x4d512b0 thru 0x4d5ec67 (0xd9b8 bytes) 2024-09-11T07:07:09.406 INFO:teuthology.orchestra.run.smithi079.stdout:3334 write 0xee2a469 thru 0xee2c8d2 (0x246a bytes) 2024-09-11T07:07:09.411 INFO:teuthology.orchestra.run.smithi079.stdout:3335 read 0x2856f46 thru 0x285ee61 (0x7f1c bytes) 2024-09-11T07:07:09.437 INFO:teuthology.orchestra.run.smithi079.stdout:3336 trunc from 0xee2c8d3 to 0xe80f6c 2024-09-11T07:07:09.440 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:09.440 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:09.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:09.461 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:09.467 INFO:teuthology.orchestra.run.smithi079.stdout:3337 read 0xaccf9a thru 0xad1767 (0x47ce bytes) 2024-09-11T07:07:09.467 INFO:teuthology.orchestra.run.smithi079.stdout:3339 read 0x13aa71 thru 0x13e05e (0x35ee bytes) 2024-09-11T07:07:09.468 INFO:teuthology.orchestra.run.smithi079.stdout:3341 punch from 0xaa14cf to 0xaa38cc, (0x23fd bytes) 2024-09-11T07:07:09.493 INFO:teuthology.orchestra.run.smithi079.stdout:3342 write 0xd49934b thru 0xd49948f (0x145 bytes) 2024-09-11T07:07:09.497 INFO:teuthology.orchestra.run.smithi079.stdout:3344 read 0x35eee26 thru 0x35fd142 (0xe31d bytes) 2024-09-11T07:07:09.497 INFO:teuthology.orchestra.run.smithi079.stdout:3346 write 0x1c6a5ac thru 0x1c78cdd (0xe732 bytes) 2024-09-11T07:07:09.500 INFO:teuthology.orchestra.run.smithi079.stdout:3347 read 0x5dcf3aa thru 0x5dd6455 (0x70ac bytes) 2024-09-11T07:07:09.500 INFO:teuthology.orchestra.run.smithi079.stdout:3348 write 0xb62ab24 thru 0xb630f1c (0x63f9 bytes) 2024-09-11T07:07:09.506 INFO:teuthology.orchestra.run.smithi079.stdout:3349 read 0xcf8947 thru 0xd085f4 (0xfcae bytes) 2024-09-11T07:07:09.507 INFO:teuthology.orchestra.run.smithi079.stdout:3352 write 0x5f63460 thru 0x5f64cc5 (0x1866 bytes) 2024-09-11T07:07:09.508 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:09.508+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:09.511 INFO:teuthology.orchestra.run.smithi079.stdout:3353 write 0xd42e42d thru 0xd43c3ef (0xdfc3 bytes) 2024-09-11T07:07:09.519 INFO:teuthology.orchestra.run.smithi079.stdout:3357 write 0xadf4a48 thru 0xadfa459 (0x5a12 bytes) 2024-09-11T07:07:09.523 INFO:teuthology.orchestra.run.smithi079.stdout:3359 read 0xc2ffcbb thru 0xc300325 (0x66b bytes) 2024-09-11T07:07:09.524 INFO:teuthology.orchestra.run.smithi079.stdout:3360 punch from 0x2fc6a22 to 0x2fcb03e, (0x461c bytes) 2024-09-11T07:07:09.524 INFO:teuthology.orchestra.run.smithi079.stdout:3361 writesame 0x38b02c4 thru 0x38b195c data_size 0x1(0x1699 bytes) 2024-09-11T07:07:09.529 INFO:teuthology.orchestra.run.smithi079.stdout:3362 punch from 0x84cee27 to 0x84d6b3c, (0x7d15 bytes) 2024-09-11T07:07:09.535 INFO:teuthology.orchestra.run.smithi079.stdout:3364 write 0xdebbb89 thru 0xdec3b6f (0x7fe7 bytes) 2024-09-11T07:07:09.548 INFO:teuthology.orchestra.run.smithi079.stdout:3367 trunc from 0xdec3b70 to 0x9a959ae 2024-09-11T07:07:09.567 INFO:teuthology.orchestra.run.smithi079.stdout:3371 trunc from 0x9a959ae to 0x688d4cd 2024-09-11T07:07:09.581 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:09.577+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:09.582 INFO:teuthology.orchestra.run.smithi079.stdout:3372 read 0x1180e4a thru 0x118fde2 (0xef99 bytes) 2024-09-11T07:07:09.590 INFO:teuthology.orchestra.run.smithi079.stdout:3375 write 0x6b3a8e3 thru 0x6b45c3d (0xb35b bytes) 2024-09-11T07:07:09.598 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.601 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:09.601 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:09.603 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:09.604 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:09.604 INFO:teuthology.orchestra.run.smithi079.stdout:3380 trunc from 0x6b45c3e to 0xa478d54 2024-09-11T07:07:09.613 INFO:teuthology.orchestra.run.smithi079.stdout:3381 write 0x58bffd3 thru 0x58cedaa (0xedd8 bytes) 2024-09-11T07:07:09.619 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:09.620 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:09.620 INFO:teuthology.orchestra.run.smithi079.stdout:3383 read 0x4960cef thru 0x496734b (0x665d bytes) 2024-09-11T07:07:09.621 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:09.633 INFO:teuthology.orchestra.run.smithi079.stdout:3384 write 0xe62198e thru 0xe627854 (0x5ec7 bytes) 2024-09-11T07:07:09.637 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:09.637 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:09.638 INFO:teuthology.orchestra.run.smithi079.stdout:3385 punch from 0xd368e60 to 0xd36cece, (0x406e bytes) 2024-09-11T07:07:09.639 INFO:teuthology.orchestra.run.smithi079.stdout:3387 read 0x3803540 thru 0x380ba32 (0x84f3 bytes) 2024-09-11T07:07:09.639 INFO:teuthology.orchestra.run.smithi079.stdout:3388 write 0x824d362 thru 0x8252bdc (0x587b bytes) 2024-09-11T07:07:09.655 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:09.655 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:09.655 INFO:teuthology.orchestra.run.smithi079.stdout:3391 trunc from 0xe627855 to 0x6d2b058 2024-09-11T07:07:09.669 INFO:teuthology.orchestra.run.smithi079.stdout:3392 write 0x6cfc619 thru 0x6d01a86 (0x546e bytes) 2024-09-11T07:07:09.675 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:09.675 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:09.675 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.681 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:09.677+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:09.692 INFO:teuthology.orchestra.run.smithi079.stdout:3395 write 0xce226ce thru 0xce261b3 (0x3ae6 bytes) 2024-09-11T07:07:09.699 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:09.700 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:09.707 INFO:teuthology.orchestra.run.smithi079.stdout:3396 trunc from 0xce261b4 to 0x5ee1e09 2024-09-11T07:07:09.722 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:07:09.722 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:07:09.723 INFO:teuthology.orchestra.run.smithi079.stdout:3397 punch from 0x3a16f89 to 0x3a23a91, (0xcb08 bytes) 2024-09-11T07:07:09.723 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.723 INFO:teuthology.orchestra.run.smithi079.stdout:3399 punch from 0x2af09dc to 0x2af4a0e, (0x4032 bytes) 2024-09-11T07:07:09.723 INFO:teuthology.orchestra.run.smithi079.stdout:3401 writesame 0x2464d82 thru 0x2466e59 data_size 0x1(0x20d8 bytes) 2024-09-11T07:07:09.724 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:09.724 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:09.730 INFO:teuthology.orchestra.run.smithi079.stdout:3402 write 0x5738b86 thru 0x5742dbb (0xa236 bytes) 2024-09-11T07:07:09.732 INFO:teuthology.orchestra.run.smithi079.stdout:3403 punch from 0x30e3707 to 0x30ec359, (0x8c52 bytes) 2024-09-11T07:07:09.742 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:09.743 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:09.745 INFO:teuthology.orchestra.run.smithi079.stdout:3404 write 0x981d58d thru 0x982c8e3 (0xf357 bytes) 2024-09-11T07:07:09.747 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2024-09-11T07:07:08.975705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":811401059,"num_objects":1180,"num_object_clones":269,"num_object_copies":2360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1180,"num_whiteouts":357,"num_read":92302,"num_read_kb":438185,"num_write":10065,"num_write_kb":298644,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":530,"num_bytes_recovered":49495571,"num_keys_recovered":130,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8077,"ondisk_log_size":8077,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":278744,"kb_used_data":43752,"kb_used_omap":10,"kb_used_meta":234805,"kb_avail":660324136,"statfs":{"total":676457349120,"available":676171915264,"internally_reserved":0,"allocated":44802048,"data_stored":597005696,"data_compressed":11699892,"data_compressed_allocated":32616448,"data_compressed_original":590769686,"omap_allocated":11164,"internal_metadata":240440420},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":14413676,"num_objects":52,"num_object_clones":6,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":0,"num_read":5284,"num_read_kb":85306,"num_write":1155,"num_write_kb":17538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029142"},"pg_stats":[{"pgid":"3.1f","version":"77'299","reported_seq":2380,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971858+0000","last_change":"2024-09-11T07:07:00.913312+0000","last_active":"2024-09-11T07:07:05.971858+0000","last_peered":"2024-09-11T07:07:05.971858+0000","last_clean":"2024-09-11T07:07:05.971858+0000","last_became_active":"2024-09-11T07:07:00.912449+0000","last_became_peered":"2024-09-11T07:07:00.912449+0000","last_unstale":"2024-09-11T07:07:05.971858+0000","last_undegraded":"2024-09-11T07:07:05.971858+0000","last_fullsized":"2024-09-11T07:07:05.971858+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:27:49.246508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097647200000000004,"stat_sum":{"num_bytes":9416788,"num_objects":41,"num_object_clones":11,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":18,"num_read":2478,"num_read_kb":4566,"num_write":406,"num_write_kb":16504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1716442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"77'181","reported_seq":1351,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.225655+0000","last_change":"2024-09-11T07:06:00.970173+0000","last_active":"2024-09-11T07:07:06.225655+0000","last_peered":"2024-09-11T07:07:06.225655+0000","last_clean":"2024-09-11T07:07:06.225655+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:07:06.225655+0000","last_undegraded":"2024-09-11T07:07:06.225655+0000","last_fullsized":"2024-09-11T07:07:06.225655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":181,"log_dups_size":0,"ondisk_log_size":181,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:22:44.996277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084787600000000001,"stat_sum":{"num_bytes":24848135,"num_objects":35,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":8,"num_read":1399,"num_read_kb":15041,"num_write":220,"num_write_kb":8269,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"77'148","reported_seq":4176,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971820+0000","last_change":"2024-09-11T07:06:00.825433+0000","last_active":"2024-09-11T07:07:05.971820+0000","last_peered":"2024-09-11T07:07:05.971820+0000","last_clean":"2024-09-11T07:07:05.971820+0000","last_became_active":"2024-09-11T07:05:58.827234+0000","last_became_peered":"2024-09-11T07:05:58.827234+0000","last_unstale":"2024-09-11T07:07:05.971820+0000","last_undegraded":"2024-09-11T07:07:05.971820+0000","last_fullsized":"2024-09-11T07:07:05.971820+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:43:03.606750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550473,"stat_sum":{"num_bytes":50369827,"num_objects":36,"num_object_clones":9,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":4839,"num_read_kb":28064,"num_write":142,"num_write_kb":6031,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"78'154","reported_seq":2009,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.224123+0000","last_change":"2024-09-11T07:06:00.827149+0000","last_active":"2024-09-11T07:07:06.224123+0000","last_peered":"2024-09-11T07:07:06.224123+0000","last_clean":"2024-09-11T07:07:06.224123+0000","last_became_active":"2024-09-11T07:05:58.826843+0000","last_became_peered":"2024-09-11T07:05:58.826843+0000","last_unstale":"2024-09-11T07:07:06.224123+0000","last_undegraded":"2024-09-11T07:07:06.224123+0000","last_fullsized":"2024-09-11T07:07:06.224123+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":154,"log_dups_size":0,"ondisk_log_size":154,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:20:29.070443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022332319999999999,"stat_sum":{"num_bytes":29112401,"num_objects":47,"num_object_clones":12,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":13,"num_read":1851,"num_read_kb":12516,"num_write":157,"num_write_kb":8873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"77'231","reported_seq":1179,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.950366+0000","last_change":"2024-09-11T07:07:00.905220+0000","last_active":"2024-09-11T07:07:05.950366+0000","last_peered":"2024-09-11T07:07:05.950366+0000","last_clean":"2024-09-11T07:07:05.950366+0000","last_became_active":"2024-09-11T07:07:00.904412+0000","last_became_peered":"2024-09-11T07:07:00.904412+0000","last_unstale":"2024-09-11T07:07:05.950366+0000","last_undegraded":"2024-09-11T07:07:05.950366+0000","last_fullsized":"2024-09-11T07:07:05.950366+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:01:18.928946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001182787,"stat_sum":{"num_bytes":7007482,"num_objects":30,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":10,"num_read":2145,"num_read_kb":4919,"num_write":295,"num_write_kb":3012,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":1396946,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1a","version":"74'242","reported_seq":2595,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.223941+0000","last_change":"2024-09-11T07:06:00.813235+0000","last_active":"2024-09-11T07:07:06.223941+0000","last_peered":"2024-09-11T07:07:06.223941+0000","last_clean":"2024-09-11T07:07:06.223941+0000","last_became_active":"2024-09-11T07:05:58.808656+0000","last_became_peered":"2024-09-11T07:05:58.808656+0000","last_unstale":"2024-09-11T07:07:06.223941+0000","last_undegraded":"2024-09-11T07:07:06.223941+0000","last_fullsized":"2024-09-11T07:07:06.223941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":242,"log_dups_size":0,"ondisk_log_size":242,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:22:48.767867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059322499999999996,"stat_sum":{"num_bytes":8775313,"num_objects":29,"num_object_clones":7,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":10,"num_read":4436,"num_read_kb":7568,"num_write":297,"num_write_kb":3131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"78'246","reported_seq":1355,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.152189+0000","last_change":"2024-09-11T07:06:00.820857+0000","last_active":"2024-09-11T07:07:06.152189+0000","last_peered":"2024-09-11T07:07:06.152189+0000","last_clean":"2024-09-11T07:07:06.152189+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:07:06.152189+0000","last_undegraded":"2024-09-11T07:07:06.152189+0000","last_fullsized":"2024-09-11T07:07:06.152189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:13:34.793311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076385799999999996,"stat_sum":{"num_bytes":22673269,"num_objects":33,"num_object_clones":6,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":9,"num_read":1694,"num_read_kb":5119,"num_write":331,"num_write_kb":3504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"78'261","reported_seq":2704,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.420029+0000","last_change":"2024-09-11T07:07:00.913189+0000","last_active":"2024-09-11T07:07:06.420029+0000","last_peered":"2024-09-11T07:07:06.420029+0000","last_clean":"2024-09-11T07:07:06.420029+0000","last_became_active":"2024-09-11T07:07:00.911170+0000","last_became_peered":"2024-09-11T07:07:00.911170+0000","last_unstale":"2024-09-11T07:07:06.420029+0000","last_undegraded":"2024-09-11T07:07:06.420029+0000","last_fullsized":"2024-09-11T07:07:06.420029+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:55.282280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001212451,"stat_sum":{"num_bytes":18298607,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":13,"num_read":3682,"num_read_kb":10993,"num_write":291,"num_write_kb":20228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":4844589,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"78'192","reported_seq":2021,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.228012+0000","last_change":"2024-09-11T07:07:00.915270+0000","last_active":"2024-09-11T07:07:06.228012+0000","last_peered":"2024-09-11T07:07:06.228012+0000","last_clean":"2024-09-11T07:07:06.228012+0000","last_became_active":"2024-09-11T07:07:00.912592+0000","last_became_peered":"2024-09-11T07:07:00.912592+0000","last_unstale":"2024-09-11T07:07:06.228012+0000","last_undegraded":"2024-09-11T07:07:06.228012+0000","last_fullsized":"2024-09-11T07:07:06.228012+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":192,"log_dups_size":0,"ondisk_log_size":192,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:46:56.354447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093584899999999999,"stat_sum":{"num_bytes":24633303,"num_objects":32,"num_object_clones":9,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":8,"num_read":2552,"num_read_kb":24440,"num_write":206,"num_write_kb":19813,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":7459303,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"77'363","reported_seq":1943,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971728+0000","last_change":"2024-09-11T07:06:00.825499+0000","last_active":"2024-09-11T07:07:05.971728+0000","last_peered":"2024-09-11T07:07:05.971728+0000","last_clean":"2024-09-11T07:07:05.971728+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:07:05.971728+0000","last_undegraded":"2024-09-11T07:07:05.971728+0000","last_fullsized":"2024-09-11T07:07:05.971728+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:50:57.400219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056977600000000003,"stat_sum":{"num_bytes":25328542,"num_objects":37,"num_object_clones":10,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":12,"num_read":2787,"num_read_kb":7253,"num_write":470,"num_write_kb":3322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"74'105","reported_seq":1840,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.949362+0000","last_change":"2024-09-11T07:06:00.837150+0000","last_active":"2024-09-11T07:07:05.949362+0000","last_peered":"2024-09-11T07:07:05.949362+0000","last_clean":"2024-09-11T07:07:05.949362+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:07:05.949362+0000","last_undegraded":"2024-09-11T07:07:05.949362+0000","last_fullsized":"2024-09-11T07:07:05.949362+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:35:39.863779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184086,"stat_sum":{"num_bytes":16530436,"num_objects":34,"num_object_clones":9,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":12,"num_read":1703,"num_read_kb":12809,"num_write":103,"num_write_kb":7635,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"77'264","reported_seq":2035,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.417833+0000","last_change":"2024-09-11T07:06:00.812896+0000","last_active":"2024-09-11T07:07:06.417833+0000","last_peered":"2024-09-11T07:07:06.417833+0000","last_clean":"2024-09-11T07:07:06.417833+0000","last_became_active":"2024-09-11T07:05:58.814550+0000","last_became_peered":"2024-09-11T07:05:58.814550+0000","last_unstale":"2024-09-11T07:07:06.417833+0000","last_undegraded":"2024-09-11T07:07:06.417833+0000","last_fullsized":"2024-09-11T07:07:06.417833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:12:21.898369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046265999999999999,"stat_sum":{"num_bytes":14738924,"num_objects":41,"num_object_clones":9,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":14,"num_read":3700,"num_read_kb":11786,"num_write":303,"num_write_kb":5927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":79,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.950050+0000","last_change":"2024-09-11T07:06:26.962907+0000","last_active":"2024-09-11T07:07:05.950050+0000","last_peered":"2024-09-11T07:07:05.950050+0000","last_clean":"2024-09-11T07:07:05.950050+0000","last_became_active":"2024-09-11T07:06:26.962135+0000","last_became_peered":"2024-09-11T07:06:26.962135+0000","last_unstale":"2024-09-11T07:07:05.950050+0000","last_undegraded":"2024-09-11T07:07:05.950050+0000","last_fullsized":"2024-09-11T07:07:05.950050+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:19:32.560330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.6","version":"78'262","reported_seq":2283,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.158009+0000","last_change":"2024-09-11T07:07:00.914196+0000","last_active":"2024-09-11T07:07:06.158009+0000","last_peered":"2024-09-11T07:07:06.158009+0000","last_clean":"2024-09-11T07:07:06.158009+0000","last_became_active":"2024-09-11T07:07:00.912070+0000","last_became_peered":"2024-09-11T07:07:00.912070+0000","last_unstale":"2024-09-11T07:07:06.158009+0000","last_undegraded":"2024-09-11T07:07:06.158009+0000","last_fullsized":"2024-09-11T07:07:06.158009+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":262,"log_dups_size":0,"ondisk_log_size":262,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:45:33.416393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056190700000000005,"stat_sum":{"num_bytes":44185825,"num_objects":44,"num_object_clones":13,"num_object_copies":88,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":44,"num_whiteouts":13,"num_read":2322,"num_read_kb":12198,"num_write":312,"num_write_kb":7858,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":5329407,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":134,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.956322+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:07:05.956322+0000","last_peered":"2024-09-11T07:07:05.956322+0000","last_clean":"2024-09-11T07:07:05.956322+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:07:05.956322+0000","last_undegraded":"2024-09-11T07:07:05.956322+0000","last_fullsized":"2024-09-11T07:07:05.956322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"77'484","reported_seq":1772,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.224428+0000","last_change":"2024-09-11T07:06:00.969789+0000","last_active":"2024-09-11T07:07:06.224428+0000","last_peered":"2024-09-11T07:07:06.224428+0000","last_clean":"2024-09-11T07:07:06.224428+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:07:06.224428+0000","last_undegraded":"2024-09-11T07:07:06.224428+0000","last_fullsized":"2024-09-11T07:07:06.224428+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":484,"log_dups_size":0,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:49:19.893099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068823799999999998,"stat_sum":{"num_bytes":15670804,"num_objects":48,"num_object_clones":13,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":18,"num_read":3555,"num_read_kb":10993,"num_write":715,"num_write_kb":5060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":140,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.949505+0000","last_change":"2024-09-11T07:06:57.876106+0000","last_active":"2024-09-11T07:07:05.949505+0000","last_peered":"2024-09-11T07:07:05.949505+0000","last_clean":"2024-09-11T07:07:05.949505+0000","last_became_active":"2024-09-11T07:06:57.875190+0000","last_became_peered":"2024-09-11T07:06:57.875190+0000","last_unstale":"2024-09-11T07:07:05.949505+0000","last_undegraded":"2024-09-11T07:07:05.949505+0000","last_fullsized":"2024-09-11T07:07:05.949505+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:44:24.573352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"75'134","reported_seq":3273,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.956450+0000","last_change":"2024-09-11T07:06:00.821584+0000","last_active":"2024-09-11T07:07:05.956450+0000","last_peered":"2024-09-11T07:07:05.956450+0000","last_clean":"2024-09-11T07:07:05.956450+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:07:05.956450+0000","last_undegraded":"2024-09-11T07:07:05.956450+0000","last_fullsized":"2024-09-11T07:07:05.956450+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:13:58.722747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001413975,"stat_sum":{"num_bytes":22852498,"num_objects":29,"num_object_clones":6,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":9,"num_read":3276,"num_read_kb":22145,"num_write":129,"num_write_kb":5011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":139,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.956498+0000","last_change":"2024-09-11T07:06:57.872595+0000","last_active":"2024-09-11T07:07:05.956498+0000","last_peered":"2024-09-11T07:07:05.956498+0000","last_clean":"2024-09-11T07:07:05.956498+0000","last_became_active":"2024-09-11T07:06:57.872268+0000","last_became_peered":"2024-09-11T07:06:57.872268+0000","last_unstale":"2024-09-11T07:07:05.956498+0000","last_undegraded":"2024-09-11T07:07:05.956498+0000","last_fullsized":"2024-09-11T07:07:05.956498+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:51.009453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"77'353","reported_seq":1781,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971769+0000","last_change":"2024-09-11T07:06:00.827482+0000","last_active":"2024-09-11T07:07:05.971769+0000","last_peered":"2024-09-11T07:07:05.971769+0000","last_clean":"2024-09-11T07:07:05.971769+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:07:05.971769+0000","last_undegraded":"2024-09-11T07:07:05.971769+0000","last_fullsized":"2024-09-11T07:07:05.971769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":353,"log_dups_size":0,"ondisk_log_size":353,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:43:17.878538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002494839,"stat_sum":{"num_bytes":23727463,"num_objects":38,"num_object_clones":6,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":9,"num_read":2430,"num_read_kb":5079,"num_write":492,"num_write_kb":3437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"77'250","reported_seq":2319,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.950426+0000","last_change":"2024-09-11T07:07:00.910232+0000","last_active":"2024-09-11T07:07:05.950426+0000","last_peered":"2024-09-11T07:07:05.950426+0000","last_clean":"2024-09-11T07:07:05.950426+0000","last_became_active":"2024-09-11T07:07:00.907922+0000","last_became_peered":"2024-09-11T07:07:00.907922+0000","last_unstale":"2024-09-11T07:07:05.950426+0000","last_undegraded":"2024-09-11T07:07:05.950426+0000","last_fullsized":"2024-09-11T07:07:05.950426+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:45:52.605093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040103300000000002,"stat_sum":{"num_bytes":23666581,"num_objects":37,"num_object_clones":9,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":13,"num_read":2289,"num_read_kb":9165,"num_write":319,"num_write_kb":6890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":2632451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":137,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971297+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:07:05.971297+0000","last_peered":"2024-09-11T07:07:05.971297+0000","last_clean":"2024-09-11T07:07:05.971297+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:07:05.971297+0000","last_undegraded":"2024-09-11T07:07:05.971297+0000","last_fullsized":"2024-09-11T07:07:05.971297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"78'327","reported_seq":3554,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.170417+0000","last_change":"2024-09-11T07:06:00.820656+0000","last_active":"2024-09-11T07:07:06.170417+0000","last_peered":"2024-09-11T07:07:06.170417+0000","last_clean":"2024-09-11T07:07:06.170417+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:07:06.170417+0000","last_undegraded":"2024-09-11T07:07:06.170417+0000","last_fullsized":"2024-09-11T07:07:06.170417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:28:43.102443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058463999999999999,"stat_sum":{"num_bytes":84898488,"num_objects":52,"num_object_clones":14,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":52,"num_whiteouts":10,"num_read":4230,"num_read_kb":35305,"num_write":387,"num_write_kb":25718,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.949623+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:07:05.949623+0000","last_peered":"2024-09-11T07:07:05.949623+0000","last_clean":"2024-09-11T07:07:05.949623+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:07:05.949623+0000","last_undegraded":"2024-09-11T07:07:05.949623+0000","last_fullsized":"2024-09-11T07:07:05.949623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"78'206","reported_seq":3132,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.400120+0000","last_change":"2024-09-11T07:07:00.913625+0000","last_active":"2024-09-11T07:07:06.400120+0000","last_peered":"2024-09-11T07:07:06.400120+0000","last_clean":"2024-09-11T07:07:06.400120+0000","last_became_active":"2024-09-11T07:07:00.912106+0000","last_became_peered":"2024-09-11T07:07:00.912106+0000","last_unstale":"2024-09-11T07:07:06.400120+0000","last_undegraded":"2024-09-11T07:07:06.400120+0000","last_fullsized":"2024-09-11T07:07:06.400120+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:49:40.219417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070404599999999995,"stat_sum":{"num_bytes":36256976,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":8,"num_read":3765,"num_read_kb":26275,"num_write":224,"num_write_kb":20917,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":15817603,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.949034+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:07:05.949034+0000","last_peered":"2024-09-11T07:07:05.949034+0000","last_clean":"2024-09-11T07:07:05.949034+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:07:05.949034+0000","last_undegraded":"2024-09-11T07:07:05.949034+0000","last_fullsized":"2024-09-11T07:07:05.949034+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"78'201","reported_seq":563,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.953570+0000","last_change":"2024-09-11T07:06:00.970754+0000","last_active":"2024-09-11T07:07:05.953570+0000","last_peered":"2024-09-11T07:07:05.953570+0000","last_clean":"2024-09-11T07:07:05.953570+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:07:05.953570+0000","last_undegraded":"2024-09-11T07:07:05.953570+0000","last_fullsized":"2024-09-11T07:07:05.953570+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:02:03.547902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013822890000000001,"stat_sum":{"num_bytes":5315041,"num_objects":23,"num_object_clones":4,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":7,"num_read":759,"num_read_kb":3026,"num_write":270,"num_write_kb":2596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":136,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971276+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:07:05.971276+0000","last_peered":"2024-09-11T07:07:05.971276+0000","last_clean":"2024-09-11T07:07:05.971276+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:07:05.971276+0000","last_undegraded":"2024-09-11T07:07:05.971276+0000","last_fullsized":"2024-09-11T07:07:05.971276+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":299,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.948199+0000","last_change":"2024-09-11T07:07:00.907608+0000","last_active":"2024-09-11T07:07:05.948199+0000","last_peered":"2024-09-11T07:07:05.948199+0000","last_clean":"2024-09-11T07:07:05.948199+0000","last_became_active":"2024-09-11T07:07:00.907199+0000","last_became_peered":"2024-09-11T07:07:00.907199+0000","last_unstale":"2024-09-11T07:07:05.948199+0000","last_undegraded":"2024-09-11T07:07:05.948199+0000","last_fullsized":"2024-09-11T07:07:05.948199+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:37.571030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"77'173","reported_seq":2288,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.224548+0000","last_change":"2024-09-11T07:06:00.970646+0000","last_active":"2024-09-11T07:07:06.224548+0000","last_peered":"2024-09-11T07:07:06.224548+0000","last_clean":"2024-09-11T07:07:06.224548+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:07:06.224548+0000","last_undegraded":"2024-09-11T07:07:06.224548+0000","last_fullsized":"2024-09-11T07:07:06.224548+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":173,"log_dups_size":0,"ondisk_log_size":173,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:46:16.919051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012611810000000001,"stat_sum":{"num_bytes":18784168,"num_objects":42,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":14,"num_read":2059,"num_read_kb":10154,"num_write":177,"num_write_kb":5366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"78'132","reported_seq":1181,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.226210+0000","last_change":"2024-09-11T07:06:00.813164+0000","last_active":"2024-09-11T07:07:06.226210+0000","last_peered":"2024-09-11T07:07:06.226210+0000","last_clean":"2024-09-11T07:07:06.226210+0000","last_became_active":"2024-09-11T07:05:59.016079+0000","last_became_peered":"2024-09-11T07:05:59.016079+0000","last_unstale":"2024-09-11T07:07:06.226210+0000","last_undegraded":"2024-09-11T07:07:06.226210+0000","last_fullsized":"2024-09-11T07:07:06.226210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:41.872303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062012700000000005,"stat_sum":{"num_bytes":25933903,"num_objects":35,"num_object_clones":7,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":1163,"num_read_kb":7678,"num_write":116,"num_write_kb":2623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"78'312","reported_seq":1263,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.226446+0000","last_change":"2024-09-11T07:06:26.964107+0000","last_active":"2024-09-11T07:07:06.226446+0000","last_peered":"2024-09-11T07:07:06.226446+0000","last_clean":"2024-09-11T07:07:06.226446+0000","last_became_active":"2024-09-11T07:06:26.960126+0000","last_became_peered":"2024-09-11T07:06:26.960126+0000","last_unstale":"2024-09-11T07:07:06.226446+0000","last_undegraded":"2024-09-11T07:07:06.226446+0000","last_fullsized":"2024-09-11T07:07:06.226446+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:01:07.772779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046764000000000002,"stat_sum":{"num_bytes":16399990,"num_objects":32,"num_object_clones":4,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":11,"num_read":2315,"num_read_kb":5768,"num_write":412,"num_write_kb":2894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"78'258","reported_seq":1895,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.424183+0000","last_change":"2024-09-11T07:07:00.915151+0000","last_active":"2024-09-11T07:07:06.424183+0000","last_peered":"2024-09-11T07:07:06.424183+0000","last_clean":"2024-09-11T07:07:06.424183+0000","last_became_active":"2024-09-11T07:07:00.913932+0000","last_became_peered":"2024-09-11T07:07:00.913932+0000","last_unstale":"2024-09-11T07:07:06.424183+0000","last_undegraded":"2024-09-11T07:07:06.424183+0000","last_fullsized":"2024-09-11T07:07:06.424183+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:38.408140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021149200000000002,"stat_sum":{"num_bytes":21612175,"num_objects":34,"num_object_clones":7,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":8,"num_read":3591,"num_read_kb":19534,"num_write":327,"num_write_kb":13958,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":37,"num_bytes_recovered":886826,"num_keys_recovered":24,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"77'150","reported_seq":2332,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.971803+0000","last_change":"2024-09-11T07:06:00.827407+0000","last_active":"2024-09-11T07:07:05.971803+0000","last_peered":"2024-09-11T07:07:05.971803+0000","last_clean":"2024-09-11T07:07:05.971803+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:07:05.971803+0000","last_undegraded":"2024-09-11T07:07:05.971803+0000","last_fullsized":"2024-09-11T07:07:05.971803+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":150,"log_dups_size":0,"ondisk_log_size":150,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:51.192671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024738579999999998,"stat_sum":{"num_bytes":19372726,"num_objects":36,"num_object_clones":11,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":12,"num_read":2096,"num_read_kb":6437,"num_write":139,"num_write_kb":4669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"74'213","reported_seq":3056,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.224109+0000","last_change":"2024-09-11T07:06:00.838531+0000","last_active":"2024-09-11T07:07:06.224109+0000","last_peered":"2024-09-11T07:07:06.224109+0000","last_clean":"2024-09-11T07:07:06.224109+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:07:06.224109+0000","last_undegraded":"2024-09-11T07:07:06.224109+0000","last_fullsized":"2024-09-11T07:07:06.224109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:25:30.146045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022638789999999999,"stat_sum":{"num_bytes":28944835,"num_objects":42,"num_object_clones":8,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":11,"num_read":4257,"num_read_kb":18613,"num_write":244,"num_write_kb":8517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"77'252","reported_seq":2247,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.949930+0000","last_change":"2024-09-11T07:06:00.837799+0000","last_active":"2024-09-11T07:07:05.949930+0000","last_peered":"2024-09-11T07:07:05.949930+0000","last_clean":"2024-09-11T07:07:05.949930+0000","last_became_active":"2024-09-11T07:05:58.825160+0000","last_became_peered":"2024-09-11T07:05:58.825160+0000","last_unstale":"2024-09-11T07:07:05.949930+0000","last_undegraded":"2024-09-11T07:07:05.949930+0000","last_fullsized":"2024-09-11T07:07:05.949930+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:51:38.644913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017910619999999999,"stat_sum":{"num_bytes":51428424,"num_objects":35,"num_object_clones":8,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":9,"num_read":4458,"num_read_kb":40035,"num_write":292,"num_write_kb":33011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"75'462","reported_seq":3909,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:05.950334+0000","last_change":"2024-09-11T07:06:00.838063+0000","last_active":"2024-09-11T07:07:05.950334+0000","last_peered":"2024-09-11T07:07:05.950334+0000","last_clean":"2024-09-11T07:07:05.950334+0000","last_became_active":"2024-09-11T07:05:58.822422+0000","last_became_peered":"2024-09-11T07:05:58.822422+0000","last_unstale":"2024-09-11T07:07:05.950334+0000","last_undegraded":"2024-09-11T07:07:05.950334+0000","last_fullsized":"2024-09-11T07:07:05.950334+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:21:59.648675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020506280000000001,"stat_sum":{"num_bytes":35869010,"num_objects":35,"num_object_clones":9,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":10,"num_read":5921,"num_read_kb":20406,"num_write":653,"num_write_kb":14110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"77'505","reported_seq":1660,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.175533+0000","last_change":"2024-09-11T07:07:00.913705+0000","last_active":"2024-09-11T07:07:06.175533+0000","last_peered":"2024-09-11T07:07:06.175533+0000","last_clean":"2024-09-11T07:07:06.175533+0000","last_became_active":"2024-09-11T07:07:00.912031+0000","last_became_peered":"2024-09-11T07:07:00.912031+0000","last_unstale":"2024-09-11T07:07:06.175533+0000","last_undegraded":"2024-09-11T07:07:06.175533+0000","last_fullsized":"2024-09-11T07:07:06.175533+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":505,"log_dups_size":0,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:22:52.682316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049279100000000002,"stat_sum":{"num_bytes":18132026,"num_objects":38,"num_object_clones":6,"num_object_copies":76,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":13,"num_read":3493,"num_read_kb":9399,"num_write":794,"num_write_kb":9461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":2516909,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"77'140","reported_seq":2631,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.225504+0000","last_change":"2024-09-11T07:06:00.836320+0000","last_active":"2024-09-11T07:07:06.225504+0000","last_peered":"2024-09-11T07:07:06.225504+0000","last_clean":"2024-09-11T07:07:06.225504+0000","last_became_active":"2024-09-11T07:05:58.822373+0000","last_became_peered":"2024-09-11T07:05:58.822373+0000","last_unstale":"2024-09-11T07:07:06.225504+0000","last_undegraded":"2024-09-11T07:07:06.225504+0000","last_fullsized":"2024-09-11T07:07:06.225504+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":140,"log_dups_size":0,"ondisk_log_size":140,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:41:09.729082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089665299999999997,"stat_sum":{"num_bytes":27202966,"num_objects":42,"num_object_clones":11,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":13,"num_read":2386,"num_read_kb":7723,"num_write":138,"num_write_kb":5469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"77'225","reported_seq":2342,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.225116+0000","last_change":"2024-09-11T07:07:00.911244+0000","last_active":"2024-09-11T07:07:06.225116+0000","last_peered":"2024-09-11T07:07:06.225116+0000","last_clean":"2024-09-11T07:07:06.225116+0000","last_became_active":"2024-09-11T07:07:00.910054+0000","last_became_peered":"2024-09-11T07:07:00.910054+0000","last_unstale":"2024-09-11T07:07:06.225116+0000","last_undegraded":"2024-09-11T07:07:06.225116+0000","last_fullsized":"2024-09-11T07:07:06.225116+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":225,"log_dups_size":0,"ondisk_log_size":225,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:53:26.268511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086507200000000004,"stat_sum":{"num_bytes":30700409,"num_objects":41,"num_object_clones":10,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":12,"num_read":2415,"num_read_kb":20162,"num_write":298,"num_write_kb":9364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":6304727,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"78'232","reported_seq":1500,"reported_epoch":78,"state":"active+clean","last_fresh":"2024-09-11T07:07:06.279937+0000","last_change":"2024-09-11T07:06:00.836900+0000","last_active":"2024-09-11T07:07:06.279937+0000","last_peered":"2024-09-11T07:07:06.279937+0000","last_clean":"2024-09-11T07:07:06.279937+0000","last_became_active":"2024-09-11T07:05:58.823540+0000","last_became_peered":"2024-09-11T07:05:58.823540+0000","last_unstale":"2024-09-11T07:07:06.279937+0000","last_undegraded":"2024-09-11T07:07:06.279937+0000","last_fullsized":"2024-09-11T07:07:06.279937+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:53:14.138757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012764899999999999,"stat_sum":{"num_bytes":8123337,"num_objects":29,"num_object_clones":3,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":9,"num_read":2140,"num_read_kb":2916,"num_write":245,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":810810672,"num_objects":1176,"num_object_clones":269,"num_object_copies":2352,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1176,"num_whiteouts":357,"num_read":92186,"num_read_kb":438085,"num_write":9904,"num_write_kb":296226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":528,"num_bytes_recovered":48905203,"num_keys_recovered":130,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":43032576,"data_stored":660190807,"data_compressed":13288986,"data_compressed_allocated":36569088,"data_compressed_original":656524821,"omap_allocated":0,"internal_metadata":0},"log_size":7957,"ondisk_log_size":7957,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":18293,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34808,"kb_used_data":7784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94337032,"statfs":{"total":96636764160,"available":96601120768,"internally_reserved":0,"allocated":7970816,"data_stored":110906010,"data_compressed":1821383,"data_compressed_allocated":5996544,"data_compressed_original":109858742,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574869,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37836,"kb_used_data":2484,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334004,"statfs":{"total":96636764160,"available":96598020096,"internally_reserved":0,"allocated":2543616,"data_stored":18930408,"data_compressed":541752,"data_compressed_allocated":1253376,"data_compressed_original":18283926,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574868,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43908,"kb_used_data":4400,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94327932,"statfs":{"total":96636764160,"available":96591802368,"internally_reserved":0,"allocated":4505600,"data_stored":32710860,"data_compressed":1385764,"data_compressed_allocated":2789376,"data_compressed_original":31844646,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37488,"kb_used_data":10460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94334352,"statfs":{"total":96636764160,"available":96598376448,"internally_reserved":0,"allocated":10711040,"data_stored":165790264,"data_compressed":2711982,"data_compressed_allocated":8441856,"data_compressed_original":164552629,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574868,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48084,"kb_used_data":8580,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323756,"statfs":{"total":96636764160,"available":96587526144,"internally_reserved":0,"allocated":8785920,"data_stored":132431470,"data_compressed":2276226,"data_compressed_allocated":6750208,"data_compressed_original":131417345,"omap_allocated":1594,"internal_metadata":40434118},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574868,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36112,"kb_used_data":4920,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335728,"statfs":{"total":96636764160,"available":96599785472,"internally_reserved":0,"allocated":5038080,"data_stored":75086998,"data_compressed":1358566,"data_compressed_allocated":3735552,"data_compressed_original":74445068,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40508,"kb_used_data":5124,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94331332,"statfs":{"total":96636764160,"available":96595283968,"internally_reserved":0,"allocated":5246976,"data_stored":61149686,"data_compressed":1604219,"data_compressed_allocated":3649536,"data_compressed_original":60367330,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":0,"seq":55834574868,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4644864,"data_stored":67162937,"data_compressed":1534910,"data_compressed_allocated":3944448,"data_compressed_original":66791423,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4325376,"data_stored":60729800,"data_compressed":1604219,"data_compressed_allocated":3649536,"data_compressed_original":60367330,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4157440,"data_stored":74713464,"data_compressed":1384213,"data_compressed_allocated":3764224,"data_compressed_original":74486028,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":7946240,"data_stored":132107287,"data_compressed":2317237,"data_compressed_allocated":6803456,"data_compressed_original":131503361,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":9793536,"data_stored":165370397,"data_compressed":2711982,"data_compressed_allocated":8441856,"data_compressed_original":164552629,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":3584000,"data_stored":32290974,"data_compressed":1385764,"data_compressed_allocated":2789376,"data_compressed_original":31844646,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1585152,"data_stored":17920173,"data_compressed":535097,"data_compressed_allocated":1216512,"data_compressed_original":17694102,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":6995968,"data_stored":109895775,"data_compressed":1815564,"data_compressed_allocated":5959680,"data_compressed_original":109285302,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:07:09.749 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T07:07:09.749 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:07:09.750 INFO:tasks.thrashosds.thrasher:trim_stale_osdmaps 2024-09-11T07:07:09.750 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 'trim stale osdmaps' 2024-09-11T07:07:09.753 INFO:teuthology.orchestra.run.smithi079.stdout:3405 punch from 0x298d8d6 to 0x2996b09, (0x9233 bytes) 2024-09-11T07:07:09.761 INFO:teuthology.orchestra.run.smithi079.stdout:3406 write 0xae9ec2d thru 0xaea63c4 (0x7798 bytes) 2024-09-11T07:07:09.763 INFO:teuthology.orchestra.run.smithi079.stdout:3407 read 0x5506f90 thru 0x550cb38 (0x5ba9 bytes) 2024-09-11T07:07:09.764 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.774 INFO:teuthology.orchestra.run.smithi079.stdout:3409 write 0xde37e8c thru 0xde4216a (0xa2df bytes) 2024-09-11T07:07:09.782 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:09.780+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:09.782 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.782 INFO:teuthology.orchestra.run.smithi079.stdout:3413 write 0xde0b5f9 thru 0xde0c4db (0xee3 bytes) 2024-09-11T07:07:09.786 INFO:teuthology.orchestra.run.smithi079.stdout:3414 writesame 0xd1041ee thru 0xd11248c data_size 0x29(0xe29f bytes) 2024-09-11T07:07:09.795 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.795 INFO:teuthology.orchestra.run.smithi079.stdout:3418 writesame 0x70b5f64 thru 0x70c02be data_size 0x1f(0xa35b bytes) 2024-09-11T07:07:09.803 INFO:teuthology.orchestra.run.smithi079.stdout:3419 read 0x7deedfa thru 0x7dfbb39 (0xcd40 bytes) 2024-09-11T07:07:09.803 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.804 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:09.804 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:09.804 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:09.804 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:09.804 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:09.806 INFO:teuthology.orchestra.run.smithi079.stdout:3421 trunc from 0xde4216b to 0xbf0e62a 2024-09-11T07:07:09.819 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.819 INFO:teuthology.orchestra.run.smithi079.stdout:3424 write 0x6eb7adc thru 0x6eb7d17 (0x23c bytes) 2024-09-11T07:07:09.821 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:09.822 INFO:teuthology.orchestra.run.smithi079.stdout:3425 read 0x5a27f58 thru 0x5a32355 (0xa3fe bytes) 2024-09-11T07:07:09.823 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.823 INFO:teuthology.orchestra.run.smithi079.stdout:3428 read 0xa9f19b3 thru 0xa9f84bc (0x6b0a bytes) 2024-09-11T07:07:09.825 INFO:teuthology.orchestra.run.smithi079.stdout:3429 trunc from 0xbf0e62a to 0xd3dc231 2024-09-11T07:07:09.831 INFO:teuthology.orchestra.run.smithi079.stdout:3430 read 0x81b2df3 thru 0x81ba223 (0x7431 bytes) 2024-09-11T07:07:09.831 INFO:teuthology.orchestra.run.smithi079.stdout:3431 writesame 0xc8ac999 thru 0xc8b71de data_size 0x22(0xa846 bytes) 2024-09-11T07:07:09.836 INFO:teuthology.orchestra.run.smithi079.stdout:3432 write 0x3ae26db thru 0x3aeae7f (0x87a5 bytes) 2024-09-11T07:07:09.840 INFO:teuthology.orchestra.run.smithi079.stdout:3434 read 0x65981c1 thru 0x65a778a (0xf5ca bytes) 2024-09-11T07:07:09.840 INFO:teuthology.orchestra.run.smithi079.stdout:3437 write 0x7425745 thru 0x7432085 (0xc941 bytes) 2024-09-11T07:07:09.845 INFO:teuthology.orchestra.run.smithi079.stdout:3441 read 0xa22f83d thru 0xa23dc99 (0xe45d bytes) 2024-09-11T07:07:09.846 INFO:teuthology.orchestra.run.smithi079.stdout:3442 punch from 0x916fef1 to 0x917bec1, (0xbfd0 bytes) 2024-09-11T07:07:09.846 INFO:teuthology.orchestra.run.smithi079.stdout:3443 punch from 0x589a17e to 0x58a8507, (0xe389 bytes) 2024-09-11T07:07:09.846 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.852 INFO:teuthology.orchestra.run.smithi079.stdout:3446 writesame 0xd88a1d8 thru 0xd892034 data_size 0x3(0x7e5d bytes) 2024-09-11T07:07:09.852 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:09.852 INFO:teuthology.orchestra.run.smithi079.stdout:3448 punch from 0xaf378cc to 0xaf4482a, (0xcf5e bytes) 2024-09-11T07:07:09.852 INFO:teuthology.orchestra.run.smithi079.stdout:3449 write 0x262605f thru 0x2635167 (0xf109 bytes) 2024-09-11T07:07:09.859 INFO:teuthology.orchestra.run.smithi079.stdout:3450 writesame 0x20645fd thru 0x20689b7 data_size 0x1(0x43bb bytes) 2024-09-11T07:07:09.869 INFO:teuthology.orchestra.run.smithi079.stdout:3451 trunc from 0xd892035 to 0xbdea2be 2024-09-11T07:07:09.883 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:09.877+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:09.886 INFO:teuthology.orchestra.run.smithi079.stdout:3452 write 0xdaca8b8 thru 0xdad7b11 (0xd25a bytes) 2024-09-11T07:07:09.892 INFO:teuthology.orchestra.run.smithi079.stdout:3453 read 0x666cc03 thru 0x66701b5 (0x35b3 bytes) 2024-09-11T07:07:09.892 INFO:teuthology.orchestra.run.smithi079.stdout:3454 write 0x31e3dfc thru 0x31f0a6c (0xcc71 bytes) 2024-09-11T07:07:09.896 INFO:teuthology.orchestra.run.smithi079.stdout:3455 write 0xcc0c7c7 thru 0xcc0f6be (0x2ef8 bytes) 2024-09-11T07:07:09.898 INFO:teuthology.orchestra.run.smithi079.stdout:3456 punch from 0xb78ec40 to 0xb79ce48, (0xe208 bytes) 2024-09-11T07:07:09.906 INFO:teuthology.orchestra.run.smithi079.stderr:no valid command found; 10 closest matches: 2024-09-11T07:07:09.906 INFO:teuthology.orchestra.run.smithi079.stderr:0 2024-09-11T07:07:09.906 INFO:teuthology.orchestra.run.smithi079.stderr:1 2024-09-11T07:07:09.906 INFO:teuthology.orchestra.run.smithi079.stderr:2 2024-09-11T07:07:09.906 INFO:teuthology.orchestra.run.smithi079.stderr:abort 2024-09-11T07:07:09.906 INFO:teuthology.orchestra.run.smithi079.stderr:assert 2024-09-11T07:07:09.906 INFO:teuthology.orchestra.run.smithi079.stderr:bench [] [] [] [] 2024-09-11T07:07:09.906 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs debug_inject_read_zeros 2024-09-11T07:07:09.907 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs files list 2024-09-11T07:07:09.907 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs stats 2024-09-11T07:07:09.907 INFO:teuthology.orchestra.run.smithi079.stderr:bluestore allocator dump block 2024-09-11T07:07:09.907 INFO:teuthology.orchestra.run.smithi079.stderr:Error EINVAL: invalid command 2024-09-11T07:07:09.907 INFO:teuthology.orchestra.run.smithi079.stdout:3459 trunc from 0xdad7b12 to 0x718dff9 2024-09-11T07:07:09.909 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T07:07:09.910 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T07:07:09.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 'trim stale osdmaps' 2024-09-11T07:07:09.924 INFO:teuthology.orchestra.run.smithi079.stdout:3461 read 0x1943ae thru 0x19e437 (0xa08a bytes) 2024-09-11T07:07:09.924 INFO:teuthology.orchestra.run.smithi079.stdout:3462 write 0x2b5050d thru 0x2b5be33 (0xb927 bytes) 2024-09-11T07:07:09.934 INFO:teuthology.orchestra.run.smithi079.stdout:3464 trunc from 0x718dff9 to 0x1c3f3b5 2024-09-11T07:07:09.972 INFO:teuthology.orchestra.run.smithi079.stdout:3465 writesame 0xb30b4dd thru 0xb310a1d data_size 0x5(0x5541 bytes) 2024-09-11T07:07:09.972 INFO:teuthology.orchestra.run.smithi079.stdout:3466 punch from 0x54cb204 to 0x54d0d2f, (0x5b2b bytes) 2024-09-11T07:07:09.972 INFO:teuthology.orchestra.run.smithi079.stdout:3467 trunc from 0xb310a1e to 0xbbb2639 2024-09-11T07:07:09.984 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:09.980+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:09.990 INFO:teuthology.orchestra.run.smithi079.stdout:3468 trunc from 0xbbb2639 to 0x2fea6c6 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.671447585000003, 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:09.995 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:09.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:07:09.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9997 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 180224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368832613999999, 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010421191999999999, 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9997 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.001 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624847+0000", 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624848+0000", 2024-09-11T07:07:10.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0529999999999999e-06 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624854+0000", 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2330000000000003e-06 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624873+0000", 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8770000000000002e-05 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624887+0000", 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.437e-05 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.634868+0000", 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0099809489999999994 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635065+0000", 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196622 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635268+0000", 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020319500000000001 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10000 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 442368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368772155000002, 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010963796, 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.005 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10000 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624907+0000", 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624909+0000", 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.68e-06 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624915+0000", 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.003e-06 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624939+0000", 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4386999999999999e-05 2024-09-11T07:07:10.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624953+0000", 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.419e-05 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635384+0000", 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010430356 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635653+0000", 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026916499999999998 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635871+0000", 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021801500000000001 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10002 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 311296~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:07:10.009 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368706138999997, 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011381399, 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10002 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624973+0000", 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624974+0000", 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2640000000000001e-06 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.624994+0000", 2024-09-11T07:07:10.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9826e-05 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625015+0000", 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0724e-05 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625031+0000", 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6089000000000001e-05 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.635948+0000", 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010917349 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636143+0000", 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019470199999999999 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636355+0000", 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021144499999999999 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.013 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10004 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 180224~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368581220000003, 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011952765000000001, 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.014 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10004 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625098+0000", 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625099+0000", 2024-09-11T07:07:10.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2839999999999999e-06 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625118+0000", 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625135+0000", 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7669999999999999e-05 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625150+0000", 2024-09-11T07:07:10.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4504e-05 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636471+0000", 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011321278000000001 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.636726+0000", 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025507200000000001 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637051+0000", 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00032463099999999998 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368508490000004, 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.018 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:10.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368445373999997, 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.023 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:07:10.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:10.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:07:10.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:07:10.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368370380999998, 2024-09-11T07:07:10.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:10.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:07:10.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:07:10.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:07:10.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.032 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.032 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368305825, 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:10.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368250596000003, 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:10.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.041 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368196699000002, 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368136200000002, 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:07:10.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:07:10.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.048 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368080186999997, 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.050 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.054 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.368000834, 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:10.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:07:10.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.367944530999999, 2024-09-11T07:07:10.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:10.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.063 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.367872091999999, 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.064 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:07:10.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:07:10.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:07:10.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.367815972000002, 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.068 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:07:10.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.367742505999999, 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:07:10.072 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:07:10.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:07:10.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 55.367664113000004, 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.076 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:10.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:07:10.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.458488099, 2024-09-11T07:07:10.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:07:10.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:07:10.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.084 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.085 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.085 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:10.087 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:10.087 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:10.084+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:10.088 INFO:teuthology.orchestra.run.smithi079.stdout:3470 read 0x2ccebcb thru 0x2cd7553 (0x8989 bytes) 2024-09-11T07:07:10.088 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:10.088 INFO:teuthology.orchestra.run.smithi079.stdout:3473 write 0x6d34b05 thru 0x6d36dab (0x22a7 bytes) 2024-09-11T07:07:10.088 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:10.088 INFO:teuthology.orchestra.run.smithi079.stdout:3476 read 0x1ab92c2 thru 0x1ac6854 (0xd593 bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3477 read 0x33b9065 thru 0x33be064 (0x5000 bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3479 write 0x79cdd2b thru 0x79cfbca (0x1ea0 bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3480 write 0xb1f080b thru 0xb1fbc1d (0xb413 bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3481 read 0xadb7b63 thru 0xadc6201 (0xe69f bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3482 write 0x9922f8b thru 0x9931d13 (0xed89 bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3483 punch from 0x18ba943 to 0x18c518c, (0xa849 bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3484 trunc from 0xb1fbc1e to 0xd89805d 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3485 punch from 0x757e13d to 0x7587877, (0x973a bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3486 read 0x7da7aee thru 0x7db487b (0xcd8e bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3487 punch from 0x3f88b31 to 0x3f8a575, (0x1a44 bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3488 read 0xc48f094 thru 0xc494530 (0x549d bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3490 write 0x81f8537 thru 0x81ffd5d (0x7827 bytes) 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:3492 trunc from 0xd89805d to 0x9d3c654 2024-09-11T07:07:10.089 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:10.090 INFO:teuthology.orchestra.run.smithi079.stdout:3495 read 0xb28500 thru 0xb288cb (0x3cc bytes) 2024-09-11T07:07:10.090 INFO:teuthology.orchestra.run.smithi079.stdout:3496 punch from 0x5f5d0c2 to 0x5f64e74, (0x7db2 bytes) 2024-09-11T07:07:10.090 INFO:teuthology.orchestra.run.smithi079.stdout:3504 punch from 0x5217eb to 0x52395f, (0x2174 bytes) 2024-09-11T07:07:10.090 INFO:teuthology.orchestra.run.smithi079.stderr:no valid command found; 10 closest matches: 2024-09-11T07:07:10.090 INFO:teuthology.orchestra.run.smithi079.stderr:0 2024-09-11T07:07:10.090 INFO:teuthology.orchestra.run.smithi079.stderr:1 2024-09-11T07:07:10.090 INFO:teuthology.orchestra.run.smithi079.stderr:2 2024-09-11T07:07:10.091 INFO:teuthology.orchestra.run.smithi079.stderr:abort 2024-09-11T07:07:10.091 INFO:teuthology.orchestra.run.smithi079.stderr:assert 2024-09-11T07:07:10.091 INFO:teuthology.orchestra.run.smithi079.stderr:bench [] [] [] [] 2024-09-11T07:07:10.091 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs debug_inject_read_zeros 2024-09-11T07:07:10.091 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs files list 2024-09-11T07:07:10.091 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs stats 2024-09-11T07:07:10.091 INFO:teuthology.orchestra.run.smithi079.stderr:bluestore allocator dump block 2024-09-11T07:07:10.091 INFO:teuthology.orchestra.run.smithi079.stderr:Error EINVAL: invalid command 2024-09-11T07:07:10.091 INFO:teuthology.orchestra.run.smithi079.stdout:3505 writesame 0xc04a380 thru 0xc055cfb data_size 0x12(0xb97c bytes) 2024-09-11T07:07:10.092 INFO:teuthology.orchestra.run.smithi079.stdout:3506 writesame 0x9d1f6a4 thru 0x9d25781 data_size 0x3(0x60de bytes) 2024-09-11T07:07:10.092 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T07:07:10.092 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T07:07:10.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 'trim stale osdmaps' 2024-09-11T07:07:10.093 INFO:teuthology.orchestra.run.smithi079.stdout:3507 punch from 0x9fd2a8 to 0xa0c653, (0xf3ab bytes) 2024-09-11T07:07:10.107 INFO:teuthology.orchestra.run.smithi079.stdout:3508 trunc from 0xc055cfc to 0x2a94026 2024-09-11T07:07:10.122 INFO:teuthology.orchestra.run.smithi079.stdout:3509 write 0x2777e70 thru 0x2781cf4 (0x9e85 bytes) 2024-09-11T07:07:10.147 INFO:teuthology.orchestra.run.smithi079.stdout:3510 write 0x9dec679 thru 0x9df20aa (0x5a32 bytes) 2024-09-11T07:07:10.163 INFO:teuthology.orchestra.run.smithi079.stdout:3511 trunc from 0x9df20ab to 0x228233e 2024-09-11T07:07:10.187 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:10.181+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:10.197 INFO:teuthology.orchestra.run.smithi079.stdout:3512 writesame 0x864e266 thru 0x86528ce data_size 0x7(0x4669 bytes) 2024-09-11T07:07:10.197 INFO:teuthology.orchestra.run.smithi079.stdout:3514 write 0x484cc27 thru 0x48570ff (0xa4d9 bytes) 2024-09-11T07:07:10.204 INFO:teuthology.orchestra.run.smithi079.stdout:3515 write 0x344801c thru 0x344f597 (0x757c bytes) 2024-09-11T07:07:10.219 INFO:teuthology.orchestra.run.smithi079.stdout:3516 write 0xaa0e9b8 thru 0xaa14157 (0x57a0 bytes) 2024-09-11T07:07:10.239 INFO:teuthology.orchestra.run.smithi079.stdout:3517 trunc from 0xaa14158 to 0x1e05eb2 2024-09-11T07:07:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:no valid command found; 10 closest matches: 2024-09-11T07:07:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:0 2024-09-11T07:07:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:1 2024-09-11T07:07:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:2 2024-09-11T07:07:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:abort 2024-09-11T07:07:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:assert 2024-09-11T07:07:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:bench [] [] [] [] 2024-09-11T07:07:10.255 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs debug_inject_read_zeros 2024-09-11T07:07:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs files list 2024-09-11T07:07:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs stats 2024-09-11T07:07:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:bluestore allocator dump block 2024-09-11T07:07:10.256 INFO:teuthology.orchestra.run.smithi079.stderr:Error EINVAL: invalid command 2024-09-11T07:07:10.258 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T07:07:10.259 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T07:07:10.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 'trim stale osdmaps' 2024-09-11T07:07:10.261 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:10.261 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:10.261 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:10.272 INFO:teuthology.orchestra.run.smithi079.stdout:3518 trunc from 0x1e05eb2 to 0xe0562a3 2024-09-11T07:07:10.275 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:3519 read 0xd5a0ac6 thru 0xd5a99d2 (0x8f0d bytes) 2024-09-11T07:07:10.280 INFO:teuthology.orchestra.run.smithi079.stdout:3521 read 0x88d7a31 thru 0x88e2206 (0xa7d6 bytes) 2024-09-11T07:07:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:3522 read 0x34afea5 thru 0x34b3e2b (0x3f87 bytes) 2024-09-11T07:07:10.281 INFO:teuthology.orchestra.run.smithi079.stdout:3525 write 0xc17ce62 thru 0xc18c219 (0xf3b8 bytes) 2024-09-11T07:07:10.302 INFO:teuthology.orchestra.run.smithi079.stdout:3526 trunc from 0xe0562a3 to 0x5eb36eb 2024-09-11T07:07:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:10.314 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:3529 read 0x3522c57 thru 0x352856c (0x5916 bytes) 2024-09-11T07:07:10.315 INFO:teuthology.orchestra.run.smithi079.stdout:3530 punch from 0x1c49cdf to 0x1c4b8af, (0x1bd0 bytes) 2024-09-11T07:07:10.316 INFO:teuthology.orchestra.run.smithi079.stdout:3531 trunc from 0x5eb36eb to 0x71e4459 2024-09-11T07:07:10.320 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:10.320+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:10.323 INFO:teuthology.orchestra.run.smithi079.stdout:3532 write 0x5f77dc4 thru 0x5f80e73 (0x90b0 bytes) 2024-09-11T07:07:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:3535 read 0x1c2d24d thru 0x1c32796 (0x554a bytes) 2024-09-11T07:07:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:10.330 INFO:teuthology.orchestra.run.smithi079.stdout:3537 read 0x574ef12 thru 0x574ef1e (0xd bytes) 2024-09-11T07:07:10.341 INFO:teuthology.orchestra.run.smithi079.stdout:3538 write 0x99c3475 thru 0x99c70dc (0x3c68 bytes) 2024-09-11T07:07:10.350 INFO:teuthology.orchestra.run.smithi079.stdout:3539 trunc from 0x99c70dd to 0x7beaef0 2024-09-11T07:07:10.380 INFO:teuthology.orchestra.run.smithi079.stdout:3540 write 0xd211ed1 thru 0xd215836 (0x3966 bytes) 2024-09-11T07:07:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:10.386 INFO:teuthology.orchestra.run.smithi079.stdout:3542 read 0x6c10c30 thru 0x6c1b9af (0xad80 bytes) 2024-09-11T07:07:10.387 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:10.381+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:10.390 INFO:teuthology.orchestra.run.smithi079.stdout:3544 trunc from 0xd215837 to 0xb711a08 2024-09-11T07:07:10.398 INFO:teuthology.orchestra.run.smithi079.stdout:3545 clone 34 order 21 su 262144 sc 3 2024-09-11T07:07:10.404 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:10.404 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:10.404 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:10.404 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:10.404 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:10.418 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:no valid command found; 10 closest matches: 2024-09-11T07:07:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:0 2024-09-11T07:07:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:1 2024-09-11T07:07:10.430 INFO:teuthology.orchestra.run.smithi079.stderr:2 2024-09-11T07:07:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:abort 2024-09-11T07:07:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:assert 2024-09-11T07:07:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:bench [] [] [] [] 2024-09-11T07:07:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs debug_inject_read_zeros 2024-09-11T07:07:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs files list 2024-09-11T07:07:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs stats 2024-09-11T07:07:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:bluestore allocator dump block 2024-09-11T07:07:10.431 INFO:teuthology.orchestra.run.smithi079.stderr:Error EINVAL: invalid command 2024-09-11T07:07:10.434 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T07:07:10.434 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T07:07:10.434 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 'trim stale osdmaps' 2024-09-11T07:07:10.504 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:10.504+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.512951663999999, 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:10.584 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:07:10.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:07:10.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7525 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4898816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 59.881978052000001, 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058576490000000002, 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.590 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7525 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701087+0000", 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018042780000000001 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701093+0000", 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7880000000000003e-06 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701108+0000", 2024-09-11T07:07:10.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4409999999999999e-05 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701116+0000", 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2120000000000003e-06 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757734+0000", 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056618467999999998 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757798+0000", 2024-09-11T07:07:10.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3978000000000003e-05 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757860+0000", 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1356e-05 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.086781168999998, 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.594 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.086724951999997, 2024-09-11T07:07:10.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26245 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 88064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:10.602 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083726321999997, 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058494675000000003, 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26245 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497536+0000", 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.035e-06 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497541+0000", 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9740000000000001e-06 2024-09-11T07:07:10.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497557+0000", 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5794000000000002e-05 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497568+0000", 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0879999999999999e-05 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555887+0000", 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058319353999999997 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555952+0000", 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4875999999999993e-05 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556030+0000", 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7762000000000005e-05 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:10.606 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083677791, 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:10.610 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083624690999997, 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083525786000003, 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:07:10.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.618 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083457918000001, 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:10.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:07:10.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:07:10.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083401383999998, 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:07:10.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:07:10.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083348923999999, 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:07:10.627 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:10.631 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083297295999998, 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:10.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:07:10.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:07:10.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083245873999999, 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.640 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083194779999999, 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:07:10.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083142819999999, 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.645 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:07:10.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.083043306999997, 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:07:10.649 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.653 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.082984502000002, 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:10.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:07:10.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:07:10.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.082933347999997, 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:07:10.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.082877042, 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.662 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:07:10.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:07:10.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:07:10.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.076077527000002, 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:07:10.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:10.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:07:10.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:07:10.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.670 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:10.670 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:10.670 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:10.671 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T07:07:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:no valid command found; 10 closest matches: 2024-09-11T07:07:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:0 2024-09-11T07:07:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:1 2024-09-11T07:07:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:2 2024-09-11T07:07:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:abort 2024-09-11T07:07:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:assert 2024-09-11T07:07:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:bench [] [] [] [] 2024-09-11T07:07:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs debug_inject_read_zeros 2024-09-11T07:07:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs files list 2024-09-11T07:07:10.672 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs stats 2024-09-11T07:07:10.673 INFO:teuthology.orchestra.run.smithi079.stderr:bluestore allocator dump block 2024-09-11T07:07:10.673 INFO:teuthology.orchestra.run.smithi079.stderr:Error EINVAL: invalid command 2024-09-11T07:07:10.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:10.673 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T07:07:10.673 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 'trim stale osdmaps' 2024-09-11T07:07:10.674 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:10.665+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:10.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:10.769+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:10.836 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:10.836 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:10.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:10.866 INFO:teuthology.orchestra.run.smithi079.stderr:no valid command found; 10 closest matches: 2024-09-11T07:07:10.867 INFO:teuthology.orchestra.run.smithi079.stderr:0 2024-09-11T07:07:10.867 INFO:teuthology.orchestra.run.smithi079.stderr:1 2024-09-11T07:07:10.867 INFO:teuthology.orchestra.run.smithi079.stderr:2 2024-09-11T07:07:10.867 INFO:teuthology.orchestra.run.smithi079.stderr:abort 2024-09-11T07:07:10.867 INFO:teuthology.orchestra.run.smithi079.stderr:assert 2024-09-11T07:07:10.867 INFO:teuthology.orchestra.run.smithi079.stderr:bench [] [] [] [] 2024-09-11T07:07:10.867 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs debug_inject_read_zeros 2024-09-11T07:07:10.868 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs files list 2024-09-11T07:07:10.868 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs stats 2024-09-11T07:07:10.868 INFO:teuthology.orchestra.run.smithi079.stderr:bluestore allocator dump block 2024-09-11T07:07:10.868 INFO:teuthology.orchestra.run.smithi079.stderr:Error EINVAL: invalid command 2024-09-11T07:07:10.870 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T07:07:10.871 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T07:07:10.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 'trim stale osdmaps' 2024-09-11T07:07:10.873 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:10.872+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:10.974 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:10.972+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:10.983 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:10.983 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:10.983 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:11.000 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:11.009 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:07:11.074 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:11.072+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:11.089 INFO:teuthology.orchestra.run.smithi079.stderr:no valid command found; 10 closest matches: 2024-09-11T07:07:11.089 INFO:teuthology.orchestra.run.smithi079.stderr:0 2024-09-11T07:07:11.090 INFO:teuthology.orchestra.run.smithi079.stderr:1 2024-09-11T07:07:11.090 INFO:teuthology.orchestra.run.smithi079.stderr:2 2024-09-11T07:07:11.090 INFO:teuthology.orchestra.run.smithi079.stderr:abort 2024-09-11T07:07:11.090 INFO:teuthology.orchestra.run.smithi079.stderr:assert 2024-09-11T07:07:11.090 INFO:teuthology.orchestra.run.smithi079.stderr:bench [] [] [] [] 2024-09-11T07:07:11.090 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs debug_inject_read_zeros 2024-09-11T07:07:11.090 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs files list 2024-09-11T07:07:11.090 INFO:teuthology.orchestra.run.smithi079.stderr:bluefs stats 2024-09-11T07:07:11.090 INFO:teuthology.orchestra.run.smithi079.stderr:bluestore allocator dump block 2024-09-11T07:07:11.090 INFO:teuthology.orchestra.run.smithi079.stderr:Error EINVAL: invalid command 2024-09-11T07:07:11.093 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-11T07:07:11.093 INFO:tasks.thrashosds.thrasher:Failed to trim stale osdmaps, ignoring 2024-09-11T07:07:11.141 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:11.141 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:11.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.469687639, 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.142 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.469675498999997, 2024-09-11T07:07:11.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.469024548, 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:07:11.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:07:11.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:11.155 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.468967652000003, 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:07:11.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:07:11.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.468940617999998, 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:07:11.160 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:11.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:07:11.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:07:11.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.164 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.466396756000002, 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:07:11.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:07:11.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:07:11.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:07:11.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.466374647999999, 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.169 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:07:11.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:07:11.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.466355032999999, 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:07:11.173 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.177 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.466332127999998, 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:11.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.181 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.465953366999997, 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.182 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:11.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:07:11.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.186 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.465921864999999, 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:07:11.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:07:11.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.465404589999999, 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.191 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:07:11.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.465380461000002, 2024-09-11T07:07:11.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:07:11.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:07:11.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.465367135000001, 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:11.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:07:11.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:07:11.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.464947207000002, 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:07:11.204 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:07:11.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.464919797999997, 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.209 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:07:11.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.464140794000002, 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.213 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:11.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:07:11.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:11.217 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.459040666, 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.701163333, 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:07:11.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:07:11.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.228 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.70098952, 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:07:11.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:07:11.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:07:11.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:11.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:07:11.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:07:11.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.236 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:11.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:11.238 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:11.236+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:11.280 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #32, image image_client.0-clone32 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent33 2024-09-11T07:07:11.338 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:11.336+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:11.374 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:11.374 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:11.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:11.422 INFO:teuthology.orchestra.run.smithi079.stdout:3546 writesame 0x956bfd9 thru 0x95796c1 data_size 0x3(0xd6e9 bytes) 2024-09-11T07:07:11.457 INFO:teuthology.orchestra.run.smithi079.stdout:3547 punch from 0x90c5b8d to 0x90d027b, (0xa6ee bytes) 2024-09-11T07:07:11.458 INFO:teuthology.orchestra.run.smithi079.stdout:3548 read 0xb043e54 thru 0xb0490fe (0x52ab bytes) 2024-09-11T07:07:11.458 INFO:teuthology.orchestra.run.smithi079.stdout:3549 writesame 0xae0b6af thru 0xae18474 data_size 0x1(0xcdc6 bytes) 2024-09-11T07:07:11.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:11.453+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:11.517 INFO:teuthology.orchestra.run.smithi079.stdout:3551 read 0x568edfc thru 0x568eee2 (0xe7 bytes) 2024-09-11T07:07:11.533 INFO:teuthology.orchestra.run.smithi079.stdout:3553 write 0xd0392ce thru 0xd047ee6 (0xec19 bytes) 2024-09-11T07:07:11.536 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:11.537 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:11.537 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:11.539 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:11.536+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:11.541 INFO:teuthology.orchestra.run.smithi079.stdout:3554 write 0x2262a0f thru 0x226614e (0x3740 bytes) 2024-09-11T07:07:11.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:11.559 INFO:teuthology.orchestra.run.smithi079.stdout:3555 read 0xb3525f9 thru 0xb35b18d (0x8b95 bytes) 2024-09-11T07:07:11.560 INFO:teuthology.orchestra.run.smithi079.stdout:3556 punch from 0x23574dd to 0x23615a9, (0xa0cc bytes) 2024-09-11T07:07:11.561 INFO:teuthology.orchestra.run.smithi079.stdout:3557 write 0xac37157 thru 0xac463a6 (0xf250 bytes) 2024-09-11T07:07:11.569 INFO:teuthology.orchestra.run.smithi079.stdout:3558 read 0x6e92fb7 thru 0x6e94813 (0x185d bytes) 2024-09-11T07:07:11.570 INFO:teuthology.orchestra.run.smithi079.stdout:3559 trunc from 0xd047ee7 to 0xc97ceaa 2024-09-11T07:07:11.586 INFO:teuthology.orchestra.run.smithi079.stdout:3560 read 0x153d617 thru 0x1542d49 (0x5733 bytes) 2024-09-11T07:07:11.587 INFO:teuthology.orchestra.run.smithi079.stdout:3561 write 0x1886575 thru 0x188e605 (0x8091 bytes) 2024-09-11T07:07:11.603 INFO:teuthology.orchestra.run.smithi079.stdout:3562 read 0x2a9aa79 thru 0x2aa7716 (0xcc9e bytes) 2024-09-11T07:07:11.606 INFO:teuthology.orchestra.run.smithi079.stdout:3563 trunc from 0xc97ceaa to 0xb2e5b70 2024-09-11T07:07:11.621 INFO:teuthology.orchestra.run.smithi079.stdout:3564 read 0x3ca6c2 thru 0x3cf2fe (0x4c3d bytes) 2024-09-11T07:07:11.622 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:11.622 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:11.623 INFO:teuthology.orchestra.run.smithi079.stdout:3568 punch from 0x340a34c to 0x340b358, (0x100c bytes) 2024-09-11T07:07:11.623 INFO:teuthology.orchestra.run.smithi079.stdout:3571 writesame 0x1d7f808 thru 0x1d8e0b1 data_size 0x1b(0xe8aa bytes) 2024-09-11T07:07:11.640 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:11.637+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:11.660 INFO:teuthology.orchestra.run.smithi079.stdout:3572 write 0xe03bf01 thru 0xe04a472 (0xe572 bytes) 2024-09-11T07:07:11.669 INFO:teuthology.orchestra.run.smithi079.stdout:3573 read 0x9adaae6 thru 0x9ae12a5 (0x67c0 bytes) 2024-09-11T07:07:11.670 INFO:teuthology.orchestra.run.smithi079.stdout:3577 write 0x9f7d45c thru 0x9f8ab34 (0xd6d9 bytes) 2024-09-11T07:07:11.678 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:11.686 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46274 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5447680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351997273999999, 2024-09-11T07:07:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042635002999999998, 2024-09-11T07:07:11.686 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46274 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9800000000000004e-07 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331645+0000", 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331652+0000", 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4159999999999998e-06 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331659+0000", 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2710000000000003e-06 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374165+0000", 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042505493999999998 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374214+0000", 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8826999999999999e-05 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374277+0000", 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3145000000000006e-05 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46275 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5496832~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351972312000001, 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042748189999999998, 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46275 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331669+0000", 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2900000000000001e-06 2024-09-11T07:07:11.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331686+0000", 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6767999999999999e-05 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331693+0000", 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6599999999999998e-06 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374308+0000", 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042614919000000001 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374355+0000", 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7166000000000002e-05 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374415+0000", 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9893999999999999e-05 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46276 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5545984~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:11.695 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351937886000002, 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042856001999999997, 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46276 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:11.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331702+0000", 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331704+0000", 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5629999999999999e-06 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331712+0000", 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9340000000000006e-06 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331720+0000", 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1049999999999995e-06 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374445+0000", 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042724597000000003 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374494+0000", 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9234999999999999e-05 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374557+0000", 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3058000000000005e-05 2024-09-11T07:07:11.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46277 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5595136~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351887541, 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042946033000000002, 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.700 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46277 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331752+0000", 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2500000000000005e-07 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331755+0000", 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7e-06 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331763+0000", 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331777+0000", 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3749e-05 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374591+0000", 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042813898000000003 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374637+0000", 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6492000000000001e-05 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374697+0000", 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0222e-05 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46278 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5644288~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351852862000001, 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043078449999999997, 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.705 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46278 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331787+0000", 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9299999999999997e-07 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331789+0000", 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331797+0000", 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-11T07:07:11.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331804+0000", 2024-09-11T07:07:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3010000000000001e-06 2024-09-11T07:07:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374743+0000", 2024-09-11T07:07:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042938538999999998 2024-09-11T07:07:11.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374800+0000", 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6637e-05 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374865+0000", 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4906999999999994e-05 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46279 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5693440~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351826976000002, 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043192304000000001, 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46279 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1500000000000005e-07 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331815+0000", 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4080000000000001e-06 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331822+0000", 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3359999999999997e-06 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331831+0000", 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4530000000000002e-06 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374897+0000", 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043066213999999998 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374944+0000", 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7292000000000001e-05 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375004+0000", 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0086e-05 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46280 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5742592~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:11.714 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351796847999999, 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043330417000000003, 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46280 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:11.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331843+0000", 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331848+0000", 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5570000000000003e-06 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331857+0000", 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6689999999999995e-06 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331863+0000", 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0610000000000001e-06 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375049+0000", 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043186443999999997 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375104+0000", 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4821999999999998e-05 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375172+0000", 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8371e-05 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46281 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5791744~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351768585999999, 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043441781999999998, 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.719 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.720 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.720 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.720 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.720 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46281 2024-09-11T07:07:11.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.720 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:11.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331871+0000", 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9900000000000001e-07 2024-09-11T07:07:11.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331873+0000", 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.458e-06 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331885+0000", 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1919999999999999e-05 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331891+0000", 2024-09-11T07:07:11.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0950000000000001e-06 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375205+0000", 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043314084000000003 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375253+0000", 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8047000000000003e-05 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375312+0000", 2024-09-11T07:07:11.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8678999999999998e-05 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46282 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5840896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351691471999999, 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043532266999999999, 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.724 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46282 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:11.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331948+0000", 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7199999999999997e-07 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331952+0000", 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4479999999999999e-06 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331962+0000", 2024-09-11T07:07:11.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7389999999999994e-06 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331968+0000", 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6789999999999999e-06 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375357+0000", 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043388559 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375413+0000", 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5971999999999999e-05 2024-09-11T07:07:11.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375480+0000", 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6997999999999998e-05 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46283 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5890048~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351656532, 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043635858999999999, 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.728 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46283 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:11.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331983+0000", 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3799999999999997e-07 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331985+0000", 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4990000000000001e-06 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331993+0000", 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9629999999999998e-06 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332003+0000", 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8199999999999992e-06 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375512+0000", 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043508865000000001 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375560+0000", 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8004999999999999e-05 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375618+0000", 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8168999999999998e-05 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46284 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5939200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351628144999999, 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043772483000000001, 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.733 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46284 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0699999999999997e-07 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332014+0000", 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4619999999999999e-06 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332021+0000", 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650000000000004e-06 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332029+0000", 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-06 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375663+0000", 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043634233000000001 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375717+0000", 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4209000000000002e-05 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375783+0000", 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6297000000000006e-05 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46285 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5988352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351601704, 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043885753, 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46285 2024-09-11T07:07:11.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332038+0000", 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332040+0000", 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332048+0000", 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5830000000000001e-06 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332054+0000", 2024-09-11T07:07:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0340000000000002e-06 2024-09-11T07:07:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375817+0000", 2024-09-11T07:07:11.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043762574999999998 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375865+0000", 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8637000000000002e-05 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375923+0000", 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7757000000000003e-05 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.742 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46286 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6037504~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351577516999999, 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044027821000000002, 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46286 2024-09-11T07:07:11.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332062+0000", 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332064+0000", 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2740000000000002e-06 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332073+0000", 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6719999999999993e-06 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332079+0000", 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8579999999999996e-06 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375967+0000", 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043888476000000003 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376022+0000", 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4208e-05 2024-09-11T07:07:11.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376089+0000", 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7688000000000007e-05 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46287 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6086656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351527515000001, 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044117732999999999, 2024-09-11T07:07:11.747 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46287 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332112+0000", 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332115+0000", 2024-09-11T07:07:11.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6680000000000001e-06 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332123+0000", 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3110000000000006e-06 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332129+0000", 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4230000000000002e-06 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376121+0000", 2024-09-11T07:07:11.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043991816000000003 2024-09-11T07:07:11.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376171+0000", 2024-09-11T07:07:11.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9540999999999999e-05 2024-09-11T07:07:11.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376229+0000", 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8328999999999997e-05 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46288 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6135808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351501161000002, 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044260648, 2024-09-11T07:07:11.752 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46288 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7000000000000004e-07 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332141+0000", 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4449999999999999e-06 2024-09-11T07:07:11.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332153+0000", 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1772e-05 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332159+0000", 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376274+0000", 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044115170000000002 2024-09-11T07:07:11.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376333+0000", 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9017000000000001e-05 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376398+0000", 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5506999999999995e-05 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46289 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6184960~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351457788000001, 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044357445000000002, 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46289 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.757 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332182+0000", 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3200000000000005e-07 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332184+0000", 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332192+0000", 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332200+0000", 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3170000000000004e-06 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376431+0000", 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044230923999999998 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376479+0000", 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8072999999999999e-05 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376539+0000", 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9789e-05 2024-09-11T07:07:11.760 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46290 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6234112~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351431179999999, 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044494765999999998, 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46290 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0100000000000005e-07 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332211+0000", 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099999999999998e-06 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332222+0000", 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1443999999999999e-05 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332228+0000", 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376583+0000", 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044355252999999997 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376639+0000", 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5278000000000002e-05 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376703+0000", 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3885000000000002e-05 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46291 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6283264~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.351402877999998, 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044598027999999998, 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46291 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332237+0000", 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:07:11.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332239+0000", 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4399999999999999e-06 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332246+0000", 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332253+0000", 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0379999999999996e-06 2024-09-11T07:07:11.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376728+0000", 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044475317 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376777+0000", 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9475999999999999e-05 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376834+0000", 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6749999999999997e-05 2024-09-11T07:07:11.769 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46955 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9379840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.135477684000001, 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042646256, 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.770 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46955 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3099999999999999e-07 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548163+0000", 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.127e-06 2024-09-11T07:07:11.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548166+0000", 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.179e-06 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548169+0000", 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8609999999999998e-06 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590717+0000", 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042547883000000002 2024-09-11T07:07:11.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590754+0000", 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.765e-05 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590808+0000", 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3325000000000002e-05 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46956 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9428992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:11.774 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.13546642, 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042772421999999997, 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46956 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548174+0000", 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1790000000000001e-06 2024-09-11T07:07:11.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548177+0000", 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2119999999999999e-06 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548180+0000", 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7369999999999998e-06 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590827+0000", 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042647353999999998 2024-09-11T07:07:11.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590886+0000", 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8968999999999997e-05 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590945+0000", 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8754e-05 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:11.778 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:11.779 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:3579 trunc from 0xe04a473 to 0x93c755f 2024-09-11T07:07:11.780 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:11.776+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:11.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:11.782 INFO:teuthology.orchestra.run.smithi079.stdout:3580 read 0x3bf1b28 thru 0x3bf9df2 (0x82cb bytes) 2024-09-11T07:07:11.782 INFO:teuthology.orchestra.run.smithi079.stdout:3581 trunc from 0x93c755f to 0x3114c54 2024-09-11T07:07:11.782 INFO:teuthology.orchestra.run.smithi079.stdout:3582 read 0x59a5a6 thru 0x5a04a2 (0x5efd bytes) 2024-09-11T07:07:11.782 INFO:teuthology.orchestra.run.smithi079.stdout:3583 trunc from 0x3114c54 to 0x592082d 2024-09-11T07:07:11.798 INFO:teuthology.orchestra.run.smithi079.stdout:3584 write 0xa414cef thru 0xa4179c7 (0x2cd9 bytes) 2024-09-11T07:07:11.806 INFO:teuthology.orchestra.run.smithi079.stdout:3585 read 0x9caf7cf thru 0x9cafad8 (0x30a bytes) 2024-09-11T07:07:11.825 INFO:teuthology.orchestra.run.smithi079.stdout:3587 trunc from 0xa4179c8 to 0x149a737 2024-09-11T07:07:11.876 INFO:teuthology.orchestra.run.smithi079.stdout:3588 write 0x6a37da thru 0x6b20c4 (0xe8eb bytes) 2024-09-11T07:07:11.881 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:11.880+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:11.894 INFO:teuthology.orchestra.run.smithi079.stdout:3589 read 0xd38362 thru 0xd3f23e (0x6edd bytes) 2024-09-11T07:07:11.895 INFO:teuthology.orchestra.run.smithi079.stdout:3591 read 0xbf9f70 thru 0xc04e81 (0xaf12 bytes) 2024-09-11T07:07:11.896 INFO:teuthology.orchestra.run.smithi079.stdout:3592 read 0xd7d6bb thru 0xd82d77 (0x56bd bytes) 2024-09-11T07:07:11.908 INFO:teuthology.orchestra.run.smithi079.stdout:3594 write 0x230d1fb thru 0x231c753 (0xf559 bytes) 2024-09-11T07:07:11.914 INFO:teuthology.orchestra.run.smithi079.stdout:3595 read 0x163c6ce thru 0x164adce (0xe701 bytes) 2024-09-11T07:07:11.918 INFO:teuthology.orchestra.run.smithi079.stdout:3596 trunc from 0x231c754 to 0x15ddbd 2024-09-11T07:07:11.933 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:11.933 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:11.950 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:11.971 INFO:teuthology.orchestra.run.smithi079.stdout:3597 punch from 0x61d24 to 0x625c5, (0x8a1 bytes) 2024-09-11T07:07:11.982 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:11.980+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:11.984 INFO:teuthology.orchestra.run.smithi079.stdout:3598 trunc from 0x15ddbd to 0x80a2ae5 2024-09-11T07:07:11.991 INFO:teuthology.orchestra.run.smithi079.stdout:3600 write 0x1be4322 thru 0x1beeeff (0xabde bytes) 2024-09-11T07:07:11.997 INFO:teuthology.orchestra.run.smithi079.stdout:3601 punch from 0x2678cdd to 0x2683702, (0xaa25 bytes) 2024-09-11T07:07:11.997 INFO:teuthology.orchestra.run.smithi079.stdout:3602 punch from 0x4fa6a0c to 0x4fa8537, (0x1b2b bytes) 2024-09-11T07:07:11.997 INFO:teuthology.orchestra.run.smithi079.stdout:3603 read 0x2773885 thru 0x2774ba5 (0x1321 bytes) 2024-09-11T07:07:11.997 INFO:teuthology.orchestra.run.smithi079.stdout:3606 punch from 0x6e5a9 to 0x7c7af, (0xe206 bytes) 2024-09-11T07:07:11.997 INFO:teuthology.orchestra.run.smithi079.stdout:3608 writesame 0x6828a7f thru 0x68310df data_size 0x1(0x8661 bytes) 2024-09-11T07:07:12.002 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:07:12.039 INFO:teuthology.orchestra.run.smithi079.stdout:3610 punch from 0x33176c7 to 0x3325d4d, (0xe686 bytes) 2024-09-11T07:07:12.039 INFO:teuthology.orchestra.run.smithi079.stdout:3612 read 0x6145538 thru 0x6150589 (0xb052 bytes) 2024-09-11T07:07:12.039 INFO:teuthology.orchestra.run.smithi079.stdout:3613 punch from 0x28ffa45 to 0x2908341, (0x88fc bytes) 2024-09-11T07:07:12.040 INFO:teuthology.orchestra.run.smithi079.stdout:3615 punch from 0x6a0d373 to 0x6a1b7d9, (0xe466 bytes) 2024-09-11T07:07:12.040 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:12.040 INFO:teuthology.orchestra.run.smithi079.stdout:3620 punch from 0x79d730f to 0x79de18d, (0x6e7e bytes) 2024-09-11T07:07:12.040 INFO:teuthology.orchestra.run.smithi079.stdout:3621 read 0x4536d06 thru 0x453ebe1 (0x7edc bytes) 2024-09-11T07:07:12.040 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:12.040 INFO:teuthology.orchestra.run.smithi079.stdout:3623 read 0x4aa37c8 thru 0x4aa509c (0x18d5 bytes) 2024-09-11T07:07:12.054 INFO:teuthology.orchestra.run.smithi079.stdout:3624 write 0xe219d61 thru 0xe21c6d3 (0x2973 bytes) 2024-09-11T07:07:12.061 INFO:teuthology.orchestra.run.smithi079.stdout:3625 read 0x99c8b97 thru 0x99cea52 (0x5ebc bytes) 2024-09-11T07:07:12.061 INFO:teuthology.orchestra.run.smithi079.stdout:3626 trunc from 0xe21c6d4 to 0xe2ce934 2024-09-11T07:07:12.068 INFO:teuthology.orchestra.run.smithi079.stdout:3627 write 0xcddfad4 thru 0xcded7ca (0xdcf7 bytes) 2024-09-11T07:07:12.075 INFO:teuthology.orchestra.run.smithi079.stdout:3630 read 0x8cae6a2 thru 0x8cba7b6 (0xc115 bytes) 2024-09-11T07:07:12.075 INFO:teuthology.orchestra.run.smithi079.stdout:3631 read 0xa9ed47c thru 0xa9f5089 (0x7c0e bytes) 2024-09-11T07:07:12.075 INFO:teuthology.orchestra.run.smithi079.stdout:3632 writesame 0xe98a89 thru 0xe9eed8 data_size 0x3c(0x6450 bytes) 2024-09-11T07:07:12.082 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:12.082 INFO:teuthology.orchestra.run.smithi079.stdout:3634 read 0xb15eec8 thru 0xb1619cb (0x2b04 bytes) 2024-09-11T07:07:12.082 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:12.083 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:12.077+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:12.083 INFO:teuthology.orchestra.run.smithi079.stdout:3638 trunc from 0xe2ce934 to 0xeb3a733 2024-09-11T07:07:12.090 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:12.090 INFO:teuthology.orchestra.run.smithi079.stdout:3642 read 0x9c9d1a1 thru 0x9ca3de4 (0x6c44 bytes) 2024-09-11T07:07:12.090 INFO:teuthology.orchestra.run.smithi079.stdout:3643 writesame 0x95ee7d2 thru 0x95fbedb data_size 0x4b(0xd70a bytes) 2024-09-11T07:07:12.096 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:12.096 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:12.096 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:12.096 INFO:teuthology.orchestra.run.smithi079.stdout:3646 clone 35 order 21 su 262144 sc 7 2024-09-11T07:07:12.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:12.154 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:12.155 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:12.173 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:12.173 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:12.183 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:12.180+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:12.196 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:12.197 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:12.213 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:12.213 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:12.236 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:12.237 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:12.258 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:12.258 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:12.273 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:12.274 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:12.280 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:12.280 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:12.283 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:12.277+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:12.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:12.302 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:12.303 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:12.385 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:12.384+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:12.432 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:12.432 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:12.446 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:12.486 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:12.484+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:12.567 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:12.567 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:12.581 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:12.628 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:12.625+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:12.688 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:12.685+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:12.705 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:12.705 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:12.719 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:12.789 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:12.788+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:12.851 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:12.851 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:12.864 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:12.890 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:12.885+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:12.991 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:12.985+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:13.036 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:13.036 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:13.051 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:13.091 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:13.085+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:13.146 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone34 from 0xeb3a733 (overlap 0x15ddbd) to 0x0 2024-09-11T07:07:13.184 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:13.184 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:13.193 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:13.189+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:13.199 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:13.256 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #33, image image_client.0-clone33 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent34 2024-09-11T07:07:13.294 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:13.289+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:13.324 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:13.325 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:13.340 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:13.395 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:13.392+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:13.465 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:13.465 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:13.479 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:13.520 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:13.520+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:13.596 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:13.596+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:13.644 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:13.644 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:13.659 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:13.682 INFO:teuthology.orchestra.run.smithi079.stdout:3647 punch from 0x51a0fa2 to 0x51a3e69, (0x2ec7 bytes) 2024-09-11T07:07:13.689 INFO:teuthology.orchestra.run.smithi079.stdout:3648 write 0x5b5ff22 thru 0x5b6ec2b (0xed0a bytes) 2024-09-11T07:07:13.694 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:13.694 INFO:teuthology.orchestra.run.smithi079.stdout:3650 write 0xc616ff3 thru 0xc621fef (0xaffd bytes) 2024-09-11T07:07:13.698 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:13.693+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:13.701 INFO:teuthology.orchestra.run.smithi079.stdout:3651 write 0x48cddbb thru 0x48d9d51 (0xbf97 bytes) 2024-09-11T07:07:13.706 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:13.706 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:13.706 INFO:teuthology.orchestra.run.smithi079.stdout:3655 punch from 0x2e90b15 to 0x2ea0533, (0xfa1e bytes) 2024-09-11T07:07:13.706 INFO:teuthology.orchestra.run.smithi079.stdout:3657 punch from 0x3ae5027 to 0x3aee0cc, (0x90a5 bytes) 2024-09-11T07:07:13.727 INFO:teuthology.orchestra.run.smithi079.stdout:3658 trunc from 0xeb3a733 to 0x22e366 2024-09-11T07:07:13.757 INFO:teuthology.orchestra.run.smithi079.stdout:3659 read 0x188a86 thru 0x19243d (0x99b8 bytes) 2024-09-11T07:07:13.757 INFO:teuthology.orchestra.run.smithi079.stdout:3660 punch from 0x1f7da6 to 0x2049cb, (0xcc25 bytes) 2024-09-11T07:07:13.792 INFO:teuthology.orchestra.run.smithi079.stdout:3661 write 0xd20326b thru 0xd20972c (0x64c2 bytes) 2024-09-11T07:07:13.798 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:13.793+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:3662 punch from 0xba4dd46 to 0xba50241, (0x24fb bytes) 2024-09-11T07:07:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:3663 read 0x7d29888 thru 0x7d30592 (0x6d0b bytes) 2024-09-11T07:07:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:3666 read 0xa2c1baf thru 0xa2cf2a4 (0xd6f6 bytes) 2024-09-11T07:07:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:3671 read 0x91f6e70 thru 0x9201c7d (0xae0e bytes) 2024-09-11T07:07:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:3672 read 0x8b06770 thru 0x8b143df (0xdc70 bytes) 2024-09-11T07:07:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:3674 punch from 0x11286fd to 0x112dc27, (0x552a bytes) 2024-09-11T07:07:13.800 INFO:teuthology.orchestra.run.smithi079.stdout:3675 writesame 0x816a88a thru 0x816d7f6 data_size 0x13(0x2f6d bytes) 2024-09-11T07:07:13.807 INFO:teuthology.orchestra.run.smithi079.stdout:3676 punch from 0x5fe7945 to 0x5ff45a0, (0xcc5b bytes) 2024-09-11T07:07:13.807 INFO:teuthology.orchestra.run.smithi079.stdout:3677 read 0xa02f22f thru 0xa03d8ee (0xe6c0 bytes) 2024-09-11T07:07:13.807 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:13.807 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:13.807 INFO:teuthology.orchestra.run.smithi079.stdout:3680 writesame 0x1267384 thru 0x126f3ac data_size 0x2b(0x8029 bytes) 2024-09-11T07:07:13.814 INFO:teuthology.orchestra.run.smithi079.stdout:3681 read 0x756b52b thru 0x7570342 (0x4e18 bytes) 2024-09-11T07:07:13.814 INFO:teuthology.orchestra.run.smithi079.stdout:3682 punch from 0x61c26dd to 0x61c836e, (0x5c91 bytes) 2024-09-11T07:07:13.814 INFO:teuthology.orchestra.run.smithi079.stdout:3683 write 0xa5ca4d2 thru 0xa5d1f44 (0x7a73 bytes) 2024-09-11T07:07:13.836 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:13.836 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:13.846 INFO:teuthology.orchestra.run.smithi079.stdout:3684 trunc from 0xd20972d to 0xb3b826 2024-09-11T07:07:13.851 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:13.872 INFO:teuthology.orchestra.run.smithi079.stdout:3685 punch from 0xa35ef3 to 0xa37c65, (0x1d72 bytes) 2024-09-11T07:07:13.895 INFO:teuthology.orchestra.run.smithi079.stdout:3687 write 0x7bed2ca thru 0x7bef883 (0x25ba bytes) 2024-09-11T07:07:13.899 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:13.893+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:13.909 INFO:teuthology.orchestra.run.smithi079.stdout:3688 write 0x7f0d20f thru 0x7f1850a (0xb2fc bytes) 2024-09-11T07:07:13.915 INFO:teuthology.orchestra.run.smithi079.stdout:3689 read 0x7da9c60 thru 0x7db8455 (0xe7f6 bytes) 2024-09-11T07:07:13.937 INFO:teuthology.orchestra.run.smithi079.stdout:3691 write 0xcd73462 thru 0xcd7c10f (0x8cae bytes) 2024-09-11T07:07:13.943 INFO:teuthology.orchestra.run.smithi079.stdout:3692 write 0x88e56dc thru 0x88f08b9 (0xb1de bytes) 2024-09-11T07:07:13.950 INFO:teuthology.orchestra.run.smithi079.stdout:3693 write 0x87fbf12 thru 0x88058bc (0x99ab bytes) 2024-09-11T07:07:13.971 INFO:teuthology.orchestra.run.smithi079.stdout:3695 write 0xddc0911 thru 0xddcb3bc (0xaaac bytes) 2024-09-11T07:07:13.978 INFO:teuthology.orchestra.run.smithi079.stdout:3696 read 0xa973de4 thru 0xa9788f5 (0x4b12 bytes) 2024-09-11T07:07:13.978 INFO:teuthology.orchestra.run.smithi079.stdout:3698 write 0x52cf57f thru 0x52d9f0a (0xa98c bytes) 2024-09-11T07:07:13.984 INFO:teuthology.orchestra.run.smithi079.stdout:3699 write 0xc5a66b7 thru 0xc5b0c5b (0xa5a5 bytes) 2024-09-11T07:07:13.986 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:13.986 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:13.994 INFO:teuthology.orchestra.run.smithi079.stdout:3700 trunc from 0xddcb3bd to 0xcbcda09 2024-09-11T07:07:14.001 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:14.000+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:14.002 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:14.013 INFO:teuthology.orchestra.run.smithi079.stdout:3701 write 0x67622c7 thru 0x676a2ac (0x7fe6 bytes) 2024-09-11T07:07:14.024 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:07:14.045 INFO:teuthology.orchestra.run.smithi079.stdout:3702 trunc from 0xcbcda09 to 0x2c5cc20 2024-09-11T07:07:14.061 INFO:teuthology.orchestra.run.smithi079.stdout:3704 read 0x1edea87 thru 0x1ee1e46 (0x33c0 bytes) 2024-09-11T07:07:14.061 INFO:teuthology.orchestra.run.smithi079.stdout:3705 write 0x1e87fec thru 0x1e94a6c (0xca81 bytes) 2024-09-11T07:07:14.066 INFO:teuthology.orchestra.run.smithi079.stdout:3706 read 0x258046e thru 0x258e792 (0xe325 bytes) 2024-09-11T07:07:14.067 INFO:teuthology.orchestra.run.smithi079.stdout:3707 punch from 0x1b1746b to 0x1b26868, (0xf3fd bytes) 2024-09-11T07:07:14.067 INFO:teuthology.orchestra.run.smithi079.stdout:3709 writesame 0x1490c03 thru 0x149ca46 data_size 0xa4(0xbe44 bytes) 2024-09-11T07:07:14.102 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:14.097+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:14.104 INFO:teuthology.orchestra.run.smithi079.stdout:3710 write 0xdab2215 thru 0xdab2bb7 (0x9a3 bytes) 2024-09-11T07:07:14.110 INFO:teuthology.orchestra.run.smithi079.stdout:3711 write 0xd084840 thru 0xd08b40d (0x6bce bytes) 2024-09-11T07:07:14.116 INFO:teuthology.orchestra.run.smithi079.stdout:3713 read 0x8dd426d thru 0x8dd9eeb (0x5c7f bytes) 2024-09-11T07:07:14.116 INFO:teuthology.orchestra.run.smithi079.stdout:3715 write 0x3c9a44a thru 0x3c9afd5 (0xb8c bytes) 2024-09-11T07:07:14.122 INFO:teuthology.orchestra.run.smithi079.stdout:3716 punch from 0x17fa124 to 0x17fa9e9, (0x8c5 bytes) 2024-09-11T07:07:14.123 INFO:teuthology.orchestra.run.smithi079.stdout:3718 punch from 0x4c7d811 to 0x4c8056e, (0x2d5d bytes) 2024-09-11T07:07:14.123 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.123 INFO:teuthology.orchestra.run.smithi079.stdout:3720 read 0x693dfda thru 0x6940938 (0x295f bytes) 2024-09-11T07:07:14.123 INFO:teuthology.orchestra.run.smithi079.stdout:3721 write 0x2001521 thru 0x201001c (0xeafc bytes) 2024-09-11T07:07:14.129 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.143 INFO:teuthology.orchestra.run.smithi079.stdout:3723 trunc from 0xdab2bb8 to 0x7ce905e 2024-09-11T07:07:14.162 INFO:teuthology.orchestra.run.smithi079.stdout:3724 write 0x65130cd thru 0x6518309 (0x523d bytes) 2024-09-11T07:07:14.169 INFO:teuthology.orchestra.run.smithi079.stdout:3725 read 0x136084c thru 0x136efef (0xe7a4 bytes) 2024-09-11T07:07:14.169 INFO:teuthology.orchestra.run.smithi079.stdout:3726 read 0x315a980 thru 0x315c191 (0x1812 bytes) 2024-09-11T07:07:14.169 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.169 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.169 INFO:teuthology.orchestra.run.smithi079.stdout:3729 punch from 0x17fd910 to 0x180205a, (0x474a bytes) 2024-09-11T07:07:14.169 INFO:teuthology.orchestra.run.smithi079.stdout:3730 punch from 0x317a9c1 to 0x318314a, (0x8789 bytes) 2024-09-11T07:07:14.169 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.171 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:14.171 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:14.183 INFO:teuthology.orchestra.run.smithi079.stdout:3732 writesame 0xa285dd9 thru 0xa28d9a1 data_size 0x15(0x7bc9 bytes) 2024-09-11T07:07:14.183 INFO:teuthology.orchestra.run.smithi079.stdout:3733 read 0x76ab2fe thru 0x76b295f (0x7662 bytes) 2024-09-11T07:07:14.187 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:14.200 INFO:teuthology.orchestra.run.smithi079.stdout:3734 writesame 0xdcfc6bf thru 0xdd0168d data_size 0x1(0x4fcf bytes) 2024-09-11T07:07:14.200 INFO:teuthology.orchestra.run.smithi079.stdout:3735 punch from 0x1e4b673 to 0x1e4f8f4, (0x4281 bytes) 2024-09-11T07:07:14.200 INFO:teuthology.orchestra.run.smithi079.stdout:3736 read 0x1fbb2d2 thru 0x1fc3cff (0x8a2e bytes) 2024-09-11T07:07:14.200 INFO:teuthology.orchestra.run.smithi079.stdout:3737 writesame 0x7c5f8e4 thru 0x7c69164 data_size 0x1(0x9881 bytes) 2024-09-11T07:07:14.203 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:14.197+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:14.222 INFO:teuthology.orchestra.run.smithi079.stdout:3738 write 0x63daca4 thru 0x63db882 (0xbdf bytes) 2024-09-11T07:07:14.226 INFO:teuthology.orchestra.run.smithi079.stdout:3740 write 0x7419748 thru 0x741c6b3 (0x2f6c bytes) 2024-09-11T07:07:14.231 INFO:teuthology.orchestra.run.smithi079.stdout:3741 write 0x26ffe80 thru 0x270f4f5 (0xf676 bytes) 2024-09-11T07:07:14.235 INFO:teuthology.orchestra.run.smithi079.stdout:3744 write 0x86b37cb thru 0x86b5d50 (0x2586 bytes) 2024-09-11T07:07:14.239 INFO:teuthology.orchestra.run.smithi079.stdout:3745 writesame 0x1426db6 thru 0x142811a data_size 0x5(0x1365 bytes) 2024-09-11T07:07:14.250 INFO:teuthology.orchestra.run.smithi079.stdout:3746 trunc from 0xdd0168e to 0x96d8394 2024-09-11T07:07:14.259 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.275 INFO:teuthology.orchestra.run.smithi079.stdout:3749 write 0xdc760ef thru 0xdc77ca0 (0x1bb2 bytes) 2024-09-11T07:07:14.280 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.280 INFO:teuthology.orchestra.run.smithi079.stdout:3752 read 0x1707f71 thru 0x170af97 (0x3027 bytes) 2024-09-11T07:07:14.281 INFO:teuthology.orchestra.run.smithi079.stdout:3755 read 0xbc957c7 thru 0xbca0f81 (0xb7bb bytes) 2024-09-11T07:07:14.281 INFO:teuthology.orchestra.run.smithi079.stdout:3756 write 0x7e52d37 thru 0x7e5aac1 (0x7d8b bytes) 2024-09-11T07:07:14.298 INFO:teuthology.orchestra.run.smithi079.stdout:3758 write 0xe554c68 thru 0xe55818b (0x3524 bytes) 2024-09-11T07:07:14.304 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:14.304+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:14.305 INFO:teuthology.orchestra.run.smithi079.stdout:3761 write 0x321e224 thru 0x322caf7 (0xe8d4 bytes) 2024-09-11T07:07:14.310 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:14.311 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:14.321 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:14.326 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:14.332 INFO:teuthology.orchestra.run.smithi079.stdout:3762 trunc from 0xe55818c to 0x66f9b93 2024-09-11T07:07:14.372 INFO:teuthology.orchestra.run.smithi079.stdout:3763 write 0xb8b92ea thru 0xb8c421d (0xaf34 bytes) 2024-09-11T07:07:14.380 INFO:teuthology.orchestra.run.smithi079.stdout:3766 write 0xb030ec1 thru 0xb034583 (0x36c3 bytes) 2024-09-11T07:07:14.398 INFO:teuthology.orchestra.run.smithi079.stdout:3767 write 0xec15c4c thru 0xec23775 (0xdb2a bytes) 2024-09-11T07:07:14.402 INFO:teuthology.orchestra.run.smithi079.stdout:3768 read 0x311369 thru 0x31d7e2 (0xc47a bytes) 2024-09-11T07:07:14.416 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:14.416+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:14.434 INFO:teuthology.orchestra.run.smithi079.stdout:3769 trunc from 0xec23776 to 0x6b9244 2024-09-11T07:07:14.455 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.455 INFO:teuthology.orchestra.run.smithi079.stdout:3771 read 0x1b4d63 thru 0x1c2ff2 (0xe290 bytes) 2024-09-11T07:07:14.455 INFO:teuthology.orchestra.run.smithi079.stdout:3773 read 0x95c69 thru 0x9f71b (0x9ab3 bytes) 2024-09-11T07:07:14.456 INFO:teuthology.orchestra.run.smithi079.stdout:3774 read 0x1ce70a thru 0x1d4353 (0x5c4a bytes) 2024-09-11T07:07:14.475 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:14.475 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:14.477 INFO:teuthology.orchestra.run.smithi079.stdout:3775 writesame 0x85e2527 thru 0x85edaeb data_size 0x1(0xb5c5 bytes) 2024-09-11T07:07:14.477 INFO:teuthology.orchestra.run.smithi079.stdout:3776 write 0x1384c8a thru 0x138b128 (0x649f bytes) 2024-09-11T07:07:14.491 INFO:teuthology.orchestra.run.smithi079.stdout:3777 write 0x908aa2d thru 0x908cb4b (0x211f bytes) 2024-09-11T07:07:14.492 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:14.492 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:14.497 INFO:teuthology.orchestra.run.smithi079.stdout:3779 write 0x59f2ce6 thru 0x59f49d2 (0x1ced bytes) 2024-09-11T07:07:14.502 INFO:teuthology.orchestra.run.smithi079.stdout:3781 punch from 0x467693d to 0x467ae43, (0x4506 bytes) 2024-09-11T07:07:14.505 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:14.505 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:14.505 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:14.501+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:14.511 INFO:teuthology.orchestra.run.smithi079.stdout:3782 trunc from 0x908cb4c to 0x27b07e8 2024-09-11T07:07:14.512 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:14.512 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:14.521 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:14.529 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:14.529 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:14.530 INFO:teuthology.orchestra.run.smithi079.stdout:3783 read 0x16072f1 thru 0x1616c15 (0xf925 bytes) 2024-09-11T07:07:14.530 INFO:teuthology.orchestra.run.smithi079.stdout:3785 writesame 0xf0ba58 thru 0xf13a9c data_size 0x1(0x8045 bytes) 2024-09-11T07:07:14.546 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:14.546 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:14.561 INFO:teuthology.orchestra.run.smithi079.stdout:3786 read 0x1f1c3d1 thru 0x1f23f5f (0x7b8f bytes) 2024-09-11T07:07:14.572 INFO:teuthology.orchestra.run.smithi079.stdout:3787 trunc from 0x27b07e8 to 0xa4e730a 2024-09-11T07:07:14.579 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:14.579 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:14.582 INFO:teuthology.orchestra.run.smithi079.stdout:3789 writesame 0x319efdc thru 0x31a7355 data_size 0x1(0x837a bytes) 2024-09-11T07:07:14.598 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:14.598 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:14.606 INFO:teuthology.orchestra.run.smithi079.stdout:3790 write 0x55156fe thru 0x5524f68 (0xf86b bytes) 2024-09-11T07:07:14.608 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:14.608+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:14.611 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.611 INFO:teuthology.orchestra.run.smithi079.stdout:3792 write 0x93addc3 thru 0x93b299f (0x4bdd bytes) 2024-09-11T07:07:14.615 INFO:teuthology.orchestra.run.smithi079.stdout:3793 writesame 0x5048aed thru 0x504d34a data_size 0x3b(0x485e bytes) 2024-09-11T07:07:14.619 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:14.620 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.621 INFO:teuthology.orchestra.run.smithi079.stdout:3795 writesame 0x5e1415f thru 0x5e16f70 data_size 0x1(0x2e12 bytes) 2024-09-11T07:07:14.645 INFO:teuthology.orchestra.run.smithi079.stdout:3796 trunc from 0xa4e730a to 0x2bad4b0 2024-09-11T07:07:14.663 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.663 INFO:teuthology.orchestra.run.smithi079.stdout:3799 read 0x8f82b4 thru 0x901e2e (0x9b7b bytes) 2024-09-11T07:07:14.664 INFO:teuthology.orchestra.run.smithi079.stdout:3800 read 0xab217 thru 0xab55f (0x349 bytes) 2024-09-11T07:07:14.664 INFO:teuthology.orchestra.run.smithi079.stdout:3801 read 0x2127d34 thru 0x212da32 (0x5cff bytes) 2024-09-11T07:07:14.664 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.664 INFO:teuthology.orchestra.run.smithi079.stdout:3805 read 0x28a2f50 thru 0x28a9c11 (0x6cc2 bytes) 2024-09-11T07:07:14.678 INFO:teuthology.orchestra.run.smithi079.stdout:3806 writesame 0x5d6e41f thru 0x5d7d1f1 data_size 0x1(0xedd3 bytes) 2024-09-11T07:07:14.695 INFO:teuthology.orchestra.run.smithi079.stdout:3808 write 0x9e150f1 thru 0x9e1a7bb (0x56cb bytes) 2024-09-11T07:07:14.701 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:14.701 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:14.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:14.701 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:14.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.701 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:07:14.701 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.629442588000003, 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:14.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:07:14.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:7525 3.d 3:b63d126e:::rbd_data.1161d159867d.0000000000000001:5 [read 4898816~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 63.998468975999998, 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058576490000000002, 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 7525 2024-09-11T07:07:14.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.699283+0000", 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701087+0000", 2024-09-11T07:07:14.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0018042780000000001 2024-09-11T07:07:14.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701093+0000", 2024-09-11T07:07:14.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7880000000000003e-06 2024-09-11T07:07:14.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701108+0000", 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4409999999999999e-05 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.701116+0000", 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.2120000000000003e-06 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757734+0000", 2024-09-11T07:07:14.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056618467999999998 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757798+0000", 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3978000000000003e-05 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:10.757860+0000", 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1356e-05 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.712 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.203272093000002, 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:14.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.717 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.203215876000002, 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:14.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:14.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:07:14.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26245 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 88064~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.200217246000001, 2024-09-11T07:07:14.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058494675000000003, 2024-09-11T07:07:14.723 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.723 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.723 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.723 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.723 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26245 2024-09-11T07:07:14.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.723 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497535+0000", 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497536+0000", 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.035e-06 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497541+0000", 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9740000000000001e-06 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497557+0000", 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5794000000000002e-05 2024-09-11T07:07:14.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497568+0000", 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0879999999999999e-05 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555887+0000", 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058319353999999997 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.555952+0000", 2024-09-11T07:07:14.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4875999999999993e-05 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556030+0000", 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7762000000000005e-05 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:14.727 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.200168714999997, 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:07:14.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:07:14.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:07:14.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:07:14.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:07:14.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.732 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.732 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.200115615000001, 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:14.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:07:14.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.20001671, 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199948841999998, 2024-09-11T07:07:14.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:07:14.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:07:14.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199892308000003, 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.747 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:07:14.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.752 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.752 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:14.752 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199839848000003, 2024-09-11T07:07:14.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:07:14.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.753 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.753 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.753 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:07:14.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.754 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:14.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:14.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:07:14.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:07:14.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:07:14.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:07:14.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:07:14.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:07:14.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:07:14.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:14.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:07:14.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:07:14.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:07:14.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:07:14.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:07:14.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:07:14.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.761 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.762 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.762 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:14.762 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199788220000002, 2024-09-11T07:07:14.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:07:14.762 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.763 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.763 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.763 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:07:14.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:14.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:14.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:07:14.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:07:14.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:07:14.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:07:14.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:07:14.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:07:14.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:07:14.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:07:14.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:07:14.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:07:14.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:07:14.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:07:14.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:07:14.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:07:14.771 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.772 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.773 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:14.773 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199736798000004, 2024-09-11T07:07:14.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:07:14.773 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.773 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.773 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.774 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:07:14.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.774 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:14.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:14.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:07:14.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:14.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:07:14.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:07:14.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:07:14.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:07:14.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:07:14.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:07:14.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:07:14.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:07:14.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:07:14.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:07:14.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:07:14.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:07:14.782 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.782 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.782 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:14.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199685703999997, 2024-09-11T07:07:14.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:07:14.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.784 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.784 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:07:14.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.785 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:14.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:14.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:07:14.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:14.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:07:14.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:07:14.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:07:14.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:07:14.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:07:14.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:07:14.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:07:14.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:07:14.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.792 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.792 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:14.792 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199633744000003, 2024-09-11T07:07:14.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:07:14.792 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.792 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.792 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.793 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:07:14.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.793 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:14.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:14.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:07:14.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:07:14.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:07:14.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:07:14.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:07:14.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:07:14.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:07:14.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:07:14.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:07:14.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:07:14.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:07:14.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:07:14.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:07:14.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:07:14.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.798 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.798 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.798 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:14.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199534231000001, 2024-09-11T07:07:14.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:07:14.799 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.799 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.799 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.799 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.799 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:07:14.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.799 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:14.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:14.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:07:14.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:07:14.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199475425999999, 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:07:14.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:07:14.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199424272000002, 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:14.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.812 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.199367965999997, 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:07:14.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.192568451, 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:14.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:14.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:14.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:07:14.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:14.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:14.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:07:14.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:07:14.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:07:14.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:14.822 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:14.822 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:14.824 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:14.825 INFO:teuthology.orchestra.run.smithi079.stdout:3809 write 0x953dbc6 thru 0x954af6c (0xd3a7 bytes) 2024-09-11T07:07:14.825 INFO:teuthology.orchestra.run.smithi079.stdout:3811 write 0x2478f9a thru 0x247b93c (0x29a3 bytes) 2024-09-11T07:07:14.825 INFO:teuthology.orchestra.run.smithi079.stdout:3813 read 0x3f7106f thru 0x3f79311 (0x82a3 bytes) 2024-09-11T07:07:14.825 INFO:teuthology.orchestra.run.smithi079.stdout:3814 writesame 0x11ef24c thru 0x11f4fe7 data_size 0x6(0x5d9c bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3815 read 0x29980a7 thru 0x29a1289 (0x91e3 bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3816 write 0x3fce528 thru 0x3fd067b (0x2154 bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3819 trunc from 0x9e1a7bc to 0x80d9e95 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3820 punch from 0x570a85d to 0x57192b3, (0xea56 bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3821 read 0x44574ee thru 0x445ca74 (0x5587 bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3822 writesame 0x45b05e1 thru 0x45b3d3a data_size 0xd(0x375a bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3823 trunc from 0x80d9e95 to 0xe1a9457 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3824 punch from 0x1c962f6 to 0x1c9b63e, (0x5348 bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3825 punch from 0x202b1b5 to 0x203570f, (0xa55a bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3826 punch from 0xdf94f1b to 0xdf9e4bf, (0x95a4 bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3827 writesame 0x9c08f8 thru 0x9cd7e1 data_size 0x5(0xceea bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3828 read 0x59b3cd8 thru 0x59b4640 (0x969 bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3829 write 0x676efa1 thru 0x6779c25 (0xac85 bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3830 write 0x684419 thru 0x688f04 (0x4aec bytes) 2024-09-11T07:07:14.826 INFO:teuthology.orchestra.run.smithi079.stdout:3831 punch from 0x8be19f4 to 0x8be8e1c, (0x7428 bytes) 2024-09-11T07:07:14.827 INFO:teuthology.orchestra.run.smithi079.stdout:3833 writesame 0x3552b13 thru 0x3554cce data_size 0x22(0x21bc bytes) 2024-09-11T07:07:14.827 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:14.817+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:14.827 INFO:teuthology.orchestra.run.smithi079.stdout:3834 writesame 0xd567694 thru 0xd56c97d data_size 0x1(0x52ea bytes) 2024-09-11T07:07:14.854 INFO:teuthology.orchestra.run.smithi079.stdout:3835 punch from 0x7b074b6 to 0x7b14ed8, (0xda22 bytes) 2024-09-11T07:07:14.867 INFO:teuthology.orchestra.run.smithi079.stdout:3836 trunc from 0xe1a9457 to 0x940d7f6 2024-09-11T07:07:14.893 INFO:teuthology.orchestra.run.smithi079.stdout:3838 write 0x88b9283 thru 0x88c7ffe (0xed7c bytes) 2024-09-11T07:07:14.901 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:14.917 INFO:teuthology.orchestra.run.smithi079.stdout:3840 writesame 0x9d69fca thru 0x9d70c5a data_size 0x1(0x6c91 bytes) 2024-09-11T07:07:14.923 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:14.920+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:14.941 INFO:teuthology.orchestra.run.smithi079.stdout:3841 write 0xd628280 thru 0xd62bf30 (0x3cb1 bytes) 2024-09-11T07:07:14.948 INFO:teuthology.orchestra.run.smithi079.stdout:3842 writesame 0xa6a322d thru 0xa6a3c05 data_size 0x1(0x9d9 bytes) 2024-09-11T07:07:14.960 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:14.961 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:14.961 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:14.961 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:14.980 INFO:teuthology.orchestra.run.smithi079.stdout:3843 trunc from 0xd62bf31 to 0x3047097 2024-09-11T07:07:14.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:15.010 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.010 INFO:teuthology.orchestra.run.smithi079.stdout:3845 punch from 0x76cf66 to 0x7799dc, (0xca76 bytes) 2024-09-11T07:07:15.010 INFO:teuthology.orchestra.run.smithi079.stdout:3846 punch from 0x16647a8 to 0x16649d0, (0x228 bytes) 2024-09-11T07:07:15.010 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.010 INFO:teuthology.orchestra.run.smithi079.stdout:3849 read 0x13a0f0d thru 0x13a795b (0x6a4f bytes) 2024-09-11T07:07:15.011 INFO:teuthology.orchestra.run.smithi079.stdout:3850 punch from 0x1c25ee1 to 0x1c26a2a, (0xb49 bytes) 2024-09-11T07:07:15.024 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:15.024+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:15.031 INFO:teuthology.orchestra.run.smithi079.stdout:3853 write 0x63fbc56 thru 0x64029df (0x6d8a bytes) 2024-09-11T07:07:15.035 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:07:15.073 INFO:teuthology.orchestra.run.smithi079.stdout:3854 writesame 0xd68e3e4 thru 0xd6916f0 data_size 0x1(0x330d bytes) 2024-09-11T07:07:15.074 INFO:teuthology.orchestra.run.smithi079.stdout:3855 read 0x60f4bd1 thru 0x60fdb93 (0x8fc3 bytes) 2024-09-11T07:07:15.074 INFO:teuthology.orchestra.run.smithi079.stdout:3857 writesame 0x19c4ed4 thru 0x19c5f2e data_size 0x1(0x105b bytes) 2024-09-11T07:07:15.083 INFO:teuthology.orchestra.run.smithi079.stdout:3858 writesame 0xa9bd796 thru 0xa9c4bac data_size 0x71(0x7417 bytes) 2024-09-11T07:07:15.096 INFO:teuthology.orchestra.run.smithi079.stdout:3861 trunc from 0xd6916f1 to 0xc37a1e4 2024-09-11T07:07:15.109 INFO:teuthology.orchestra.run.smithi079.stdout:3863 punch from 0x8367d83 to 0x8371e14, (0xa091 bytes) 2024-09-11T07:07:15.109 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.109 INFO:teuthology.orchestra.run.smithi079.stdout:3865 write 0xbcce922 thru 0xbcced35 (0x414 bytes) 2024-09-11T07:07:15.116 INFO:teuthology.orchestra.run.smithi079.stdout:3866 read 0xbe12839 thru 0xbe2145e (0xec26 bytes) 2024-09-11T07:07:15.116 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.125 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:15.121+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:15.138 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:15.138 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:15.138 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:15.138 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:15.138 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:15.139 INFO:teuthology.orchestra.run.smithi079.stdout:3868 trunc from 0xc37a1e4 to 0x1eebbca 2024-09-11T07:07:15.155 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:15.196 INFO:teuthology.orchestra.run.smithi079.stdout:3869 writesame 0x857bd1f thru 0x857ef5c data_size 0x2(0x323e bytes) 2024-09-11T07:07:15.202 INFO:teuthology.orchestra.run.smithi079.stdout:3870 trunc from 0x857ef5d to 0xb783dba 2024-09-11T07:07:15.215 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.216 INFO:teuthology.orchestra.run.smithi079.stdout:3872 punch from 0x5f8bcc2 to 0x5f981e1, (0xc51f bytes) 2024-09-11T07:07:15.216 INFO:teuthology.orchestra.run.smithi079.stdout:3873 read 0x67b58ca thru 0x67b8204 (0x293b bytes) 2024-09-11T07:07:15.226 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:15.224+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:15.229 INFO:teuthology.orchestra.run.smithi079.stdout:3874 write 0xc28d655 thru 0xc298c40 (0xb5ec bytes) 2024-09-11T07:07:15.237 INFO:teuthology.orchestra.run.smithi079.stdout:3875 read 0x72284e7 thru 0x72347de (0xc2f8 bytes) 2024-09-11T07:07:15.237 INFO:teuthology.orchestra.run.smithi079.stdout:3877 read 0x36e0855 thru 0x36e14a1 (0xc4d bytes) 2024-09-11T07:07:15.238 INFO:teuthology.orchestra.run.smithi079.stdout:3878 trunc from 0xc298c41 to 0xd220313 2024-09-11T07:07:15.265 INFO:teuthology.orchestra.run.smithi079.stdout:3879 write 0xe82973d thru 0xe8318c0 (0x8184 bytes) 2024-09-11T07:07:15.273 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.273 INFO:teuthology.orchestra.run.smithi079.stdout:3881 read 0xc433a3b thru 0xc435937 (0x1efd bytes) 2024-09-11T07:07:15.273 INFO:teuthology.orchestra.run.smithi079.stdout:3882 punch from 0x49644ac to 0x4965000, (0xb54 bytes) 2024-09-11T07:07:15.274 INFO:teuthology.orchestra.run.smithi079.stdout:3884 read 0x86b6509 thru 0x86b923c (0x2d34 bytes) 2024-09-11T07:07:15.274 INFO:teuthology.orchestra.run.smithi079.stdout:3885 read 0x37568e5 thru 0x37613cd (0xaae9 bytes) 2024-09-11T07:07:15.274 INFO:teuthology.orchestra.run.smithi079.stdout:3886 punch from 0x82a840e to 0x82a85fe, (0x1f0 bytes) 2024-09-11T07:07:15.274 INFO:teuthology.orchestra.run.smithi079.stdout:3887 write 0x1fc1117 thru 0x1fcae41 (0x9d2b bytes) 2024-09-11T07:07:15.280 INFO:teuthology.orchestra.run.smithi079.stdout:3889 read 0xb4bc481 thru 0xb4c85c4 (0xc144 bytes) 2024-09-11T07:07:15.289 INFO:teuthology.orchestra.run.smithi079.stdout:3890 trunc from 0xe8318c1 to 0x8a39b17 2024-09-11T07:07:15.313 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.313 INFO:teuthology.orchestra.run.smithi079.stdout:3892 read 0x6b6b0ec thru 0x6b6d7b2 (0x26c7 bytes) 2024-09-11T07:07:15.316 INFO:teuthology.orchestra.run.smithi079.stdout:3893 trunc from 0x8a39b17 to 0x6d0761e 2024-09-11T07:07:15.326 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:15.326 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.654016384000002, 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:07:15.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:07:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:07:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:07:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:07:15.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:07:15.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.654004244000006, 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:07:15.331 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:07:15.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:07:15.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.653353292999995, 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:07:15.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:07:15.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:07:15.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.340 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.653296397000005, 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:07:15.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:07:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:07:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.653269363000007, 2024-09-11T07:07:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:07:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:07:15.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:15.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:07:15.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:07:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:07:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:07:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:07:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:07:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:07:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:07:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:07:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:07:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:07:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:07:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:07:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:07:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.650725500999997, 2024-09-11T07:07:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:07:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:07:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.359 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:07:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:07:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:07:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:07:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:07:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:07:15.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:07:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:07:15.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:07:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:07:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:07:15.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:07:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:07:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.367 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.368 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.650703393000001, 2024-09-11T07:07:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:07:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:07:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:15.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:07:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:07:15.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:07:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:07:15.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:07:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:07:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:07:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:07:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:07:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:07:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:07:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:07:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:07:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.650683778000001, 2024-09-11T07:07:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:07:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.379 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:07:15.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:15.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:07:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:07:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:07:15.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:07:15.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:07:15.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:07:15.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:07:15.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:07:15.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:07:15.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:07:15.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:07:15.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:07:15.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:07:15.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:07:15.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.389 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.389 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.389 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:15.390 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.650660873000007, 2024-09-11T07:07:15.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:07:15.390 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.391 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:07:15.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.391 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:07:15.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:07:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:07:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:07:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:07:15.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:07:15.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:07:15.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:07:15.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:07:15.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:07:15.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:07:15.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:07:15.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:07:15.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:07:15.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.398 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.399 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.399 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.399 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:15.399 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.650282111999999, 2024-09-11T07:07:15.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:07:15.399 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:07:15.403 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.650250610000001, 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.404 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.407 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.649733334999993, 2024-09-11T07:07:15.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.410 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.411 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.649709205999997, 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.413 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:07:15.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.649695879999996, 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.417 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:15.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.649275951999996, 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.422 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:07:15.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:07:15.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.649248542999999, 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:07:15.426 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.427 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.430 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.648469539000004, 2024-09-11T07:07:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:07:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.431 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.432 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:07:15.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 64.643369410999995, 2024-09-11T07:07:15.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:15.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:15.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:07:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:07:15.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.441 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:07:15.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:07:15.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:07:15.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:07:15.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.442 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.442 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.442 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:15.442 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:15.443 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.885492077999999, 2024-09-11T07:07:15.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:07:15.443 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.443 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.443 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:15.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.443 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.443 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:07:15.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:07:15.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:07:15.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:07:15.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:07:15.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:07:15.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.450 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.451 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:15.451 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:15.451 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.885318264999999, 2024-09-11T07:07:15.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:07:15.451 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.451 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.451 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:07:15.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:15.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.458 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.459 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:15.459 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:15.321+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:15.460 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:15.461 INFO:teuthology.orchestra.run.smithi079.stdout:3894 write 0xd800b4d thru 0xd8061b9 (0x566d bytes) 2024-09-11T07:07:15.461 INFO:teuthology.orchestra.run.smithi079.stdout:3896 read 0x9ae0657 thru 0x9ae4935 (0x42df bytes) 2024-09-11T07:07:15.461 INFO:teuthology.orchestra.run.smithi079.stdout:3897 trunc from 0xd8061ba to 0x12fbd2a 2024-09-11T07:07:15.461 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.461 INFO:teuthology.orchestra.run.smithi079.stdout:3900 read 0xa0a322 thru 0xa0ae61 (0xb40 bytes) 2024-09-11T07:07:15.461 INFO:teuthology.orchestra.run.smithi079.stdout:3902 write 0xb0a58ba thru 0xb0b35b4 (0xdcfb bytes) 2024-09-11T07:07:15.461 INFO:teuthology.orchestra.run.smithi079.stdout:3903 read 0x37adf7e thru 0x37ba832 (0xc8b5 bytes) 2024-09-11T07:07:15.461 INFO:teuthology.orchestra.run.smithi079.stdout:3904 writesame 0x7b2652b thru 0x7b337c8 data_size 0x1(0xd29e bytes) 2024-09-11T07:07:15.505 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:15.501+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:15.524 INFO:teuthology.orchestra.run.smithi079.stdout:3905 read 0x261d4f8 thru 0x2625e14 (0x891d bytes) 2024-09-11T07:07:15.524 INFO:teuthology.orchestra.run.smithi079.stdout:3907 write 0x7d00ffe thru 0x7d0f540 (0xe543 bytes) 2024-09-11T07:07:15.551 INFO:teuthology.orchestra.run.smithi079.stdout:3908 write 0xd4171e3 thru 0xd420f9e (0x9dbc bytes) 2024-09-11T07:07:15.559 INFO:teuthology.orchestra.run.smithi079.stdout:3910 trunc from 0xd420f9f to 0xcccba68 2024-09-11T07:07:15.564 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:15.564+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:15.585 INFO:teuthology.orchestra.run.smithi079.stdout:3911 punch from 0x8a9f1ff to 0x8aa8f7b, (0x9d7c bytes) 2024-09-11T07:07:15.603 INFO:teuthology.orchestra.run.smithi079.stdout:3912 writesame 0xed288bf thru 0xed3758b data_size 0x79(0xeccd bytes) 2024-09-11T07:07:15.609 INFO:teuthology.orchestra.run.smithi079.stdout:3913 trunc from 0xed3758c to 0xc591d76 2024-09-11T07:07:15.624 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.641 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:15.641 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:15.641 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:15.643 INFO:teuthology.orchestra.run.smithi079.stdout:3916 write 0xe8e0975 thru 0xe8eb808 (0xae94 bytes) 2024-09-11T07:07:15.651 INFO:teuthology.orchestra.run.smithi079.stdout:3917 read 0x696741b thru 0x6968199 (0xd7f bytes) 2024-09-11T07:07:15.656 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:15.673 INFO:teuthology.orchestra.run.smithi079.stdout:3919 trunc from 0xe8eb809 to 0x4fa1dbd 2024-09-11T07:07:15.673 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:15.669+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:15.697 INFO:teuthology.orchestra.run.smithi079.stdout:3921 read 0x2f756e2 thru 0x2f84b70 (0xf48f bytes) 2024-09-11T07:07:15.734 INFO:teuthology.orchestra.run.smithi079.stdout:3922 write 0xdfd4ca5 thru 0xdfe06cb (0xba27 bytes) 2024-09-11T07:07:15.740 INFO:teuthology.orchestra.run.smithi079.stdout:3923 write 0xaff76bd thru 0xaffb1e8 (0x3b2c bytes) 2024-09-11T07:07:15.748 INFO:teuthology.orchestra.run.smithi079.stdout:3924 write 0x31b73a5 thru 0x31c2d26 (0xb982 bytes) 2024-09-11T07:07:15.758 INFO:teuthology.orchestra.run.smithi079.stdout:3926 write 0x54eb14d thru 0x54ef3f0 (0x42a4 bytes) 2024-09-11T07:07:15.766 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:15.764+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:3928 read 0x41b502a thru 0x41c30bf (0xe096 bytes) 2024-09-11T07:07:15.767 INFO:teuthology.orchestra.run.smithi079.stdout:3930 writesame 0x704dde6 thru 0x704ed81 data_size 0x12(0xf9c bytes) 2024-09-11T07:07:15.774 INFO:teuthology.orchestra.run.smithi079.stdout:3931 read 0x1388bdb thru 0x1395481 (0xc8a7 bytes) 2024-09-11T07:07:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:3933 punch from 0x234de2f to 0x235c0bd, (0xe28e bytes) 2024-09-11T07:07:15.775 INFO:teuthology.orchestra.run.smithi079.stdout:3934 read 0x7da1bb1 thru 0x7dad259 (0xb6a9 bytes) 2024-09-11T07:07:15.790 INFO:teuthology.orchestra.run.smithi079.stdout:3935 write 0xebdeb74 thru 0xebe4b86 (0x6013 bytes) 2024-09-11T07:07:15.798 INFO:teuthology.orchestra.run.smithi079.stdout:3936 read 0x3eef4b7 thru 0x3efb9e7 (0xc531 bytes) 2024-09-11T07:07:15.798 INFO:teuthology.orchestra.run.smithi079.stdout:3937 writesame 0xaff388a thru 0xaffd82a data_size 0xb(0x9fa1 bytes) 2024-09-11T07:07:15.801 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:15.802 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:15.802 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:15.802 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:15.802 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:15.822 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:15.831 INFO:teuthology.orchestra.run.smithi079.stdout:3938 trunc from 0xebe4b87 to 0x268d641 2024-09-11T07:07:15.866 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:15.864+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:15.879 INFO:teuthology.orchestra.run.smithi079.stdout:3940 write 0xa2091e4 thru 0xa20f383 (0x61a0 bytes) 2024-09-11T07:07:15.887 INFO:teuthology.orchestra.run.smithi079.stdout:3942 read 0x6062976 thru 0x60692f4 (0x697f bytes) 2024-09-11T07:07:15.887 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.905 INFO:teuthology.orchestra.run.smithi079.stdout:3944 write 0xde6370e thru 0xde672a4 (0x3b97 bytes) 2024-09-11T07:07:15.912 INFO:teuthology.orchestra.run.smithi079.stdout:3945 read 0x755ec01 thru 0x7562db8 (0x41b8 bytes) 2024-09-11T07:07:15.912 INFO:teuthology.orchestra.run.smithi079.stdout:3947 writesame 0x10893db thru 0x10947fd data_size 0x17(0xb423 bytes) 2024-09-11T07:07:15.920 INFO:teuthology.orchestra.run.smithi079.stdout:3948 write 0x41f7b0c thru 0x41fc829 (0x4d1e bytes) 2024-09-11T07:07:15.927 INFO:teuthology.orchestra.run.smithi079.stdout:3949 write 0x6c23adc thru 0x6c2b6d9 (0x7bfe bytes) 2024-09-11T07:07:15.933 INFO:teuthology.orchestra.run.smithi079.stdout:3951 write 0x28ecd3d thru 0x28fccd1 (0xff95 bytes) 2024-09-11T07:07:15.942 INFO:teuthology.orchestra.run.smithi079.stdout:3952 punch from 0x99a19f7 to 0x99a8a19, (0x7022 bytes) 2024-09-11T07:07:15.942 INFO:teuthology.orchestra.run.smithi079.stdout:3953 write 0x57ce8e0 thru 0x57d70a2 (0x87c3 bytes) 2024-09-11T07:07:15.949 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:15.960 INFO:teuthology.orchestra.run.smithi079.stdout:3956 trunc from 0xde672a5 to 0x8dbf26b 2024-09-11T07:07:15.964 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46274 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5447680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629518690000001, 2024-09-11T07:07:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042635002999999998, 2024-09-11T07:07:15.964 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46274 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:15.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9800000000000004e-07 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331645+0000", 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331652+0000", 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4159999999999998e-06 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331659+0000", 2024-09-11T07:07:15.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2710000000000003e-06 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374165+0000", 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042505493999999998 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374214+0000", 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8826999999999999e-05 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374277+0000", 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3145000000000006e-05 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46275 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5496832~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629493728, 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042748189999999998, 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.969 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46275 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:15.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331669+0000", 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2900000000000001e-06 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331686+0000", 2024-09-11T07:07:15.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6767999999999999e-05 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331693+0000", 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6599999999999998e-06 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374308+0000", 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042614919000000001 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374355+0000", 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7166000000000002e-05 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374415+0000", 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9893999999999999e-05 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.973 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46276 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5545984~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629459302000001, 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042856001999999997, 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46276 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331702+0000", 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331704+0000", 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5629999999999999e-06 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331712+0000", 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9340000000000006e-06 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331720+0000", 2024-09-11T07:07:15.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1049999999999995e-06 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374445+0000", 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042724597000000003 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374494+0000", 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9234999999999999e-05 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374557+0000", 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3058000000000005e-05 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46277 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5595136~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629408956999999, 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042946033000000002, 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46277 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331752+0000", 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2500000000000005e-07 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331755+0000", 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7e-06 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331763+0000", 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331777+0000", 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3749e-05 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374591+0000", 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042813898000000003 2024-09-11T07:07:15.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374637+0000", 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6492000000000001e-05 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374697+0000", 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0222e-05 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.982 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46278 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5644288~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629374278, 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043078449999999997, 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46278 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331787+0000", 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9299999999999997e-07 2024-09-11T07:07:15.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331789+0000", 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331797+0000", 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331804+0000", 2024-09-11T07:07:15.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3010000000000001e-06 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374743+0000", 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042938538999999998 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374800+0000", 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6637e-05 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374865+0000", 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4906999999999994e-05 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46279 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5693440~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629348392000001, 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043192304000000001, 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46279 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1500000000000005e-07 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331815+0000", 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4080000000000001e-06 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331822+0000", 2024-09-11T07:07:15.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3359999999999997e-06 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331831+0000", 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4530000000000002e-06 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374897+0000", 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043066213999999998 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374944+0000", 2024-09-11T07:07:15.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7292000000000001e-05 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375004+0000", 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0086e-05 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46280 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5742592~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629318263999998, 2024-09-11T07:07:15.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043330417000000003, 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46280 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:15.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331843+0000", 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331848+0000", 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5570000000000003e-06 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331857+0000", 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6689999999999995e-06 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331863+0000", 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0610000000000001e-06 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375049+0000", 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043186443999999997 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375104+0000", 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4821999999999998e-05 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375172+0000", 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8371e-05 2024-09-11T07:07:15.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46281 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5791744~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629290002000001, 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043441781999999998, 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:15.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46281 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331871+0000", 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9900000000000001e-07 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331873+0000", 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.458e-06 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331885+0000", 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1919999999999999e-05 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331891+0000", 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0950000000000001e-06 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375205+0000", 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043314084000000003 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375253+0000", 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8047000000000003e-05 2024-09-11T07:07:15.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375312+0000", 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8678999999999998e-05 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46282 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5840896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629212888000001, 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043532266999999999, 2024-09-11T07:07:16.000 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46282 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331948+0000", 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7199999999999997e-07 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331952+0000", 2024-09-11T07:07:16.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4479999999999999e-06 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331962+0000", 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7389999999999994e-06 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331968+0000", 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6789999999999999e-06 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375357+0000", 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043388559 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375413+0000", 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5971999999999999e-05 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375480+0000", 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6997999999999998e-05 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.004 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46283 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5890048~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629177947999999, 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043635858999999999, 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.005 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46283 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331983+0000", 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3799999999999997e-07 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331985+0000", 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4990000000000001e-06 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331993+0000", 2024-09-11T07:07:16.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9629999999999998e-06 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332003+0000", 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8199999999999992e-06 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375512+0000", 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043508865000000001 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375560+0000", 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8004999999999999e-05 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375618+0000", 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8168999999999998e-05 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46284 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5939200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629149560999998, 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043772483000000001, 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46284 2024-09-11T07:07:16.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0699999999999997e-07 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332014+0000", 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4619999999999999e-06 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332021+0000", 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650000000000004e-06 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332029+0000", 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-06 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375663+0000", 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043634233000000001 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375717+0000", 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4209000000000002e-05 2024-09-11T07:07:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375783+0000", 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6297000000000006e-05 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46285 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5988352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629123119999999, 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043885753, 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46285 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332038+0000", 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332040+0000", 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332048+0000", 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5830000000000001e-06 2024-09-11T07:07:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332054+0000", 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0340000000000002e-06 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375817+0000", 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043762574999999998 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375865+0000", 2024-09-11T07:07:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8637000000000002e-05 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375923+0000", 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7757000000000003e-05 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46286 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6037504~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629098933000002, 2024-09-11T07:07:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044027821000000002, 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46286 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332062+0000", 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332064+0000", 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2740000000000002e-06 2024-09-11T07:07:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332073+0000", 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6719999999999993e-06 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332079+0000", 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8579999999999996e-06 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375967+0000", 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043888476000000003 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376022+0000", 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4208e-05 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376089+0000", 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7688000000000007e-05 2024-09-11T07:07:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46287 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6086656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629048931, 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044117732999999999, 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46287 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332112+0000", 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332115+0000", 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6680000000000001e-06 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332123+0000", 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3110000000000006e-06 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332129+0000", 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4230000000000002e-06 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376121+0000", 2024-09-11T07:07:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043991816000000003 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376171+0000", 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9540999999999999e-05 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376229+0000", 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8328999999999997e-05 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46288 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6135808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.629022577000001, 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044260648, 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46288 2024-09-11T07:07:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7000000000000004e-07 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332141+0000", 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4449999999999999e-06 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332153+0000", 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1772e-05 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332159+0000", 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376274+0000", 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044115170000000002 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376333+0000", 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9017000000000001e-05 2024-09-11T07:07:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376398+0000", 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5506999999999995e-05 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46289 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6184960~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.628979204, 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044357445000000002, 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46289 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332182+0000", 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3200000000000005e-07 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332184+0000", 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332192+0000", 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332200+0000", 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3170000000000004e-06 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376431+0000", 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044230923999999998 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376479+0000", 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8072999999999999e-05 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376539+0000", 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9789e-05 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46290 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6234112~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.628952596000001, 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044494765999999998, 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46290 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0100000000000005e-07 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332211+0000", 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099999999999998e-06 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332222+0000", 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1443999999999999e-05 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332228+0000", 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376583+0000", 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044355252999999997 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376639+0000", 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5278000000000002e-05 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376703+0000", 2024-09-11T07:07:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3885000000000002e-05 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46291 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6283264~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.628924294000001, 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044598027999999998, 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46291 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332237+0000", 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332239+0000", 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4399999999999999e-06 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332246+0000", 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332253+0000", 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0379999999999996e-06 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376728+0000", 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044475317 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376777+0000", 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9475999999999999e-05 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376834+0000", 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6749999999999997e-05 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46955 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9379840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.4129991, 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042646256, 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46955 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3099999999999999e-07 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548163+0000", 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.127e-06 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548166+0000", 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.179e-06 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548169+0000", 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8609999999999998e-06 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590717+0000", 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042547883000000002 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590754+0000", 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.765e-05 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590808+0000", 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3325000000000002e-05 2024-09-11T07:07:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46956 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9428992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.412987835999999, 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042772421999999997, 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46956 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548174+0000", 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1790000000000001e-06 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548177+0000", 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2119999999999999e-06 2024-09-11T07:07:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548180+0000", 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7369999999999998e-06 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590827+0000", 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042647353999999998 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590886+0000", 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8968999999999997e-05 2024-09-11T07:07:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590945+0000", 2024-09-11T07:07:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8754e-05 2024-09-11T07:07:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.054 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:16.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:16.057 INFO:teuthology.orchestra.run.smithi079.stdout:3957 write 0x44f0bc thru 0x458430 (0x9375 bytes) 2024-09-11T07:07:16.057 INFO:teuthology.orchestra.run.smithi079.stdout:3958 write 0xd6fa0cc thru 0xd6fff96 (0x5ecb bytes) 2024-09-11T07:07:16.057 INFO:teuthology.orchestra.run.smithi079.stdout:3959 write 0x8cc3e12 thru 0x8cccf70 (0x915f bytes) 2024-09-11T07:07:16.057 INFO:teuthology.orchestra.run.smithi079.stdout:3960 read 0xb358cd1 thru 0xb35a109 (0x1439 bytes) 2024-09-11T07:07:16.057 INFO:teuthology.orchestra.run.smithi079.stdout:3961 write 0x451c420 thru 0x4528ee2 (0xcac3 bytes) 2024-09-11T07:07:16.057 INFO:teuthology.orchestra.run.smithi079.stdout:3962 write 0x4d54072 thru 0x4d5ff84 (0xbf13 bytes) 2024-09-11T07:07:16.057 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.057 INFO:teuthology.orchestra.run.smithi079.stdout:3966 read 0x2a082ee thru 0x2a16b4c (0xe85f bytes) 2024-09-11T07:07:16.057 INFO:teuthology.orchestra.run.smithi079.stdout:3967 write 0x83346e5 thru 0x83402bf (0xbbdb bytes) 2024-09-11T07:07:16.058 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:16.052+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:16.060 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.060 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.060 INFO:teuthology.orchestra.run.smithi079.stdout:3971 read 0xc522315 thru 0xc52245f (0x14b bytes) 2024-09-11T07:07:16.060 INFO:teuthology.orchestra.run.smithi079.stdout:3972 read 0x8481265 thru 0x848cf42 (0xbcde bytes) 2024-09-11T07:07:16.060 INFO:teuthology.orchestra.run.smithi079.stdout:3973 punch from 0x82b5b2f to 0x82c4614, (0xeae5 bytes) 2024-09-11T07:07:16.060 INFO:teuthology.orchestra.run.smithi079.stdout:3974 punch from 0x4de7d0f to 0x4deaae2, (0x2dd3 bytes) 2024-09-11T07:07:16.060 INFO:teuthology.orchestra.run.smithi079.stdout:3975 writesame 0x8df7c42 thru 0x8e00297 data_size 0x5f(0x8656 bytes) 2024-09-11T07:07:16.081 INFO:teuthology.orchestra.run.smithi079.stdout:3978 trunc from 0xd6fff97 to 0x93554b4 2024-09-11T07:07:16.094 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:07:16.094 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:07:16.095 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T07:07:16.095 INFO:tasks.thrashosds.thrasher:Setting osd 4 primary_affinity to 0.000000 2024-09-11T07:07:16.095 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 0 2024-09-11T07:07:16.108 INFO:teuthology.orchestra.run.smithi079.stdout:3979 read 0x748d152 thru 0x7492f96 (0x5e45 bytes) 2024-09-11T07:07:16.129 INFO:teuthology.orchestra.run.smithi079.stdout:3980 write 0xd4f5991 thru 0xd502027 (0xc697 bytes) 2024-09-11T07:07:16.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:16.153+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:16.158 INFO:teuthology.orchestra.run.smithi079.stdout:3982 trunc from 0xd502028 to 0xb10b15 2024-09-11T07:07:16.190 INFO:teuthology.orchestra.run.smithi079.stdout:3984 punch from 0x4a1a58 to 0x4b064f, (0xebf7 bytes) 2024-09-11T07:07:16.195 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:16.195 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:16.195 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:16.195 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:16.214 INFO:teuthology.orchestra.run.smithi079.stdout:3986 write 0x7cf4df5 thru 0x7d01862 (0xca6e bytes) 2024-09-11T07:07:16.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:16.222 INFO:teuthology.orchestra.run.smithi079.stdout:3987 read 0x5803c2f thru 0x580c93e (0x8d10 bytes) 2024-09-11T07:07:16.222 INFO:teuthology.orchestra.run.smithi079.stdout:3989 write 0xf20a6e thru 0xf2cb8c (0xc11f bytes) 2024-09-11T07:07:16.238 INFO:teuthology.orchestra.run.smithi079.stdout:3990 trunc from 0x7d01863 to 0x19dd642 2024-09-11T07:07:16.257 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:16.253+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:16.264 INFO:teuthology.orchestra.run.smithi079.stdout:3993 read 0x1a3bfb thru 0x1b208a (0xe490 bytes) 2024-09-11T07:07:16.265 INFO:teuthology.orchestra.run.smithi079.stdout:3994 punch from 0x19b67ea to 0x19bfe97, (0x96ad bytes) 2024-09-11T07:07:16.280 INFO:teuthology.orchestra.run.smithi079.stdout:3995 write 0x2dac517 thru 0x2db9873 (0xd35d bytes) 2024-09-11T07:07:16.306 INFO:teuthology.orchestra.run.smithi079.stdout:3996 write 0x7ab36dd thru 0x7ab63a9 (0x2ccd bytes) 2024-09-11T07:07:16.313 INFO:teuthology.orchestra.run.smithi079.stdout:3997 writesame 0x785c3c7 thru 0x7861aed data_size 0x3(0x5727 bytes) 2024-09-11T07:07:16.322 INFO:teuthology.orchestra.run.smithi079.stdout:3999 read 0x5fd5d52 thru 0x5fdec05 (0x8eb4 bytes) 2024-09-11T07:07:16.322 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.323 INFO:teuthology.orchestra.run.smithi079.stdout:4001 flatten 2024-09-11T07:07:16.344 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:16.344 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:16.344 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:16.345 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:16.345 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:16.358 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:16.356+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:16.361 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:16.363 INFO:teuthology.orchestra.run.smithi079.stdout:4002 write 0xe615e34 thru 0xe621bdf (0xbdac bytes) 2024-09-11T07:07:16.370 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.370 INFO:teuthology.orchestra.run.smithi079.stdout:4004 read 0x52ff131 thru 0x5301e75 (0x2d45 bytes) 2024-09-11T07:07:16.370 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.370 INFO:teuthology.orchestra.run.smithi079.stdout:4008 write 0x46c2433 thru 0x46cddb7 (0xb985 bytes) 2024-09-11T07:07:16.376 INFO:teuthology.orchestra.run.smithi079.stdout:4009 write 0x8f855d9 thru 0x8f86465 (0xe8d bytes) 2024-09-11T07:07:16.381 INFO:teuthology.orchestra.run.smithi079.stdout:4011 writesame 0x48c4f91 thru 0x48ca646 data_size 0xb(0x56b6 bytes) 2024-09-11T07:07:16.393 INFO:teuthology.orchestra.run.smithi079.stdout:4013 trunc from 0xe621be0 to 0xc2e7266 2024-09-11T07:07:16.416 INFO:teuthology.orchestra.run.smithi079.stdout:4015 punch from 0xf33e4b to 0xf36d47, (0x2efc bytes) 2024-09-11T07:07:16.416 INFO:teuthology.orchestra.run.smithi079.stdout:4018 write 0x8741f8f thru 0x874d8ce (0xb940 bytes) 2024-09-11T07:07:16.425 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.425 INFO:teuthology.orchestra.run.smithi079.stdout:4022 punch from 0x20216da to 0x2031261, (0xfb87 bytes) 2024-09-11T07:07:16.425 INFO:teuthology.orchestra.run.smithi079.stdout:4023 read 0x5b644ef thru 0x5b69535 (0x5047 bytes) 2024-09-11T07:07:16.425 INFO:teuthology.orchestra.run.smithi079.stdout:4024 read 0x2f45687 thru 0x2f4b5af (0x5f29 bytes) 2024-09-11T07:07:16.425 INFO:teuthology.orchestra.run.smithi079.stdout:4026 read 0x13d69b5 thru 0x13dbc74 (0x52c0 bytes) 2024-09-11T07:07:16.427 INFO:teuthology.orchestra.run.smithi079.stdout:4027 trunc from 0xc2e7266 to 0xd95a7cb 2024-09-11T07:07:16.442 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.443 INFO:teuthology.orchestra.run.smithi079.stdout:4030 trunc from 0xd95a7cb to 0xd04755f 2024-09-11T07:07:16.457 INFO:teuthology.orchestra.run.smithi079.stdout:4031 read 0xc7800f thru 0xc7d120 (0x5112 bytes) 2024-09-11T07:07:16.458 INFO:teuthology.orchestra.run.smithi079.stdout:4032 write 0xdcb0a thru 0xe08e3 (0x3dda bytes) 2024-09-11T07:07:16.459 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:16.456+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:16.461 INFO:teuthology.orchestra.run.smithi079.stdout:4033 punch from 0x51c0105 to 0x51cc2af, (0xc1aa bytes) 2024-09-11T07:07:16.461 INFO:teuthology.orchestra.run.smithi079.stdout:4034 punch from 0xbec18db to 0xbec75c4, (0x5ce9 bytes) 2024-09-11T07:07:16.461 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.461 INFO:teuthology.orchestra.run.smithi079.stdout:4036 write 0xbc00d03 thru 0xbc09055 (0x8353 bytes) 2024-09-11T07:07:16.469 INFO:teuthology.orchestra.run.smithi079.stdout:4038 write 0xbcbf6b0 thru 0xbcc0048 (0x999 bytes) 2024-09-11T07:07:16.483 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:38225 3.0 e54/21 3:00593585:::rbd_data.11612bf90fc2.0000000000000001:head v 54'264, mlcod=51'262)", 2024-09-11T07:07:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.006440998999999, 2024-09-11T07:07:16.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095742440000000009, 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7800000000000001e-07 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478936+0000", 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032745610000000001 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478959+0000", 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3553e-05 2024-09-11T07:07:16.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478975+0000", 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5678000000000001e-05 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.479055+0000", 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9684000000000005e-05 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.479085+0000", 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9782e-05 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.485183+0000", 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060982140000000002 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.485235+0000", 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2593999999999998e-05 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.487 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:41586 3.4 e58/21 3:278deab4:::rbd_data.11612bd38060.0000000000000000:head v 58'75, mlcod=53'73)", 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.673106212, 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080719699999999995, 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808999+0000", 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2830000000000002e-06 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810913+0000", 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001913402 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810949+0000", 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5954999999999997e-05 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810966+0000", 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7459e-05 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.811079+0000", 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113101 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.811118+0000", 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8937999999999999e-05 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.816962+0000", 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005843488 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.817068+0000", 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106344 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59289 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:head [stat,truncate 11010048] snapc 20=[20] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.466638958000001, 2024-09-11T07:07:16.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024828697, 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59289 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:16.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015467+0000", 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6200000000000001e-06 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015483+0000", 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5962999999999999e-05 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015531+0000", 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7964999999999999e-05 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015554+0000", 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3493e-05 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015723+0000", 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169121 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016035+0000", 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031174000000000002 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016468+0000", 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043272900000000002 2024-09-11T07:07:16.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.039067+0000", 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022598894000000001 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040107+0000", 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010398860000000001 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040212+0000", 2024-09-11T07:07:16.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010577399999999999 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040292+0000", 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9511999999999994e-05 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62059 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.684778830999999, 2024-09-11T07:07:16.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080870200000000003, 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62059 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797324+0000", 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797325+0000", 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.175e-06 2024-09-11T07:07:16.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797328+0000", 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3519999999999998e-06 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797331+0000", 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9359999999999999e-06 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805061+0000", 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0077296919999999998 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805212+0000", 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015180799999999999 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805410+0000", 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019783999999999999 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62084 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.684458969, 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081746579999999996, 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62084 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797644+0000", 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2399999999999996e-07 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797649+0000", 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1410000000000004e-06 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797662+0000", 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3142000000000001e-05 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797671+0000", 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0599999999999997e-06 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805515+0000", 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078431270000000001 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805666+0000", 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015186299999999999 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805818+0000", 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015140100000000001 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62085 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3244032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.684404383, 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086787909999999999, 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62085 2024-09-11T07:07:16.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8800000000000002e-07 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797702+0000", 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4079999999999998e-06 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797714+0000", 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1833e-05 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797721+0000", 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1450000000000002e-06 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805934+0000", 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008213471 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806175+0000", 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024039600000000001 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806377+0000", 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020185 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62086 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3309568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.684361185, 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089940209999999996, 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62086 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1699999999999998e-07 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797745+0000", 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2629999999999999e-06 2024-09-11T07:07:16.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797757+0000", 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2214e-05 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797763+0000", 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.609e-06 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806471+0000", 2024-09-11T07:07:16.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087085700000000005 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806589+0000", 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000117939 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806735+0000", 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000145909 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62087 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3375104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.684318322999999, 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095423460000000002, 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62087 2024-09-11T07:07:16.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.13e-07 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797788+0000", 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.349e-06 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797794+0000", 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4999999999999996e-06 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797800+0000", 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8080000000000001e-06 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806844+0000", 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090440060000000003 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807059+0000", 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021471000000000001 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807326+0000", 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026746000000000002 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62088 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3440640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.684293532, 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0097044639999999995, 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.521 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62088 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5400000000000002e-07 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797812+0000", 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3340000000000002e-06 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797820+0000", 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1980000000000004e-06 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797825+0000", 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1429999999999997e-06 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807392+0000", 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095677420000000006 2024-09-11T07:07:16.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807443+0000", 2024-09-11T07:07:16.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0179999999999997e-05 2024-09-11T07:07:16.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807513+0000", 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0413000000000005e-05 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62089 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3506176~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.684272163999999, 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01023572, 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.528 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62089 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2500000000000001e-07 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797832+0000", 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4950000000000001e-06 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797836+0000", 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9899999999999999e-06 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797845+0000", 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0839999999999998e-06 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807583+0000", 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0097380100000000001 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807802+0000", 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021865599999999999 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808066+0000", 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026415999999999999 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62090 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.684243159999999, 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010367039, 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62090 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4700000000000002e-07 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797861+0000", 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8390000000000001e-06 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797866+0000", 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9150000000000004e-06 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797869+0000", 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1269999999999999e-06 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808092+0000", 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010222788999999999 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808151+0000", 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9456000000000001e-05 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808226+0000", 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4566000000000004e-05 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.536 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62091 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3637248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.684227987, 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010935996, 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.537 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62091 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5199999999999998e-07 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797876+0000", 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.277e-06 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797879+0000", 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6890000000000002e-06 2024-09-11T07:07:16.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797882+0000", 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6240000000000002e-06 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808306+0000", 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010423946999999999 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808440+0000", 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000133993 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808810+0000", 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000370214 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62116 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3194880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.541 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.683548202000001, 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010413343, 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62116 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798556+0000", 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798581+0000", 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4556e-05 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798618+0000", 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7313e-05 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798632+0000", 2024-09-11T07:07:16.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3226e-05 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808844+0000", 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01021238 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808898+0000", 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4534999999999999e-05 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808967+0000", 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8806999999999994e-05 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62117 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3260416~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.683406221, 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010787804999999999, 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62117 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798697+0000", 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3200000000000005e-07 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798700+0000", 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.517e-06 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798708+0000", 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798715+0000", 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9959999999999996e-06 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809045+0000", 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010329896 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809198+0000", 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015303499999999999 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809484+0000", 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000285968 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62118 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3325952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.683373307, 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010897328, 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.550 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62118 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798732+0000", 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0489999999999999e-06 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798740+0000", 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2359999999999998e-06 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798746+0000", 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4980000000000003e-06 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809512+0000", 2024-09-11T07:07:16.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010766133000000001 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809560+0000", 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7927999999999999e-05 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809626+0000", 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6006000000000005e-05 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62119 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3391488~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.683347766000001, 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011339109, 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62119 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798755+0000", 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8100000000000001e-07 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798758+0000", 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5119999999999998e-06 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798781+0000", 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3175000000000001e-05 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798788+0000", 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9240000000000001e-06 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809715+0000", 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010927533 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809902+0000", 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000187111 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810093+0000", 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019097299999999999 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62120 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3457024~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.683302983000001, 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011832135000000001, 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62120 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798800+0000", 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6400000000000002e-07 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798804+0000", 2024-09-11T07:07:16.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0419999999999996e-06 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798813+0000", 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6870000000000006e-06 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798819+0000", 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6810000000000003e-06 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810180+0000", 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011361069999999999 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810372+0000", 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000191456 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810631+0000", 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025963499999999998 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62121 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3522560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.683274803, 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01236723, 2024-09-11T07:07:16.564 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.565 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.565 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.565 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.565 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.565 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.565 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62121 2024-09-11T07:07:16.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.565 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798828+0000", 2024-09-11T07:07:16.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:07:16.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798830+0000", 2024-09-11T07:07:16.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-06 2024-09-11T07:07:16.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798839+0000", 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3019999999999995e-06 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798844+0000", 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2549999999999997e-06 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810713+0000", 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011869151 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810925+0000", 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021164999999999999 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811195+0000", 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026976099999999998 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.569 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62122 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3588096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.683235875999999, 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012886078, 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62122 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798867+0000", 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798870+0000", 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0630000000000002e-06 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798878+0000", 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8669999999999994e-06 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798902+0000", 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4167000000000001e-05 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811275+0000", 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012373454000000001 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811484+0000", 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020880000000000001 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811752+0000", 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026820099999999998 2024-09-11T07:07:16.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62123 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3653632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.683187498000001, 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013329191000000001, 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62123 2024-09-11T07:07:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:16.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6300000000000004e-07 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798918+0000", 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0750000000000002e-06 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798926+0000", 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8839999999999994e-06 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798933+0000", 2024-09-11T07:07:16.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0169999999999999e-06 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811830+0000", 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012896179000000001 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812072+0000", 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024236200000000001 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812244+0000", 2024-09-11T07:07:16.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017191099999999999 2024-09-11T07:07:16.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:16.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:16.578 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:16.579 INFO:teuthology.orchestra.run.smithi079.stdout:4040 write 0xe3fc655 thru 0xe40adc6 (0xe772 bytes) 2024-09-11T07:07:16.580 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:16.581 INFO:teuthology.orchestra.run.smithi079.stdout:4041 read 0x493e056 thru 0x4941684 (0x362f bytes) 2024-09-11T07:07:16.581 INFO:teuthology.orchestra.run.smithi079.stdout:4042 write 0x682a8cb thru 0x683a812 (0xff48 bytes) 2024-09-11T07:07:16.581 INFO:teuthology.orchestra.run.smithi079.stdout:4043 read 0x7c1584a thru 0x7c20ec7 (0xb67e bytes) 2024-09-11T07:07:16.581 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.581 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.581 INFO:teuthology.orchestra.run.smithi079.stdout:4046 writesame 0xe068219 thru 0xe06e052 data_size 0x7(0x5e3a bytes) 2024-09-11T07:07:16.581 INFO:teuthology.orchestra.run.smithi079.stdout:4047 trunc from 0xe40adc7 to 0xd6e2d6e 2024-09-11T07:07:16.581 INFO:teuthology.orchestra.run.smithi079.stdout:4048 trunc from 0xd6e2d6e to 0xb665097 2024-09-11T07:07:16.582 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:16.576+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:16.585 INFO:teuthology.orchestra.run.smithi079.stdout:4049 read 0x903c6fa thru 0x903f110 (0x2a17 bytes) 2024-09-11T07:07:16.585 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.585 INFO:teuthology.orchestra.run.smithi079.stdout:4051 writesame 0x47b2761 thru 0x47bedff data_size 0x11(0xc69f bytes) 2024-09-11T07:07:16.593 INFO:teuthology.orchestra.run.smithi079.stdout:4052 read 0x2c7e811 thru 0x2c817a1 (0x2f91 bytes) 2024-09-11T07:07:16.612 INFO:teuthology.orchestra.run.smithi079.stdout:4053 write 0xcad56f5 thru 0xcadf378 (0x9c84 bytes) 2024-09-11T07:07:16.637 INFO:teuthology.orchestra.run.smithi079.stdout:4056 trunc from 0xcadf379 to 0x33937e8 2024-09-11T07:07:16.648 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:16.691 INFO:teuthology.orchestra.run.smithi079.stdout:4057 write 0xa7138ba thru 0xa71977f (0x5ec6 bytes) 2024-09-11T07:07:16.692 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:16.685+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:16.699 INFO:teuthology.orchestra.run.smithi079.stdout:4059 read 0x2006e65 thru 0x200c19a (0x5336 bytes) 2024-09-11T07:07:16.700 INFO:teuthology.orchestra.run.smithi079.stdout:4060 write 0x12b3cf4 thru 0x12bee31 (0xb13e bytes) 2024-09-11T07:07:16.703 INFO:teuthology.orchestra.run.smithi079.stdout:4063 read 0x7386886 thru 0x7396239 (0xf9b4 bytes) 2024-09-11T07:07:16.703 INFO:teuthology.orchestra.run.smithi079.stdout:4064 read 0x4d3037a thru 0x4d388c8 (0x854f bytes) 2024-09-11T07:07:16.703 INFO:teuthology.orchestra.run.smithi079.stdout:4066 read 0xd8fc56 thru 0xd99b68 (0x9f13 bytes) 2024-09-11T07:07:16.703 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.703 INFO:teuthology.orchestra.run.smithi079.stdout:4069 write 0xa391208 thru 0xa3937d9 (0x25d2 bytes) 2024-09-11T07:07:16.706 INFO:teuthology.orchestra.run.smithi079.stdout:4070 read 0xa1b1f2c thru 0xa1c15e3 (0xf6b8 bytes) 2024-09-11T07:07:16.708 INFO:teuthology.orchestra.run.smithi079.stdout:4071 trunc from 0xa719780 to 0xb7fd897 2024-09-11T07:07:16.720 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:16.720 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:16.720 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:16.720 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:16.721 INFO:teuthology.orchestra.run.smithi079.stdout:4074 read 0x807be86 thru 0x807c957 (0xad2 bytes) 2024-09-11T07:07:16.721 INFO:teuthology.orchestra.run.smithi079.stdout:4075 write 0xa049cf3 thru 0xa051919 (0x7c27 bytes) 2024-09-11T07:07:16.728 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.728 INFO:teuthology.orchestra.run.smithi079.stdout:4078 punch from 0x948744c to 0x9490a9f, (0x9653 bytes) 2024-09-11T07:07:16.728 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.736 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:16.741 INFO:teuthology.orchestra.run.smithi079.stdout:4082 write 0xc3cb0f2 thru 0xc3cb591 (0x4a0 bytes) 2024-09-11T07:07:16.749 INFO:teuthology.orchestra.run.smithi079.stdout:4084 write 0x4d02b9 thru 0x4d6021 (0x5d69 bytes) 2024-09-11T07:07:16.752 INFO:teuthology.orchestra.run.smithi079.stdout:4085 writesame 0x9ee172 thru 0x9f2fb4 data_size 0x1(0x4e43 bytes) 2024-09-11T07:07:16.781 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:16.780+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:16.790 INFO:teuthology.orchestra.run.smithi079.stdout:4086 trunc from 0xc3cb592 to 0x2c931ba 2024-09-11T07:07:16.799 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:16.799 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:16.816 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:16.817 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:16.817 INFO:teuthology.orchestra.run.smithi079.stdout:4090 read 0x180d60a thru 0x1814a63 (0x745a bytes) 2024-09-11T07:07:16.817 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.818 INFO:teuthology.orchestra.run.smithi079.stdout:4092 trunc from 0x2c931ba to 0x1ee0aeb 2024-09-11T07:07:16.836 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:16.837 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:16.841 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:16.841 INFO:teuthology.orchestra.run.smithi079.stdout:4095 read 0x1201193 thru 0x1205a2c (0x489a bytes) 2024-09-11T07:07:16.841 INFO:teuthology.orchestra.run.smithi079.stdout:4096 read 0xdd3c5b thru 0xdd6444 (0x27ea bytes) 2024-09-11T07:07:16.854 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:16.855 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:4097 writesame 0x2cdb2ff thru 0x2ce1770 data_size 0x2e(0x6472 bytes) 2024-09-11T07:07:16.855 INFO:teuthology.orchestra.run.smithi079.stdout:4099 writesame 0x1c9c9fb thru 0x1caaa3b data_size 0x11(0xe041 bytes) 2024-09-11T07:07:16.862 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:16.862 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:16.875 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:16.876 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:16.881 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:16.880+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:16.883 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:16.888 INFO:teuthology.orchestra.run.smithi079.stdout:4100 write 0xa0d21bf thru 0xa0d790f (0x5751 bytes) 2024-09-11T07:07:16.897 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:16.897 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:16.899 INFO:teuthology.orchestra.run.smithi079.stdout:4101 trunc from 0xa0d7910 to 0xcf51f90 2024-09-11T07:07:16.911 INFO:teuthology.orchestra.run.smithi079.stdout:4103 write 0x2e00ba9 thru 0x2e08d6e (0x81c6 bytes) 2024-09-11T07:07:16.919 INFO:teuthology.orchestra.run.smithi079.stdout:4104 trunc from 0xcf51f90 to 0xd058d58 2024-09-11T07:07:16.920 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:16.920 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:16.933 INFO:teuthology.orchestra.run.smithi079.stdout:4106 write 0xcf79220 thru 0xcf88f55 (0xfd36 bytes) 2024-09-11T07:07:16.943 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:16.943 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:16.945 INFO:teuthology.orchestra.run.smithi079.stdout:4107 read 0x702c10b thru 0x7037cb8 (0xbbae bytes) 2024-09-11T07:07:16.945 INFO:teuthology.orchestra.run.smithi079.stdout:4108 read 0x1569fc9 thru 0x15726d1 (0x8709 bytes) 2024-09-11T07:07:16.945 INFO:teuthology.orchestra.run.smithi079.stdout:4109 read 0x72a47ab thru 0x72b39f3 (0xf249 bytes) 2024-09-11T07:07:16.945 INFO:teuthology.orchestra.run.smithi079.stdout:4110 read 0x476b417 thru 0x4771c75 (0x685f bytes) 2024-09-11T07:07:16.945 INFO:teuthology.orchestra.run.smithi079.stdout:4111 writesame 0x977a289 thru 0x9784643 data_size 0x5(0xa3bb bytes) 2024-09-11T07:07:16.953 INFO:teuthology.orchestra.run.smithi079.stdout:4113 writesame 0x18f2c31 thru 0x18ff168 data_size 0x4(0xc538 bytes) 2024-09-11T07:07:16.969 INFO:teuthology.orchestra.run.smithi079.stdout:4114 trunc from 0xd058d58 to 0x9577b18 2024-09-11T07:07:16.982 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:16.980+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:16.997 INFO:teuthology.orchestra.run.smithi079.stdout:4115 writesame 0x6fad065 thru 0x6fb4fab data_size 0x1(0x7f47 bytes) 2024-09-11T07:07:17.017 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:17.017 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:17.021 INFO:teuthology.orchestra.run.smithi079.stdout:4116 punch from 0x3c4152 to 0x3c7c60, (0x3b0e bytes) 2024-09-11T07:07:17.021 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:17.033 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:4118 writesame 0xa8ac342 thru 0xa8afa2f data_size 0x4f(0x36ee bytes) 2024-09-11T07:07:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:4119 punch from 0x25e1172 to 0x25eeb2f, (0xd9bd bytes) 2024-09-11T07:07:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:4120 punch from 0x4c2c438 to 0x4c303f7, (0x3fbf bytes) 2024-09-11T07:07:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:17.040 INFO:teuthology.orchestra.run.smithi079.stdout:4125 write 0x4b74c8a thru 0x4b782b8 (0x362f bytes) 2024-09-11T07:07:17.052 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.4 primary-affinity to 0 (802) 2024-09-11T07:07:17.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:07:17.084 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:17.084+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:17.165 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:17.165 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:17.179 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:17.220 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:17.220+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:17.285 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:17.284+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:17.337 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:17.337 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:17.351 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:17.392 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:17.392+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:17.487 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:17.481+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:17.515 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:17.515 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:17.529 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:17.588 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:17.588+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:17.651 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:17.651 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:17.665 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:17.689 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:17.685+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:17.790 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:17.788+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:17.833 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:17.833 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:17.848 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:17.890 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:17.889+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:17.991 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:17.988+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:18.018 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:18.018 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:18.032 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:18.055 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:07:18.065 INFO:teuthology.orchestra.run.smithi079.stdout:4126 writesame 0xbbc403f thru 0xbbcfbc5 data_size 0x1(0xbb87 bytes) 2024-09-11T07:07:18.065 INFO:teuthology.orchestra.run.smithi079.stdout:4127 read 0x17cf7e5 thru 0x17d3bb2 (0x43ce bytes) 2024-09-11T07:07:18.066 INFO:teuthology.orchestra.run.smithi079.stdout:4128 read 0x79e1e thru 0x82121 (0x8304 bytes) 2024-09-11T07:07:18.067 INFO:teuthology.orchestra.run.smithi079.stdout:4129 write 0xb6494a2 thru 0xb64d6da (0x4239 bytes) 2024-09-11T07:07:18.073 INFO:teuthology.orchestra.run.smithi079.stdout:4132 read 0x51cbf7b thru 0x51d5f74 (0x9ffa bytes) 2024-09-11T07:07:18.073 INFO:teuthology.orchestra.run.smithi079.stdout:4133 read 0x3484906 thru 0x34861bb (0x18b6 bytes) 2024-09-11T07:07:18.073 INFO:teuthology.orchestra.run.smithi079.stdout:4134 read 0x4d5ffe6 thru 0x4d681df (0x81fa bytes) 2024-09-11T07:07:18.073 INFO:teuthology.orchestra.run.smithi079.stdout:4135 writesame 0x607f92a thru 0x60830f7 data_size 0x3(0x37ce bytes) 2024-09-11T07:07:18.082 INFO:teuthology.orchestra.run.smithi079.stdout:4136 writesame 0x60d95f2 thru 0x60e5606 data_size 0x25(0xc015 bytes) 2024-09-11T07:07:18.089 INFO:teuthology.orchestra.run.smithi079.stdout:4138 write 0xb9bc493 thru 0xb9c885b (0xc3c9 bytes) 2024-09-11T07:07:18.096 INFO:teuthology.orchestra.run.smithi079.stdout:4139 writesame 0xa07e3b3 thru 0xa080328 data_size 0x1(0x1f76 bytes) 2024-09-11T07:07:18.107 INFO:teuthology.orchestra.run.smithi079.stdout:4140 write 0x7c674f6 thru 0x7c7719f (0xfcaa bytes) 2024-09-11T07:07:18.112 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:18.112 INFO:teuthology.orchestra.run.smithi079.stdout:4142 read 0x7b5edf7 thru 0x7b6291a (0x3b24 bytes) 2024-09-11T07:07:18.112 INFO:teuthology.orchestra.run.smithi079.stdout:4143 write 0x8517ec7 thru 0x8525c1b (0xdd55 bytes) 2024-09-11T07:07:18.118 INFO:teuthology.orchestra.run.smithi079.stdout:4144 read 0x3b28b9a thru 0x3b2e8dd (0x5d44 bytes) 2024-09-11T07:07:18.118 INFO:teuthology.orchestra.run.smithi079.stdout:4145 punch from 0xb2e7b4a to 0xb2f4536, (0xc9ec bytes) 2024-09-11T07:07:18.118 INFO:teuthology.orchestra.run.smithi079.stdout:4146 read 0x9a17d96 thru 0x9a20da7 (0x9012 bytes) 2024-09-11T07:07:18.118 INFO:teuthology.orchestra.run.smithi079.stdout:4147 writesame 0x56e6f50 thru 0x56ec2a6 data_size 0x11(0x5357 bytes) 2024-09-11T07:07:18.120 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:18.120+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:18.124 INFO:teuthology.orchestra.run.smithi079.stdout:4149 read 0x616997d thru 0x616ffb0 (0x6634 bytes) 2024-09-11T07:07:18.125 INFO:teuthology.orchestra.run.smithi079.stdout:4150 read 0x873eb84 thru 0x874ac43 (0xc0c0 bytes) 2024-09-11T07:07:18.125 INFO:teuthology.orchestra.run.smithi079.stdout:4151 write 0x9f0d4a5 thru 0x9f16886 (0x93e2 bytes) 2024-09-11T07:07:18.132 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:18.141 INFO:teuthology.orchestra.run.smithi079.stdout:4154 trunc from 0xbbcfbc6 to 0x86468df 2024-09-11T07:07:18.170 INFO:teuthology.orchestra.run.smithi079.stdout:4155 write 0x8238e01 thru 0x8244727 (0xb927 bytes) 2024-09-11T07:07:18.180 INFO:teuthology.orchestra.run.smithi079.stdout:4157 read 0x53a40ae thru 0x53b06a7 (0xc5fa bytes) 2024-09-11T07:07:18.193 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:18.192+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:18.201 INFO:teuthology.orchestra.run.smithi079.stdout:4160 write 0xabd43f9 thru 0xabd5b11 (0x1719 bytes) 2024-09-11T07:07:18.208 INFO:teuthology.orchestra.run.smithi079.stdout:4161 writesame 0x85ffc85 thru 0x86040ca data_size 0x9(0x4446 bytes) 2024-09-11T07:07:18.209 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:18.209 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:18.216 INFO:teuthology.orchestra.run.smithi079.stdout:4162 read 0x5bed039 thru 0x5bf5748 (0x8710 bytes) 2024-09-11T07:07:18.224 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:18.226 INFO:teuthology.orchestra.run.smithi079.stdout:4163 trunc from 0xabd5b12 to 0x749178c 2024-09-11T07:07:18.252 INFO:teuthology.orchestra.run.smithi079.stdout:4164 write 0x3e1ebae thru 0x3e213cb (0x281e bytes) 2024-09-11T07:07:18.258 INFO:teuthology.orchestra.run.smithi079.stdout:4165 punch from 0x2b3bcc4 to 0x2b47fa0, (0xc2dc bytes) 2024-09-11T07:07:18.259 INFO:teuthology.orchestra.run.smithi079.stdout:4166 punch from 0x3ed33c1 to 0x3ee01f3, (0xce32 bytes) 2024-09-11T07:07:18.290 INFO:teuthology.orchestra.run.smithi079.stdout:4167 writesame 0xe9a31e0 thru 0xe9af70c data_size 0x1(0xc52d bytes) 2024-09-11T07:07:18.291 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:18.291 INFO:teuthology.orchestra.run.smithi079.stdout:4170 read 0xd9087a0 thru 0xd90dbce (0x542f bytes) 2024-09-11T07:07:18.291 INFO:teuthology.orchestra.run.smithi079.stdout:4171 read 0x3cb30b4 thru 0x3cc1b72 (0xeabf bytes) 2024-09-11T07:07:18.291 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:18.291 INFO:teuthology.orchestra.run.smithi079.stdout:4177 writesame 0x367cce8 thru 0x3684c64 data_size 0x45(0x7f7d bytes) 2024-09-11T07:07:18.293 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:18.289+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:18.317 INFO:teuthology.orchestra.run.smithi079.stdout:4178 trunc from 0xe9af70d to 0x7134dca 2024-09-11T07:07:18.332 INFO:teuthology.orchestra.run.smithi079.stdout:4179 write 0xe830ab thru 0xe8cfcb (0x9f21 bytes) 2024-09-11T07:07:18.339 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:18.339 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:18.352 INFO:teuthology.orchestra.run.smithi079.stdout:4182 write 0x7803900 thru 0x7810e6f (0xd570 bytes) 2024-09-11T07:07:18.359 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:18.360 INFO:teuthology.orchestra.run.smithi079.stdout:4186 writesame 0x56c4bfc thru 0x56d11f6 data_size 0x1(0xc5fb bytes) 2024-09-11T07:07:18.395 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:18.389+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:18.406 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:18.406 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:18.410 INFO:teuthology.orchestra.run.smithi079.stdout:4187 read 0x46366d8 thru 0x4638da4 (0x26cd bytes) 2024-09-11T07:07:18.411 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:18.412 INFO:teuthology.orchestra.run.smithi079.stdout:4190 punch from 0x4821c2a to 0x4824bab, (0x2f81 bytes) 2024-09-11T07:07:18.412 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:18.412 INFO:teuthology.orchestra.run.smithi079.stdout:4192 read 0x742c8c6 thru 0x7432797 (0x5ed2 bytes) 2024-09-11T07:07:18.412 INFO:teuthology.orchestra.run.smithi079.stdout:4196 punch from 0x76f1451 to 0x76fa773, (0x9322 bytes) 2024-09-11T07:07:18.412 INFO:teuthology.orchestra.run.smithi079.stdout:4197 read 0x26309bd thru 0x2630dcf (0x413 bytes) 2024-09-11T07:07:18.421 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:18.436 INFO:teuthology.orchestra.run.smithi079.stdout:4198 write 0xba24a8c thru 0xba28b05 (0x407a bytes) 2024-09-11T07:07:18.442 INFO:teuthology.orchestra.run.smithi079.stdout:4199 punch from 0x3d6e9f4 to 0x3d72ea3, (0x44af bytes) 2024-09-11T07:07:18.443 INFO:teuthology.orchestra.run.smithi079.stdout:4201 write 0x3fec89f thru 0x3ff5c60 (0x93c2 bytes) 2024-09-11T07:07:18.446 INFO:teuthology.orchestra.run.smithi079.stdout:4202 writesame 0x8a02557 thru 0x8a0a143 data_size 0x4b(0x7bed bytes) 2024-09-11T07:07:18.466 INFO:teuthology.orchestra.run.smithi079.stdout:4204 writesame 0xce8f5d6 thru 0xce9e39e data_size 0x67(0xedc9 bytes) 2024-09-11T07:07:18.466 INFO:teuthology.orchestra.run.smithi079.stdout:4206 writesame 0x1a58bd9 thru 0x1a5b088 data_size 0x8(0x24b0 bytes) 2024-09-11T07:07:18.472 INFO:teuthology.orchestra.run.smithi079.stdout:4207 read 0x92af7b8 thru 0x92bea95 (0xf2de bytes) 2024-09-11T07:07:18.476 INFO:teuthology.orchestra.run.smithi079.stdout:4208 trunc from 0xce9e39f to 0xe36fbbf 2024-09-11T07:07:18.486 INFO:teuthology.orchestra.run.smithi079.stdout:4209 punch from 0xcb09854 to 0xcb10b3d, (0x72e9 bytes) 2024-09-11T07:07:18.486 INFO:teuthology.orchestra.run.smithi079.stdout:4211 write 0x367f2c6 thru 0x368e93c (0xf677 bytes) 2024-09-11T07:07:18.490 INFO:teuthology.orchestra.run.smithi079.stdout:4213 write 0xd4b4e0a thru 0xd4c189e (0xca95 bytes) 2024-09-11T07:07:18.495 INFO:teuthology.orchestra.run.smithi079.stdout:4214 write 0x827a978 thru 0x82824d0 (0x7b59 bytes) 2024-09-11T07:07:18.495 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:18.489+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:18.502 INFO:teuthology.orchestra.run.smithi079.stdout:4217 write 0xc3e2b8f thru 0xc3ed676 (0xaae8 bytes) 2024-09-11T07:07:18.507 INFO:teuthology.orchestra.run.smithi079.stdout:4218 write 0x86efff3 thru 0x86fecbd (0xeccb bytes) 2024-09-11T07:07:18.511 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:18.511 INFO:teuthology.orchestra.run.smithi079.stdout:4222 writesame 0x76b935f thru 0x76bc01b data_size 0x1(0x2cbd bytes) 2024-09-11T07:07:18.528 INFO:teuthology.orchestra.run.smithi079.stdout:4223 write 0x1b9cc81 thru 0x1b9cfb8 (0x338 bytes) 2024-09-11T07:07:18.535 INFO:teuthology.orchestra.run.smithi079.stdout:4224 read 0x24961bc thru 0x2498510 (0x2355 bytes) 2024-09-11T07:07:18.535 INFO:teuthology.orchestra.run.smithi079.stdout:4227 writesame 0x44c92a2 thru 0x44d5517 data_size 0x3(0xc276 bytes) 2024-09-11T07:07:18.554 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:18.555 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:18.556 INFO:teuthology.orchestra.run.smithi079.stdout:4228 read 0x65f8b59 thru 0x65fbcdf (0x3187 bytes) 2024-09-11T07:07:18.556 INFO:teuthology.orchestra.run.smithi079.stdout:4231 writesame 0x49074f8 thru 0x4909375 data_size 0x3(0x1e7e bytes) 2024-09-11T07:07:18.565 INFO:teuthology.orchestra.run.smithi079.stdout:4232 read 0x5bae5f thru 0x5bb059 (0x1fb bytes) 2024-09-11T07:07:18.566 INFO:teuthology.orchestra.run.smithi079.stdout:4235 read 0xdda2674 thru 0xddaabe6 (0x8573 bytes) 2024-09-11T07:07:18.568 INFO:teuthology.orchestra.run.smithi079.stdout:4236 read 0x3d49252 thru 0x3d5689d (0xd64c bytes) 2024-09-11T07:07:18.568 INFO:teuthology.orchestra.run.smithi079.stdout:4237 writesame 0x9ec1cf1 thru 0x9ec1f91 data_size 0x1(0x2a1 bytes) 2024-09-11T07:07:18.570 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:18.572 INFO:teuthology.orchestra.run.smithi079.stdout:4238 read 0xddb1d3a thru 0xddbc258 (0xa51f bytes) 2024-09-11T07:07:18.573 INFO:teuthology.orchestra.run.smithi079.stdout:4239 write 0x4f285b4 thru 0x4f2ae5c (0x28a9 bytes) 2024-09-11T07:07:18.580 INFO:teuthology.orchestra.run.smithi079.stdout:4240 clone 36 order 25 su 2097152 sc 2 2024-09-11T07:07:18.616 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:18.616+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:18.687 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:18.687 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:18.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:18.693+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:18.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:18.798 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:18.793+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:18.869 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:18.870 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:18.883 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:18.929 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:18.928+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:18.972 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:19.005 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:19.006 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:19.020 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:19.021 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:19.017+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:19.100 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:19.097+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:19.123 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:19.123 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:19.140 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:19.141 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:19.152 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:19.153 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:19.153 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:19.158 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:19.158 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:19.171 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:19.180 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:19.181 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:19.201 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:19.200+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:19.214 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:19.214 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:19.235 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:19.235 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:19.256 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:19.256 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:19.277 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:19.277 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:19.301 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:19.301 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:19.301 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:19.302 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:19.297+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:19.319 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:19.364 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #34, image image_client.0-clone34 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent35 2024-09-11T07:07:19.383 INFO:teuthology.orchestra.run.smithi079.stdout:4241 trunc from 0xe36fbbf to 0x37d59e4 2024-09-11T07:07:19.403 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:19.397+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:19.419 INFO:teuthology.orchestra.run.smithi079.stdout:4242 punch from 0x20bb51a to 0x20c0212, (0x4cf8 bytes) 2024-09-11T07:07:19.419 INFO:teuthology.orchestra.run.smithi079.stdout:4243 read 0x1c52044 thru 0x1c5764a (0x5607 bytes) 2024-09-11T07:07:19.420 INFO:teuthology.orchestra.run.smithi079.stdout:4244 read 0xc89392 thru 0xc8f46b (0x60da bytes) 2024-09-11T07:07:19.420 INFO:teuthology.orchestra.run.smithi079.stdout:4245 read 0x1cf4d46 thru 0x1cf800d (0x32c8 bytes) 2024-09-11T07:07:19.432 INFO:teuthology.orchestra.run.smithi079.stdout:4247 trunc from 0x37d59e4 to 0xb15449a 2024-09-11T07:07:19.439 INFO:teuthology.orchestra.run.smithi079.stdout:4248 writesame 0x64be015 thru 0x64cdd7b data_size 0x1(0xfd67 bytes) 2024-09-11T07:07:19.481 INFO:teuthology.orchestra.run.smithi079.stdout:4250 write 0x2aa92ad thru 0x2ab1084 (0x7dd8 bytes) 2024-09-11T07:07:19.491 INFO:teuthology.orchestra.run.smithi079.stdout:4251 trunc from 0xb15449a to 0xe382c06 2024-09-11T07:07:19.500 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.828738044000005, 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.501 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:19.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:07:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:07:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:07:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:07:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:07:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:07:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:07:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:07:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.828725903999995, 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.506 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.510 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.828074952999998, 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.511 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:07:19.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.828018056999994, 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:19.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.827991022999996, 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:07:19.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.525 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.825447161, 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:07:19.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.825425053000004, 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:07:19.530 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:19.535 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.825405438000004, 2024-09-11T07:07:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:07:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:07:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.536 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.825382532999996, 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.541 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:07:19.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:07:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:07:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:07:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:07:19.545 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.825003772000002, 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.546 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:19.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:07:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:07:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:07:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:07:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:07:19.550 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.824972270000004, 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.551 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:07:19.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:07:19.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:07:19.555 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.824454994999996, 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.556 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:07:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:19.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:07:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:07:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.561 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.824430866, 2024-09-11T07:07:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:07:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.562 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:07:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:07:19.566 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.824417539999999, 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.567 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:07:19.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:19.571 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.823997611999999, 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:07:19.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:07:19.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.823970203000002, 2024-09-11T07:07:19.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:07:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:07:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:07:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.823191199000007, 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.581 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:07:19.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.585 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 68.818091070999998, 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.586 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:19.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:07:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:07:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:07:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:07:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:07:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:07:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:07:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:07:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:07:19.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:07:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:07:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:07:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:07:19.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.060213738000002, 2024-09-11T07:07:19.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:07:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:07:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.595 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:07:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:07:19.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:07:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:07:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:07:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:07:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:07:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:07:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:07:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:07:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:07:19.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:07:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:07:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:07:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:07:19.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.060039924999998, 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:07:19.605 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:19.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:07:19.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:07:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:07:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.613 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:19.615 INFO:teuthology.orchestra.run.smithi079.stdout:4252 punch from 0x38526bf to 0x385a3b5, (0x7cf6 bytes) 2024-09-11T07:07:19.615 INFO:teuthology.orchestra.run.smithi079.stdout:4253 punch from 0x9382a83 to 0x938b48a, (0x8a07 bytes) 2024-09-11T07:07:19.615 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:19.615 INFO:teuthology.orchestra.run.smithi079.stdout:4257 punch from 0x66178a9 to 0x66200ad, (0x8804 bytes) 2024-09-11T07:07:19.615 INFO:teuthology.orchestra.run.smithi079.stdout:4258 writesame 0x8e9f5d2 thru 0x8ea8288 data_size 0x11(0x8cb7 bytes) 2024-09-11T07:07:19.615 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:19.615 INFO:teuthology.orchestra.run.smithi079.stdout:4260 write 0x5cedda4 thru 0x5cfb922 (0xdb7f bytes) 2024-09-11T07:07:19.616 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:19.617 INFO:teuthology.orchestra.run.smithi079.stdout:4261 trunc from 0xe382c06 to 0x6751d0b 2024-09-11T07:07:19.617 INFO:teuthology.orchestra.run.smithi079.stdout:4262 write 0xd61f162 thru 0xd61f47b (0x31a bytes) 2024-09-11T07:07:19.617 INFO:teuthology.orchestra.run.smithi079.stdout:4264 read 0xa34536a thru 0xa34cfba (0x7c51 bytes) 2024-09-11T07:07:19.617 INFO:teuthology.orchestra.run.smithi079.stdout:4265 trunc from 0xd61f47c to 0x11c348c 2024-09-11T07:07:19.618 INFO:teuthology.orchestra.run.smithi079.stdout:4266 punch from 0x6e3e6a to 0x6e84f4, (0x468a bytes) 2024-09-11T07:07:19.618 INFO:teuthology.orchestra.run.smithi079.stdout:4267 trunc from 0x11c348c to 0x133a86c 2024-09-11T07:07:19.618 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:19.612+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:19.649 INFO:teuthology.orchestra.run.smithi079.stdout:4268 write 0x8608204 thru 0x860b4f5 (0x32f2 bytes) 2024-09-11T07:07:19.656 INFO:teuthology.orchestra.run.smithi079.stdout:4269 trunc from 0x860b4f6 to 0x82d1a37 2024-09-11T07:07:19.670 INFO:teuthology.orchestra.run.smithi079.stdout:4270 write 0xf76843 thru 0xf7dcd6 (0x7494 bytes) 2024-09-11T07:07:19.674 INFO:teuthology.orchestra.run.smithi079.stdout:4272 read 0x50c477c thru 0x50cf85e (0xb0e3 bytes) 2024-09-11T07:07:19.674 INFO:teuthology.orchestra.run.smithi079.stdout:4273 read 0x7fe3b96 thru 0x7fea843 (0x6cae bytes) 2024-09-11T07:07:19.674 INFO:teuthology.orchestra.run.smithi079.stdout:4274 read 0x2deb1be thru 0x2df650e (0xb351 bytes) 2024-09-11T07:07:19.674 INFO:teuthology.orchestra.run.smithi079.stdout:4275 write 0x1480712 thru 0x148be65 (0xb754 bytes) 2024-09-11T07:07:19.695 INFO:teuthology.orchestra.run.smithi079.stdout:4276 write 0xb7038f1 thru 0xb7083a6 (0x4ab6 bytes) 2024-09-11T07:07:19.698 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:19.698 INFO:teuthology.orchestra.run.smithi079.stdout:4278 writesame 0x2fe82c1 thru 0x2ff4f54 data_size 0x2(0xcc94 bytes) 2024-09-11T07:07:19.715 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:19.709+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:19.732 INFO:teuthology.orchestra.run.smithi079.stdout:4279 punch from 0x44fc88b to 0x4501ee5, (0x565a bytes) 2024-09-11T07:07:19.732 INFO:teuthology.orchestra.run.smithi079.stdout:4280 read 0x3df2ba9 thru 0x3df4cdb (0x2133 bytes) 2024-09-11T07:07:19.733 INFO:teuthology.orchestra.run.smithi079.stdout:4281 write 0x9bf814e thru 0x9bffce6 (0x7b99 bytes) 2024-09-11T07:07:19.736 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:19.736 INFO:teuthology.orchestra.run.smithi079.stdout:4283 write 0x643b6e5 thru 0x644063e (0x4f5a bytes) 2024-09-11T07:07:19.764 INFO:teuthology.orchestra.run.smithi079.stdout:4284 trunc from 0xb7083a7 to 0xef428b 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71745 3.6 3:6461e58c:::rbd_header.1161b94a6d64:head [call rbd.parent_get in=13b,call rbd.parent_overlap_get in=29b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.789279+0000", 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00026149099999999998, 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00030874, 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:19.789 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71745 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.789279+0000", 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.789279+0000", 2024-09-11T07:07:19.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.789295+0000", 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6206e-05 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.789320+0000", 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4516999999999999e-05 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.789338+0000", 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8349e-05 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.789348+0000", 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8300000000000008e-06 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.789425+0000", 2024-09-11T07:07:19.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6785000000000004e-05 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.789544+0000", 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119397 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 1 2024-09-11T07:07:19.793 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:19.794 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:19.807 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:19.808 INFO:teuthology.orchestra.run.smithi079.stdout:4288 writesame 0x3be4f12 thru 0x3beb6fc data_size 0x1(0x67eb bytes) 2024-09-11T07:07:19.835 INFO:teuthology.orchestra.run.smithi079.stdout:4289 write 0xd9cde30 thru 0xd9d71d5 (0x93a6 bytes) 2024-09-11T07:07:19.835 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:19.829+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:19.841 INFO:teuthology.orchestra.run.smithi079.stdout:4290 writesame 0x927121b thru 0x927a004 data_size 0x46(0x8dea bytes) 2024-09-11T07:07:19.846 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:19.846 INFO:teuthology.orchestra.run.smithi079.stdout:4292 punch from 0x92cb3e4 to 0x92cdba3, (0x27bf bytes) 2024-09-11T07:07:19.846 INFO:teuthology.orchestra.run.smithi079.stdout:4293 read 0x3fc0671 thru 0x3fc278b (0x211b bytes) 2024-09-11T07:07:19.847 INFO:teuthology.orchestra.run.smithi079.stdout:4295 write 0x55a11f1 thru 0x55a26d9 (0x14e9 bytes) 2024-09-11T07:07:19.851 INFO:teuthology.orchestra.run.smithi079.stdout:4296 trunc from 0xd9d71d6 to 0xd5c716d 2024-09-11T07:07:19.861 INFO:teuthology.orchestra.run.smithi079.stdout:4297 write 0x2a70c69 thru 0x2a7a718 (0x9ab0 bytes) 2024-09-11T07:07:19.865 INFO:teuthology.orchestra.run.smithi079.stdout:4298 read 0x9d0e049 thru 0x9d12233 (0x41eb bytes) 2024-09-11T07:07:19.865 INFO:teuthology.orchestra.run.smithi079.stdout:4299 write 0xbeca26 thru 0xbf9c8c (0xd267 bytes) 2024-09-11T07:07:19.883 INFO:teuthology.orchestra.run.smithi079.stdout:4301 trunc from 0xd5c716d to 0x525eb3f 2024-09-11T07:07:19.916 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:19.913+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:19.921 INFO:teuthology.orchestra.run.smithi079.stdout:4302 writesame 0xe8512c4 thru 0xe859743 data_size 0x50(0x8480 bytes) 2024-09-11T07:07:19.935 INFO:teuthology.orchestra.run.smithi079.stdout:4304 trunc from 0xe859744 to 0x5277555 2024-09-11T07:07:19.945 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:19.956 INFO:teuthology.orchestra.run.smithi079.stdout:4307 writesame 0x7833a35 thru 0x78396e8 data_size 0x22(0x5cb4 bytes) 2024-09-11T07:07:19.958 INFO:teuthology.orchestra.run.smithi079.stdout:4308 punch from 0x31d6d70 to 0x31d854d, (0x17dd bytes) 2024-09-11T07:07:19.958 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:19.958 INFO:teuthology.orchestra.run.smithi079.stdout:4310 punch from 0x483958b to 0x48417b7, (0x822c bytes) 2024-09-11T07:07:19.958 INFO:teuthology.orchestra.run.smithi079.stdout:4312 read 0x5a794c5 thru 0x5a80570 (0x70ac bytes) 2024-09-11T07:07:19.958 INFO:teuthology.orchestra.run.smithi079.stdout:4314 punch from 0x26a48de to 0x26adaba, (0x91dc bytes) 2024-09-11T07:07:19.958 INFO:teuthology.orchestra.run.smithi079.stdout:4316 read 0x2b77c8d thru 0x2b7f625 (0x7999 bytes) 2024-09-11T07:07:19.959 INFO:teuthology.orchestra.run.smithi079.stdout:4318 punch from 0x3244dcb to 0x3247785, (0x29ba bytes) 2024-09-11T07:07:19.972 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:19.972 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:19.973 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:19.973 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:19.978 INFO:teuthology.orchestra.run.smithi079.stdout:4320 write 0xed560bd thru 0xed57318 (0x125c bytes) 2024-09-11T07:07:19.985 INFO:teuthology.orchestra.run.smithi079.stdout:4321 punch from 0x34b5c40 to 0x34c1bdf, (0xbf9f bytes) 2024-09-11T07:07:19.985 INFO:teuthology.orchestra.run.smithi079.stdout:4322 read 0x717af5 thru 0x726d75 (0xf281 bytes) 2024-09-11T07:07:19.986 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:19.988 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:19.992 INFO:teuthology.orchestra.run.smithi079.stdout:4325 trunc from 0xed57319 to 0xbb0b041 2024-09-11T07:07:20.018 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:20.016+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:20.020 INFO:teuthology.orchestra.run.smithi079.stdout:4326 trunc from 0xbb0b041 to 0x2c67e25 2024-09-11T07:07:20.038 INFO:teuthology.orchestra.run.smithi079.stdout:4328 read 0x113dc7c thru 0x113f6bf (0x1a44 bytes) 2024-09-11T07:07:20.039 INFO:teuthology.orchestra.run.smithi079.stdout:4329 read 0x24faf0b thru 0x24fba4d (0xb43 bytes) 2024-09-11T07:07:20.039 INFO:teuthology.orchestra.run.smithi079.stdout:4330 read 0x1cbfb5b thru 0x1cc17fd (0x1ca3 bytes) 2024-09-11T07:07:20.040 INFO:teuthology.orchestra.run.smithi079.stdout:4332 writesame 0x6cec34 thru 0x6dda5f data_size 0x6(0xee2c bytes) 2024-09-11T07:07:20.054 INFO:teuthology.orchestra.run.smithi079.stdout:4333 punch from 0xa19e64 to 0xa1c535, (0x26d1 bytes) 2024-09-11T07:07:20.054 INFO:teuthology.orchestra.run.smithi079.stdout:4334 punch from 0x485c0b to 0x49523d, (0xf632 bytes) 2024-09-11T07:07:20.062 INFO:teuthology.orchestra.run.smithi079.stdout:4335 write 0x39988fb thru 0x399fac6 (0x71cc bytes) 2024-09-11T07:07:20.077 INFO:teuthology.orchestra.run.smithi079.stdout:4336 write 0x5c17580 thru 0x5c23310 (0xbd91 bytes) 2024-09-11T07:07:20.086 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:07:20.093 INFO:teuthology.orchestra.run.smithi079.stdout:4337 trunc from 0x5c23311 to 0xd2e76c4 2024-09-11T07:07:20.116 INFO:teuthology.orchestra.run.smithi079.stdout:4338 trunc from 0xd2e76c4 to 0x28d7392 2024-09-11T07:07:20.118 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:20.116+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:20.142 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:20.142 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:20.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:20.142 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:20.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.142 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46274 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5447680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.809363622999999, 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042635002999999998, 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46274 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9800000000000004e-07 2024-09-11T07:07:20.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331645+0000", 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331652+0000", 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4159999999999998e-06 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331659+0000", 2024-09-11T07:07:20.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2710000000000003e-06 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374165+0000", 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042505493999999998 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374214+0000", 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8826999999999999e-05 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374277+0000", 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3145000000000006e-05 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46275 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5496832~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.809338660999998, 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042748189999999998, 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.147 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46275 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:20.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331669+0000", 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2900000000000001e-06 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331686+0000", 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6767999999999999e-05 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331693+0000", 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6599999999999998e-06 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374308+0000", 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042614919000000001 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374355+0000", 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7166000000000002e-05 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374415+0000", 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9893999999999999e-05 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46276 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5545984~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.151 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.809304234999999, 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042856001999999997, 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46276 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331702+0000", 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331704+0000", 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5629999999999999e-06 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331712+0000", 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9340000000000006e-06 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331720+0000", 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1049999999999995e-06 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374445+0000", 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042724597000000003 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374494+0000", 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9234999999999999e-05 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374557+0000", 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3058000000000005e-05 2024-09-11T07:07:20.155 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46277 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5595136~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.809253890000001, 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042946033000000002, 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.156 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46277 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331752+0000", 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2500000000000005e-07 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331755+0000", 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7e-06 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331763+0000", 2024-09-11T07:07:20.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331777+0000", 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3749e-05 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374591+0000", 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042813898000000003 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374637+0000", 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6492000000000001e-05 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374697+0000", 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0222e-05 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46278 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5644288~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.160 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.809219210999998, 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043078449999999997, 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46278 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331787+0000", 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9299999999999997e-07 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331789+0000", 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331797+0000", 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331804+0000", 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3010000000000001e-06 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374743+0000", 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042938538999999998 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374800+0000", 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6637e-05 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374865+0000", 2024-09-11T07:07:20.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4906999999999994e-05 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46279 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5693440~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.809193324999999, 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043192304000000001, 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.165 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46279 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1500000000000005e-07 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331815+0000", 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4080000000000001e-06 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331822+0000", 2024-09-11T07:07:20.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3359999999999997e-06 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331831+0000", 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4530000000000002e-06 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374897+0000", 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043066213999999998 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374944+0000", 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7292000000000001e-05 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375004+0000", 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0086e-05 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46280 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5742592~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.169 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.809163197, 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043330417000000003, 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46280 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331843+0000", 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331848+0000", 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5570000000000003e-06 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331857+0000", 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6689999999999995e-06 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331863+0000", 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0610000000000001e-06 2024-09-11T07:07:20.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375049+0000", 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043186443999999997 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375104+0000", 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4821999999999998e-05 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375172+0000", 2024-09-11T07:07:20.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8371e-05 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46281 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5791744~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.809134934999999, 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043441781999999998, 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.174 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46281 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331871+0000", 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9900000000000001e-07 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331873+0000", 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.458e-06 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331885+0000", 2024-09-11T07:07:20.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1919999999999999e-05 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331891+0000", 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0950000000000001e-06 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375205+0000", 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043314084000000003 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375253+0000", 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8047000000000003e-05 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375312+0000", 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8678999999999998e-05 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46282 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5840896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:20.178 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.809057821, 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043532266999999999, 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46282 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:20.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331948+0000", 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7199999999999997e-07 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331952+0000", 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4479999999999999e-06 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331962+0000", 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7389999999999994e-06 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331968+0000", 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6789999999999999e-06 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375357+0000", 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043388559 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375413+0000", 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5971999999999999e-05 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375480+0000", 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6997999999999998e-05 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.182 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46283 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5890048~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.809022881000001, 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043635858999999999, 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46283 2024-09-11T07:07:20.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331983+0000", 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3799999999999997e-07 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331985+0000", 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4990000000000001e-06 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331993+0000", 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9629999999999998e-06 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332003+0000", 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8199999999999992e-06 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375512+0000", 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043508865000000001 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375560+0000", 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8004999999999999e-05 2024-09-11T07:07:20.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375618+0000", 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8168999999999998e-05 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46284 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5939200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.808994494, 2024-09-11T07:07:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043772483000000001, 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46284 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:20.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0699999999999997e-07 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332014+0000", 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4619999999999999e-06 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332021+0000", 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650000000000004e-06 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332029+0000", 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-06 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375663+0000", 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043634233000000001 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375717+0000", 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4209000000000002e-05 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375783+0000", 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6297000000000006e-05 2024-09-11T07:07:20.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46285 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5988352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.808968053000001, 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043885753, 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46285 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:20.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332038+0000", 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332040+0000", 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332048+0000", 2024-09-11T07:07:20.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5830000000000001e-06 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332054+0000", 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0340000000000002e-06 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375817+0000", 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043762574999999998 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375865+0000", 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8637000000000002e-05 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375923+0000", 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7757000000000003e-05 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.196 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46286 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6037504~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.808943866, 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044027821000000002, 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46286 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332062+0000", 2024-09-11T07:07:20.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332064+0000", 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2740000000000002e-06 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332073+0000", 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6719999999999993e-06 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332079+0000", 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8579999999999996e-06 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375967+0000", 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043888476000000003 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376022+0000", 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4208e-05 2024-09-11T07:07:20.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376089+0000", 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7688000000000007e-05 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46287 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6086656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.808893864000002, 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044117732999999999, 2024-09-11T07:07:20.201 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46287 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:20.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332112+0000", 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332115+0000", 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6680000000000001e-06 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332123+0000", 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3110000000000006e-06 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332129+0000", 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4230000000000002e-06 2024-09-11T07:07:20.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376121+0000", 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043991816000000003 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376171+0000", 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9540999999999999e-05 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376229+0000", 2024-09-11T07:07:20.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8328999999999997e-05 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46288 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6135808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.808867509999999, 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044260648, 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.206 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46288 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:20.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7000000000000004e-07 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332141+0000", 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4449999999999999e-06 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332153+0000", 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1772e-05 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332159+0000", 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376274+0000", 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044115170000000002 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376333+0000", 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9017000000000001e-05 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376398+0000", 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5506999999999995e-05 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.210 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46289 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6184960~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.808824136999998, 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044357445000000002, 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46289 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332182+0000", 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3200000000000005e-07 2024-09-11T07:07:20.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332184+0000", 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332192+0000", 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332200+0000", 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3170000000000004e-06 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376431+0000", 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044230923999999998 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376479+0000", 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8072999999999999e-05 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376539+0000", 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9789e-05 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46290 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6234112~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.808797529, 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044494765999999998, 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.215 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46290 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0100000000000005e-07 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332211+0000", 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099999999999998e-06 2024-09-11T07:07:20.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332222+0000", 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1443999999999999e-05 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332228+0000", 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376583+0000", 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044355252999999997 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376639+0000", 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5278000000000002e-05 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376703+0000", 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3885000000000002e-05 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46291 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6283264~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.808769226999999, 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044598027999999998, 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.220 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46291 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332237+0000", 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332239+0000", 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4399999999999999e-06 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332246+0000", 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332253+0000", 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0379999999999996e-06 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376728+0000", 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044475317 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376777+0000", 2024-09-11T07:07:20.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9475999999999999e-05 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376834+0000", 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6749999999999997e-05 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46955 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9379840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:20.224 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.592844032999999, 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042646256, 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46955 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3099999999999999e-07 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548163+0000", 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.127e-06 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548166+0000", 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.179e-06 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548169+0000", 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8609999999999998e-06 2024-09-11T07:07:20.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590717+0000", 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042547883000000002 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590754+0000", 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.765e-05 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590808+0000", 2024-09-11T07:07:20.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3325000000000002e-05 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46956 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9428992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.592832769000001, 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042772421999999997, 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46956 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548174+0000", 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1790000000000001e-06 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548177+0000", 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2119999999999999e-06 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548180+0000", 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7369999999999998e-06 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590827+0000", 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042647353999999998 2024-09-11T07:07:20.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590886+0000", 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8968999999999997e-05 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590945+0000", 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8754e-05 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.233 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.234 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:20.235 INFO:teuthology.orchestra.run.smithi079.stdout:4339 writesame 0x98b48a1 thru 0x98bd97b data_size 0x2f(0x90db bytes) 2024-09-11T07:07:20.235 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:20.235 INFO:teuthology.orchestra.run.smithi079.stdout:4342 punch from 0x78f369d to 0x78f64da, (0x2e3d bytes) 2024-09-11T07:07:20.235 INFO:teuthology.orchestra.run.smithi079.stdout:4343 read 0x5002783 thru 0x50101b8 (0xda36 bytes) 2024-09-11T07:07:20.235 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:20.235 INFO:teuthology.orchestra.run.smithi079.stdout:4345 writesame 0x33041e4 thru 0x33097ac data_size 0x1(0x55c9 bytes) 2024-09-11T07:07:20.236 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4346 read 0x6af375e thru 0x6afdf7c (0xa81f bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4349 punch from 0x5136fd9 to 0x513ba37, (0x4a5e bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4350 write 0x7bf37d6 thru 0x7bfb4c1 (0x7cec bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4351 read 0x534de73 thru 0x53526d2 (0x4860 bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4352 trunc from 0x98bd97c to 0x80a25ea 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4353 read 0x704173f thru 0x704d8bd (0xc17f bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4355 read 0x5c660a2 thru 0x5c679c8 (0x1927 bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4357 write 0xdc19795 thru 0xdc1c48b (0x2cf7 bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4358 punch from 0xa70431b to 0xa706a84, (0x2769 bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4359 write 0xe931b6a thru 0xe9333b5 (0x184c bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4360 write 0x8dbe4e9 thru 0x8dce09a (0xfbb2 bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4361 write 0xe317a55 thru 0xe324e31 (0xd3dd bytes) 2024-09-11T07:07:20.238 INFO:teuthology.orchestra.run.smithi079.stdout:4362 write 0xee9526 thru 0xeefc37 (0x6712 bytes) 2024-09-11T07:07:20.239 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:20.229+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:20.239 INFO:teuthology.orchestra.run.smithi079.stdout:4363 writesame 0x5532e5 thru 0x55fcc7 data_size 0x1(0xc9e3 bytes) 2024-09-11T07:07:20.298 INFO:teuthology.orchestra.run.smithi079.stdout:4364 write 0x6eb3a1d thru 0x6ec0386 (0xc96a bytes) 2024-09-11T07:07:20.302 INFO:teuthology.orchestra.run.smithi079.stdout:4368 punch from 0xc6e5b5d to 0xc6ee15a, (0x85fd bytes) 2024-09-11T07:07:20.302 INFO:teuthology.orchestra.run.smithi079.stdout:4369 read 0x371c0da thru 0x371dee8 (0x1e0f bytes) 2024-09-11T07:07:20.303 INFO:teuthology.orchestra.run.smithi079.stdout:4370 write 0x96eb1d thru 0x96f455 (0x939 bytes) 2024-09-11T07:07:20.307 INFO:teuthology.orchestra.run.smithi079.stdout:4371 writesame 0x27d8882 thru 0x27dc18a data_size 0x1f(0x3909 bytes) 2024-09-11T07:07:20.310 INFO:teuthology.orchestra.run.smithi079.stdout:4372 write 0xc4e0a0c thru 0xc4e1624 (0xc19 bytes) 2024-09-11T07:07:20.313 INFO:teuthology.orchestra.run.smithi079.stdout:4373 write 0x917a9fb thru 0x917c91e (0x1f24 bytes) 2024-09-11T07:07:20.316 INFO:teuthology.orchestra.run.smithi079.stdout:4374 punch from 0x701da6 to 0x708076, (0x62d0 bytes) 2024-09-11T07:07:20.317 INFO:teuthology.orchestra.run.smithi079.stdout:4375 read 0x87d3b81 thru 0x87de0c5 (0xa545 bytes) 2024-09-11T07:07:20.317 INFO:teuthology.orchestra.run.smithi079.stdout:4376 punch from 0x2cc14e2 to 0x2cc9b9c, (0x86ba bytes) 2024-09-11T07:07:20.317 INFO:teuthology.orchestra.run.smithi079.stdout:4378 write 0xcbdf9c6 thru 0xcbe3e71 (0x44ac bytes) 2024-09-11T07:07:20.320 INFO:teuthology.orchestra.run.smithi079.stdout:4379 writesame 0xba4b6b9 thru 0xba4fa06 data_size 0x5(0x434e bytes) 2024-09-11T07:07:20.325 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:20.325 INFO:teuthology.orchestra.run.smithi079.stdout:4383 read 0xb8e1498 thru 0xb8e8aec (0x7655 bytes) 2024-09-11T07:07:20.326 INFO:teuthology.orchestra.run.smithi079.stdout:4384 punch from 0xec40a6 to 0xec4893, (0x7ed bytes) 2024-09-11T07:07:20.326 INFO:teuthology.orchestra.run.smithi079.stdout:4385 read 0x440a6ea thru 0x44128fa (0x8211 bytes) 2024-09-11T07:07:20.326 INFO:teuthology.orchestra.run.smithi079.stdout:4386 write 0xe6787fa thru 0xe68124e (0x8a55 bytes) 2024-09-11T07:07:20.329 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:20.329 INFO:teuthology.orchestra.run.smithi079.stdout:4388 read 0x76f506f thru 0x7700b85 (0xbb17 bytes) 2024-09-11T07:07:20.330 INFO:teuthology.orchestra.run.smithi079.stdout:4389 write 0xacc5f5b thru 0xacce3b1 (0x8457 bytes) 2024-09-11T07:07:20.333 INFO:teuthology.orchestra.run.smithi079.stdout:4391 read 0xb208a02 thru 0xb20ea8b (0x608a bytes) 2024-09-11T07:07:20.336 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:20.332+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:20.357 INFO:teuthology.orchestra.run.smithi079.stdout:4392 trunc from 0xe9333b6 to 0xc26c7f 2024-09-11T07:07:20.376 INFO:teuthology.orchestra.run.smithi079.stdout:4394 read 0x499cd9 thru 0x4a1ce6 (0x800e bytes) 2024-09-11T07:07:20.377 INFO:teuthology.orchestra.run.smithi079.stdout:4395 punch from 0xace9f1 to 0xad89c5, (0x9fd4 bytes) 2024-09-11T07:07:20.377 INFO:teuthology.orchestra.run.smithi079.stdout:4396 punch from 0x5817cd to 0x58f223, (0xda56 bytes) 2024-09-11T07:07:20.377 INFO:teuthology.orchestra.run.smithi079.stdout:4397 punch from 0x808759 to 0x80875a, (0x1 bytes) 2024-09-11T07:07:20.403 INFO:teuthology.orchestra.run.smithi079.stdout:4399 writesame 0x94d4246 thru 0x94dcd10 data_size 0x1(0x8acb bytes) 2024-09-11T07:07:20.403 INFO:teuthology.orchestra.run.smithi079.stdout:4400 punch from 0x2ae9297 to 0x2af3274, (0x9fdd bytes) 2024-09-11T07:07:20.416 INFO:teuthology.orchestra.run.smithi079.stdout:4402 trunc from 0x94dcd11 to 0x224c9b7 2024-09-11T07:07:20.427 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:20.429 INFO:teuthology.orchestra.run.smithi079.stdout:4404 trunc from 0x224c9b7 to 0x30c1624 2024-09-11T07:07:20.433 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:20.433 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:20.433 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:20.436 INFO:teuthology.orchestra.run.smithi079.stdout:4405 read 0x2149420 thru 0x214c836 (0x3417 bytes) 2024-09-11T07:07:20.436 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:20.433+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:20.452 INFO:teuthology.orchestra.run.smithi079.stdout:4406 writesame 0x6b98144 thru 0x6ba1bfb data_size 0x4(0x9ab8 bytes) 2024-09-11T07:07:20.453 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:20.462 INFO:teuthology.orchestra.run.smithi079.stdout:4407 write 0x8c12ed3 thru 0x8c1ad22 (0x7e50 bytes) 2024-09-11T07:07:20.467 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:20.467 INFO:teuthology.orchestra.run.smithi079.stdout:4409 read 0x27aaf0e thru 0x27b2b90 (0x7c83 bytes) 2024-09-11T07:07:20.477 INFO:teuthology.orchestra.run.smithi079.stdout:4410 trunc from 0x8c1ad23 to 0x2977e66 2024-09-11T07:07:20.498 INFO:teuthology.orchestra.run.smithi079.stdout:4411 trunc from 0x2977e66 to 0x6700071 2024-09-11T07:07:20.516 INFO:teuthology.orchestra.run.smithi079.stdout:4413 writesame 0x9825c13 thru 0x982e85d data_size 0xb(0x8c4b bytes) 2024-09-11T07:07:20.530 INFO:teuthology.orchestra.run.smithi079.stdout:4414 write 0xe469acb thru 0xe4718f0 (0x7e26 bytes) 2024-09-11T07:07:20.536 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:20.536 INFO:teuthology.orchestra.run.smithi079.stdout:4417 write 0x78baa89 thru 0x78bc516 (0x1a8e bytes) 2024-09-11T07:07:20.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:20.533+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:20.539 INFO:teuthology.orchestra.run.smithi079.stdout:4418 read 0x61125c2 thru 0x611a420 (0x7e5f bytes) 2024-09-11T07:07:20.540 INFO:teuthology.orchestra.run.smithi079.stdout:4419 writesame 0x9148e71 thru 0x9150092 data_size 0x7(0x7222 bytes) 2024-09-11T07:07:20.546 INFO:teuthology.orchestra.run.smithi079.stdout:4420 read 0x9c4cfce thru 0x9c5365b (0x668e bytes) 2024-09-11T07:07:20.547 INFO:teuthology.orchestra.run.smithi079.stdout:4422 punch from 0xcf3a209 to 0xcf3dcb1, (0x3aa8 bytes) 2024-09-11T07:07:20.547 INFO:teuthology.orchestra.run.smithi079.stdout:4424 read 0x762fa7c thru 0x763cc34 (0xd1b9 bytes) 2024-09-11T07:07:20.547 INFO:teuthology.orchestra.run.smithi079.stdout:4425 write 0x833ef60 thru 0x8340eb6 (0x1f57 bytes) 2024-09-11T07:07:20.551 INFO:teuthology.orchestra.run.smithi079.stdout:4426 write 0x4874a04 thru 0x48766a6 (0x1ca3 bytes) 2024-09-11T07:07:20.553 INFO:teuthology.orchestra.run.smithi079.stdout:4427 writesame 0x1d189d8 thru 0x1d26d99 data_size 0x1(0xe3c2 bytes) 2024-09-11T07:07:20.588 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:20.588 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:20.588 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:20.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:20.616 INFO:teuthology.orchestra.run.smithi079.stdout:4428 read 0x3142f04 thru 0x3145281 (0x237e bytes) 2024-09-11T07:07:20.618 INFO:teuthology.orchestra.run.smithi079.stdout:4429 read 0x811b5cf thru 0x8125341 (0x9d73 bytes) 2024-09-11T07:07:20.618 INFO:teuthology.orchestra.run.smithi079.stdout:4430 clone 37 order 24 su 2097152 sc 4 2024-09-11T07:07:20.638 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:20.636+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:20.739 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:20.736+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:38225 3.0 e54/21 3:00593585:::rbd_data.11612bf90fc2.0000000000000001:head v 54'264, mlcod=51'262)", 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.264105546000003, 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095742440000000009, 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.742 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7800000000000001e-07 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478936+0000", 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032745610000000001 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478959+0000", 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3553e-05 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478975+0000", 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5678000000000001e-05 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.479055+0000", 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9684000000000005e-05 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.479085+0000", 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9782e-05 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.485183+0000", 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060982140000000002 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.485235+0000", 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2593999999999998e-05 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:41586 3.4 e58/21 3:278deab4:::rbd_data.11612bd38060.0000000000000000:head v 58'75, mlcod=53'73)", 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.930770758999998, 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080719699999999995, 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808999+0000", 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2830000000000002e-06 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810913+0000", 2024-09-11T07:07:20.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001913402 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810949+0000", 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5954999999999997e-05 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810966+0000", 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7459e-05 2024-09-11T07:07:20.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.811079+0000", 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113101 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.811118+0000", 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8937999999999999e-05 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.816962+0000", 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005843488 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.817068+0000", 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106344 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.751 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59289 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:head [stat,truncate 11010048] snapc 20=[20] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.724303505000002, 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024828697, 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59289 2024-09-11T07:07:20.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015467+0000", 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6200000000000001e-06 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015483+0000", 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5962999999999999e-05 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015531+0000", 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7964999999999999e-05 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015554+0000", 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3493e-05 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015723+0000", 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169121 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016035+0000", 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031174000000000002 2024-09-11T07:07:20.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016468+0000", 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043272900000000002 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.039067+0000", 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022598894000000001 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040107+0000", 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010398860000000001 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040212+0000", 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010577399999999999 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040292+0000", 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9511999999999994e-05 2024-09-11T07:07:20.757 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62059 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.942443378, 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080870200000000003, 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62059 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:20.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797324+0000", 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797325+0000", 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.175e-06 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797328+0000", 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3519999999999998e-06 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797331+0000", 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9359999999999999e-06 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805061+0000", 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0077296919999999998 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805212+0000", 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015180799999999999 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805410+0000", 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019783999999999999 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62084 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.942123515999999, 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081746579999999996, 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62084 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797644+0000", 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2399999999999996e-07 2024-09-11T07:07:20.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797649+0000", 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1410000000000004e-06 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797662+0000", 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3142000000000001e-05 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797671+0000", 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0599999999999997e-06 2024-09-11T07:07:20.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805515+0000", 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078431270000000001 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805666+0000", 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015186299999999999 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805818+0000", 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015140100000000001 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62085 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3244032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.942068930000001, 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086787909999999999, 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.767 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62085 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8800000000000002e-07 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797702+0000", 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4079999999999998e-06 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797714+0000", 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1833e-05 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797721+0000", 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1450000000000002e-06 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805934+0000", 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008213471 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806175+0000", 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024039600000000001 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806377+0000", 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020185 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62086 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3309568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.942025732000001, 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089940209999999996, 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.772 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62086 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:20.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1699999999999998e-07 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797745+0000", 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2629999999999999e-06 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797757+0000", 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2214e-05 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797763+0000", 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.609e-06 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806471+0000", 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087085700000000005 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806589+0000", 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000117939 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806735+0000", 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000145909 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.776 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62087 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3375104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.94198287, 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095423460000000002, 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62087 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.13e-07 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797788+0000", 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.349e-06 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797794+0000", 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4999999999999996e-06 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797800+0000", 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8080000000000001e-06 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806844+0000", 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090440060000000003 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807059+0000", 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021471000000000001 2024-09-11T07:07:20.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807326+0000", 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026746000000000002 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62088 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3440640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.941958078999999, 2024-09-11T07:07:20.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0097044639999999995, 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62088 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5400000000000002e-07 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797812+0000", 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3340000000000002e-06 2024-09-11T07:07:20.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797820+0000", 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1980000000000004e-06 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797825+0000", 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1429999999999997e-06 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807392+0000", 2024-09-11T07:07:20.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095677420000000006 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807443+0000", 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0179999999999997e-05 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807513+0000", 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0413000000000005e-05 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62089 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3506176~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.941936711, 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01023572, 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62089 2024-09-11T07:07:20.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.787 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2500000000000001e-07 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797832+0000", 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4950000000000001e-06 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797836+0000", 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9899999999999999e-06 2024-09-11T07:07:20.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797845+0000", 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0839999999999998e-06 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807583+0000", 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0097380100000000001 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807802+0000", 2024-09-11T07:07:20.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021865599999999999 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808066+0000", 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026415999999999999 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62090 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:20.790 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.941907706999999, 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010367039, 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62090 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4700000000000002e-07 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797861+0000", 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8390000000000001e-06 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797866+0000", 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9150000000000004e-06 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797869+0000", 2024-09-11T07:07:20.793 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1269999999999999e-06 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808092+0000", 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010222788999999999 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808151+0000", 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9456000000000001e-05 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.794 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808226+0000", 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4566000000000004e-05 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62091 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3637248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.941892534000001, 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010935996, 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.795 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62091 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5199999999999998e-07 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797876+0000", 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.277e-06 2024-09-11T07:07:20.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797879+0000", 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6890000000000002e-06 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797882+0000", 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6240000000000002e-06 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808306+0000", 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010423946999999999 2024-09-11T07:07:20.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808440+0000", 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000133993 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808810+0000", 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000370214 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62116 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3194880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.941212749000002, 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010413343, 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62116 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.800 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798556+0000", 2024-09-11T07:07:20.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798581+0000", 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4556e-05 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798618+0000", 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7313e-05 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798632+0000", 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3226e-05 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808844+0000", 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01021238 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808898+0000", 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4534999999999999e-05 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.803 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808967+0000", 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8806999999999994e-05 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62117 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3260416~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.941070767999999, 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010787804999999999, 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.804 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62117 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798697+0000", 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3200000000000005e-07 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798700+0000", 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.517e-06 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798708+0000", 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-11T07:07:20.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798715+0000", 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9959999999999996e-06 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809045+0000", 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010329896 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809198+0000", 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015303499999999999 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809484+0000", 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000285968 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62118 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3325952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.941037854000001, 2024-09-11T07:07:20.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010897328, 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62118 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798732+0000", 2024-09-11T07:07:20.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0489999999999999e-06 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798740+0000", 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2359999999999998e-06 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798746+0000", 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4980000000000003e-06 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809512+0000", 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010766133000000001 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809560+0000", 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7927999999999999e-05 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809626+0000", 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6006000000000005e-05 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.812 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62119 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3391488~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.941012313000002, 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011339109, 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.813 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62119 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798755+0000", 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8100000000000001e-07 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798758+0000", 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5119999999999998e-06 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798781+0000", 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3175000000000001e-05 2024-09-11T07:07:20.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798788+0000", 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9240000000000001e-06 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809715+0000", 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010927533 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809902+0000", 2024-09-11T07:07:20.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000187111 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810093+0000", 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019097299999999999 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62120 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3457024~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.940967530000002, 2024-09-11T07:07:20.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011832135000000001, 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62120 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:20.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798800+0000", 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6400000000000002e-07 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798804+0000", 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0419999999999996e-06 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798813+0000", 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6870000000000006e-06 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798819+0000", 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6810000000000003e-06 2024-09-11T07:07:20.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810180+0000", 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011361069999999999 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810372+0000", 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000191456 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810631+0000", 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025963499999999998 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62121 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3522560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.940939350000001, 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01236723, 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.822 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62121 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798828+0000", 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798830+0000", 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-06 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798839+0000", 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3019999999999995e-06 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798844+0000", 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2549999999999997e-06 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810713+0000", 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011869151 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810925+0000", 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021164999999999999 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811195+0000", 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026976099999999998 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.826 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62122 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3588096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.940900422999999, 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012886078, 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62122 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798867+0000", 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798870+0000", 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0630000000000002e-06 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798878+0000", 2024-09-11T07:07:20.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8669999999999994e-06 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798902+0000", 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4167000000000001e-05 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811275+0000", 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012373454000000001 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811484+0000", 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020880000000000001 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811752+0000", 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026820099999999998 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62123 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3653632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:20.831 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.940852045, 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013329191000000001, 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62123 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:20.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6300000000000004e-07 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798918+0000", 2024-09-11T07:07:20.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0750000000000002e-06 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798926+0000", 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8839999999999994e-06 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798933+0000", 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0169999999999999e-06 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:20.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811830+0000", 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012896179000000001 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812072+0000", 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024236200000000001 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812244+0000", 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017191099999999999 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.835 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:20.836 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:20.836 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:20.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:20.839 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:20.836+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:20.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:20.933+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:20.966 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:20.966 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:20.980 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:21.072 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:21.069+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:21.099 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:07:21.141 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:21.140+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:21.155 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:21.155 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:21.156 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:21.156 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:21.172 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:21.187 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone36 from 0xe4718f1 (overlap 0xc26c7f) to 0xaefb3f 2024-09-11T07:07:21.242 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:21.240+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:21.273 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #35, image image_client.0-clone35 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent36 2024-09-11T07:07:21.299 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:21.313 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:21.313 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 43.687361297000002, 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.314 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:07:21.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:07:21.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.319 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59094 3.8 3:14e63fb1:::rbd_data.11616c31e2ad.0000000000000003:1e [read 4554752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010752+0000", 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.300884112999999, 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037890938999999998, 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59094 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010752+0000", 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010752+0000", 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010753+0000", 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.077e-06 2024-09-11T07:07:21.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010758+0000", 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0760000000000002e-06 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010776+0000", 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8068999999999999e-05 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010790+0000", 2024-09-11T07:07:21.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3813e-05 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048527+0000", 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736727999999997 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048584+0000", 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7049999999999998e-05 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048643+0000", 2024-09-11T07:07:21.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9126000000000003e-05 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59112 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5537792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010819+0000", 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.300816881999999, 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038152713999999997, 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59112 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010819+0000", 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010819+0000", 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010821+0000", 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2300000000000001e-06 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010826+0000", 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7590000000000003e-06 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010844+0000", 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.787e-05 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010858+0000", 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3633e-05 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048699+0000", 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037841125000000003 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048837+0000", 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013833300000000001 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048972+0000", 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134764 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59115 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.300759744, 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038255633999999997, 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.328 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59115 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:21.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010877+0000", 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.083e-06 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010885+0000", 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0400000000000004e-06 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010931+0000", 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6452000000000002e-05 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010947+0000", 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5786000000000001e-05 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049022+0000", 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038075472999999999 2024-09-11T07:07:21.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049076+0000", 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4131000000000001e-05 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049132+0000", 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5668999999999998e-05 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59119 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.300668093999999, 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038492673999999998, 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.333 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59119 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010969+0000", 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010976+0000", 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4529999999999999e-06 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010994+0000", 2024-09-11T07:07:21.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8672999999999999e-05 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011009+0000", 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4122e-05 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049189+0000", 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038180218000000002 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:21.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049342+0000", 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015341899999999999 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049461+0000", 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118522 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59138 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:21.337 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.300609279, 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038631255000000003, 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59138 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011028+0000", 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011034+0000", 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011049+0000", 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5702999999999999e-05 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011063+0000", 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3373000000000001e-05 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049512+0000", 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038449050999999998 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049601+0000", 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9395999999999996e-05 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049658+0000", 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6861999999999999e-05 2024-09-11T07:07:21.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59147 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.300370597000001, 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038436533000000002, 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59147 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011267+0000", 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.46e-06 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011278+0000", 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.119e-05 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011457+0000", 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017874699999999999 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011481+0000", 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4283000000000001e-05 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049693+0000", 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038212053000000003 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049702+0000", 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59148 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.300113418999999, 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038227694999999999, 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.346 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59148 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:21.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011525+0000", 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011536+0000", 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011561+0000", 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5494999999999999e-05 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011579+0000", 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7292999999999999e-05 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049739+0000", 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038159803999999999 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049750+0000", 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59149 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.300032108, 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038196747000000003, 2024-09-11T07:07:21.350 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59149 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011605+0000", 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011614+0000", 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3219999999999993e-06 2024-09-11T07:07:21.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011634+0000", 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0703000000000002e-05 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011649+0000", 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4603000000000001e-05 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049788+0000", 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038138500999999998 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049801+0000", 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3244000000000001e-05 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.354 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59150 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.299966087000001, 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038171956999999999, 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59150 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011671+0000", 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011678+0000", 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011696+0000", 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-05 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011710+0000", 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3516000000000001e-05 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049835+0000", 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038125004999999997 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049842+0000", 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0299999999999996e-06 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.358 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59151 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011729+0000", 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.299906965000002, 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038150892999999998, 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.359 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59151 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011729+0000", 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011729+0000", 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011730+0000", 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.136e-06 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011736+0000", 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0170000000000002e-06 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011754+0000", 2024-09-11T07:07:21.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7765999999999999e-05 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011768+0000", 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3546e-05 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049872+0000", 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038104449999999998 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049880+0000", 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9780000000000005e-06 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59152 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011787+0000", 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.299848997000002, 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038145537, 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.363 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59152 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011787+0000", 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011787+0000", 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011789+0000", 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011795+0000", 2024-09-11T07:07:21.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000001e-06 2024-09-11T07:07:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011812+0000", 2024-09-11T07:07:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7042e-05 2024-09-11T07:07:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011826+0000", 2024-09-11T07:07:21.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3803e-05 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049921+0000", 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038095496 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049933+0000", 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1476e-05 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59153 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.299791316, 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038163669999999997, 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.368 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59153 2024-09-11T07:07:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011846+0000", 2024-09-11T07:07:21.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1939999999999999e-06 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011853+0000", 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6030000000000001e-06 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011870+0000", 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7739000000000001e-05 2024-09-11T07:07:21.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011884+0000", 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.402e-05 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049993+0000", 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038108988000000003 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050009+0000", 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5126000000000001e-05 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59154 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.299730378, 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038170655999999997, 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.373 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59154 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011907+0000", 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1739999999999999e-06 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011974+0000", 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7200999999999996e-05 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011995+0000", 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1058999999999999e-05 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012015+0000", 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9857e-05 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050060+0000", 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038045074999999998 2024-09-11T07:07:21.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050076+0000", 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6290000000000002e-05 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59159 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.012037+0000", 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.299599230999998, 2024-09-11T07:07:21.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038100551000000003, 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59159 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012037+0000", 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012037+0000", 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012038+0000", 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.209e-06 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012044+0000", 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2140000000000001e-06 2024-09-11T07:07:21.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012063+0000", 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8284999999999999e-05 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012076+0000", 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3105000000000001e-05 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050123+0000", 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038047046000000001 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050137+0000", 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4691999999999999e-05 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59166 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.381 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.012104+0000", 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.299531893000001, 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038101007999999999, 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59166 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012104+0000", 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012104+0000", 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012105+0000", 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.006e-06 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012111+0000", 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6590000000000004e-06 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012128+0000", 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7507999999999999e-05 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012145+0000", 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6511000000000002e-05 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050189+0000", 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038043862999999997 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050205+0000", 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6461e-05 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59168 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.012163+0000", 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.299472657999999, 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038107475000000002, 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59168 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012163+0000", 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012163+0000", 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012165+0000", 2024-09-11T07:07:21.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1769999999999999e-06 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012171+0000", 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012193+0000", 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2268000000000001e-05 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012208+0000", 2024-09-11T07:07:21.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4382000000000001e-05 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050257+0000", 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038049080999999998 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050271+0000", 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4301000000000001e-05 2024-09-11T07:07:21.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59172 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.012225+0000", 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.299410751, 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038113712000000001, 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.390 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59172 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012225+0000", 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012225+0000", 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012227+0000", 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.108e-06 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012232+0000", 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9089999999999997e-06 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012253+0000", 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0412999999999999e-05 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012267+0000", 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4483e-05 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050323+0000", 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038056081999999998 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050339+0000", 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5716999999999999e-05 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:70560 3.2 3:459eba64:::rbd_data.11618cc4d69.000000000000003a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.8514997739999997, 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064825956000000004, 2024-09-11T07:07:21.394 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 70560 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460139+0000", 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460150+0000", 2024-09-11T07:07:21.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0824e-05 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460178+0000", 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8449000000000002e-05 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460199+0000", 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1075999999999999e-05 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460319+0000", 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119714 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460451+0000", 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013264 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.472543+0000", 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091437 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524779+0000", 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052236339 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524853+0000", 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524913+0000", 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0825000000000001e-05 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524962+0000", 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8999999999999998e-05 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71632 3.18 3:194b1b54:::rbd_data.1161b94a6d64.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 1.8692424480000001, 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039963481000000002, 2024-09-11T07:07:21.400 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71632 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442395+0000", 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442403+0000", 2024-09-11T07:07:21.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6210000000000004e-06 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442416+0000", 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3011e-05 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442422+0000", 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2620000000000004e-06 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442495+0000", 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2977000000000003e-05 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442647+0000", 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015205199999999999 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.450708+0000", 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080612589999999994 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482090+0000", 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031381543999999997 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482176+0000", 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6302000000000001e-05 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482279+0000", 2024-09-11T07:07:21.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010242399999999999 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482357+0000", 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8565000000000004e-05 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:21.406 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:21.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:21.408 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:21.404+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:21.454 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:21.455 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:21.487 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:21.488 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:21.508 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:21.508 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:21.509 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:21.505+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:21.525 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:21.526 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:21.538 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:21.539 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:21.546 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:21.546 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:21.553 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:21.567 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:21.567 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:21.587 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:21.587 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:21.607 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:21.608 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:21.609 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:21.605+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:21.676 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:21.676 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:21.691 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:21.710 INFO:teuthology.orchestra.run.smithi079.stdout:4431 write 0xeafe3e4 thru 0xeb05fe6 (0x7c03 bytes) 2024-09-11T07:07:21.714 INFO:teuthology.orchestra.run.smithi079.stdout:4432 read 0x4ed62a8 thru 0x4ee1794 (0xb4ed bytes) 2024-09-11T07:07:21.714 INFO:teuthology.orchestra.run.smithi079.stdout:4433 write 0xe9fe664 thru 0xea00d15 (0x26b2 bytes) 2024-09-11T07:07:21.721 INFO:teuthology.orchestra.run.smithi079.stdout:4437 write 0x9666f0c thru 0x96747d2 (0xd8c7 bytes) 2024-09-11T07:07:21.726 INFO:teuthology.orchestra.run.smithi079.stdout:4438 write 0x191a7a8 thru 0x191f933 (0x518c bytes) 2024-09-11T07:07:21.737 INFO:teuthology.orchestra.run.smithi079.stdout:4440 read 0x4058380 thru 0x405ef35 (0x6bb6 bytes) 2024-09-11T07:07:21.738 INFO:teuthology.orchestra.run.smithi079.stdout:4443 writesame 0x8f465b8 thru 0x8f4fd35 data_size 0x1(0x977e bytes) 2024-09-11T07:07:21.740 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:21.740+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:21.755 INFO:teuthology.orchestra.run.smithi079.stdout:4444 write 0xab8a4f1 thru 0xab8d607 (0x3117 bytes) 2024-09-11T07:07:21.765 INFO:teuthology.orchestra.run.smithi079.stdout:4446 read 0x773eb9a thru 0x773f1e4 (0x64b bytes) 2024-09-11T07:07:21.765 INFO:teuthology.orchestra.run.smithi079.stdout:4447 writesame 0x3e9458c thru 0x3e9e925 data_size 0x2b(0xa39a bytes) 2024-09-11T07:07:21.778 INFO:teuthology.orchestra.run.smithi079.stdout:4448 write 0xbc06beb thru 0xbc07a58 (0xe6e bytes) 2024-09-11T07:07:21.787 INFO:teuthology.orchestra.run.smithi079.stdout:4449 write 0xbdfa006 thru 0xbe093f8 (0xf3f3 bytes) 2024-09-11T07:07:21.791 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:21.791 INFO:teuthology.orchestra.run.smithi079.stdout:4451 read 0xb4f0db0 thru 0xb4ff9be (0xec0f bytes) 2024-09-11T07:07:21.792 INFO:teuthology.orchestra.run.smithi079.stdout:4453 write 0x1278a5a thru 0x127b7dd (0x2d84 bytes) 2024-09-11T07:07:21.803 INFO:teuthology.orchestra.run.smithi079.stdout:4454 write 0x7a527a8 thru 0x7a619e2 (0xf23b bytes) 2024-09-11T07:07:21.810 INFO:teuthology.orchestra.run.smithi079.stdout:4455 read 0x491e176 thru 0x4921692 (0x351d bytes) 2024-09-11T07:07:21.810 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:21.808+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:21.820 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:21.820 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:21.823 INFO:teuthology.orchestra.run.smithi079.stdout:4456 trunc from 0xeb05fe7 to 0x9e42308 2024-09-11T07:07:21.836 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:21.857 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:21.857 INFO:teuthology.orchestra.run.smithi079.stdout:4459 writesame 0x50118ae thru 0x5011fa1 data_size 0xa(0x6f4 bytes) 2024-09-11T07:07:21.895 INFO:teuthology.orchestra.run.smithi079.stdout:4460 write 0xec0ebcf thru 0xec0ecc6 (0xf8 bytes) 2024-09-11T07:07:21.902 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:21.902 INFO:teuthology.orchestra.run.smithi079.stdout:4463 punch from 0x2412962 to 0x241ea9e, (0xc13c bytes) 2024-09-11T07:07:21.902 INFO:teuthology.orchestra.run.smithi079.stdout:4464 writesame 0xa5c2095 thru 0xa5cbfb5 data_size 0x25(0x9f21 bytes) 2024-09-11T07:07:21.907 INFO:teuthology.orchestra.run.smithi079.stdout:4465 read 0xcfe5d52 thru 0xcfeced0 (0x717f bytes) 2024-09-11T07:07:21.907 INFO:teuthology.orchestra.run.smithi079.stdout:4466 read 0x109240d thru 0x109353a (0x112e bytes) 2024-09-11T07:07:21.907 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:21.907 INFO:teuthology.orchestra.run.smithi079.stdout:4468 read 0xb044d59 thru 0xb046d92 (0x203a bytes) 2024-09-11T07:07:21.908 INFO:teuthology.orchestra.run.smithi079.stdout:4469 read 0x7515b11 thru 0x75216da (0xbbca bytes) 2024-09-11T07:07:21.909 INFO:teuthology.orchestra.run.smithi079.stdout:4470 write 0xc7446af thru 0xc753822 (0xf174 bytes) 2024-09-11T07:07:21.916 INFO:teuthology.orchestra.run.smithi079.stdout:4471 write 0x9398cd3 thru 0x93a3da1 (0xb0cf bytes) 2024-09-11T07:07:21.919 INFO:teuthology.orchestra.run.smithi079.stdout:4472 read 0xc07e876 thru 0xc0890cf (0xa85a bytes) 2024-09-11T07:07:21.919 INFO:teuthology.orchestra.run.smithi079.stdout:4473 punch from 0x2560949 to 0x256510c, (0x47c3 bytes) 2024-09-11T07:07:21.920 INFO:teuthology.orchestra.run.smithi079.stdout:4474 writesame 0x9e5c240 thru 0x9e66c3c data_size 0x1(0xa9fd bytes) 2024-09-11T07:07:21.924 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:21.924+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:21.971 INFO:teuthology.orchestra.run.smithi079.stdout:4475 read 0x713156c thru 0x713ac37 (0x96cc bytes) 2024-09-11T07:07:21.997 INFO:teuthology.orchestra.run.smithi079.stdout:4476 trunc from 0xec0ecc7 to 0x36cb3f2 2024-09-11T07:07:22.007 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:22.008 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:22.012 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:22.009+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:22.024 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:22.037 INFO:teuthology.orchestra.run.smithi079.stdout:4478 punch from 0x1c7d9a1 to 0x1c8cb59, (0xf1b8 bytes) 2024-09-11T07:07:22.038 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:22.038 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:22.038 INFO:teuthology.orchestra.run.smithi079.stdout:4485 punch from 0xd6dc2e to 0xd78aca, (0xae9c bytes) 2024-09-11T07:07:22.038 INFO:teuthology.orchestra.run.smithi079.stdout:4486 write 0x1f7852a thru 0x1f827b5 (0xa28c bytes) 2024-09-11T07:07:22.068 INFO:teuthology.orchestra.run.smithi079.stdout:4487 write 0x915865f thru 0x91610ae (0x8a50 bytes) 2024-09-11T07:07:22.072 INFO:teuthology.orchestra.run.smithi079.stdout:4488 write 0x23bb9b9 thru 0x23c6e3f (0xb487 bytes) 2024-09-11T07:07:22.076 INFO:teuthology.orchestra.run.smithi079.stdout:4489 read 0x8636261 thru 0x863cdb6 (0x6b56 bytes) 2024-09-11T07:07:22.076 INFO:teuthology.orchestra.run.smithi079.stdout:4491 punch from 0x8b780dd to 0x8b84f86, (0xcea9 bytes) 2024-09-11T07:07:22.078 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:07:22.078 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:07:22.079 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T07:07:22.079 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 1.000000 2024-09-11T07:07:22.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-11T07:07:22.093 INFO:teuthology.orchestra.run.smithi079.stdout:4495 writesame 0xaf3abbb thru 0xaf42165 data_size 0x3(0x75ab bytes) 2024-09-11T07:07:22.103 INFO:teuthology.orchestra.run.smithi079.stdout:4496 trunc from 0xaf42166 to 0x6471f2f 2024-09-11T07:07:22.116 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:22.116+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:22.117 INFO:teuthology.orchestra.run.smithi079.stdout:4498 read 0x61d1744 thru 0x61d6335 (0x4bf2 bytes) 2024-09-11T07:07:22.117 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:22.117 INFO:teuthology.orchestra.run.smithi079.stdout:4500 read 0x624db2c thru 0x624db57 (0x2c bytes) 2024-09-11T07:07:22.117 INFO:teuthology.orchestra.run.smithi079.stdout:4502 read 0xc70666 thru 0xc7e4ec (0xde87 bytes) 2024-09-11T07:07:22.118 INFO:teuthology.orchestra.run.smithi079.stdout:4503 read 0x21fbd7b thru 0x2201a17 (0x5c9d bytes) 2024-09-11T07:07:22.118 INFO:teuthology.orchestra.run.smithi079.stdout:4504 punch from 0x4b1cf0 to 0x4b5d21, (0x4031 bytes) 2024-09-11T07:07:22.118 INFO:teuthology.orchestra.run.smithi079.stdout:4506 read 0xe1263 thru 0xeed31 (0xdacf bytes) 2024-09-11T07:07:22.134 INFO:teuthology.orchestra.run.smithi079.stdout:4507 write 0xa63d806 thru 0xa63efee (0x17e9 bytes) 2024-09-11T07:07:22.139 INFO:teuthology.orchestra.run.smithi079.stdout:4508 read 0x70eb044 thru 0x70f7375 (0xc332 bytes) 2024-09-11T07:07:22.139 INFO:teuthology.orchestra.run.smithi079.stdout:4509 read 0x75d1b26 thru 0x75d7f60 (0x643b bytes) 2024-09-11T07:07:22.139 INFO:teuthology.orchestra.run.smithi079.stdout:4510 writesame 0x35b7f07 thru 0x35bf171 data_size 0x1(0x726b bytes) 2024-09-11T07:07:22.163 INFO:teuthology.orchestra.run.smithi079.stdout:4512 writesame 0xacada6 thru 0xacbe29 data_size 0xe(0x1084 bytes) 2024-09-11T07:07:22.166 INFO:teuthology.orchestra.run.smithi079.stdout:4513 write 0x5a42b2b thru 0x5a505b2 (0xda88 bytes) 2024-09-11T07:07:22.173 INFO:teuthology.orchestra.run.smithi079.stdout:4514 write 0x60bed1 thru 0x619538 (0xd668 bytes) 2024-09-11T07:07:22.190 INFO:teuthology.orchestra.run.smithi079.stdout:4515 write 0xc1dfbb8 thru 0xc1e2e9b (0x32e4 bytes) 2024-09-11T07:07:22.197 INFO:teuthology.orchestra.run.smithi079.stdout:4516 writesame 0x402ed3b thru 0x4038cfd data_size 0x1(0x9fc3 bytes) 2024-09-11T07:07:22.201 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:22.201 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:22.214 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:22.209+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:22.215 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:22.227 INFO:teuthology.orchestra.run.smithi079.stdout:4518 write 0x126f43b thru 0x127bc2b (0xc7f1 bytes) 2024-09-11T07:07:22.230 INFO:teuthology.orchestra.run.smithi079.stdout:4520 read 0x56c69ba thru 0x56cee98 (0x84df bytes) 2024-09-11T07:07:22.230 INFO:teuthology.orchestra.run.smithi079.stdout:4522 punch from 0x5c979b5 to 0x5c9e1de, (0x6829 bytes) 2024-09-11T07:07:22.230 INFO:teuthology.orchestra.run.smithi079.stdout:4523 punch from 0x6467b66 to 0x6470b8e, (0x9028 bytes) 2024-09-11T07:07:22.230 INFO:teuthology.orchestra.run.smithi079.stdout:4524 read 0xa003e2c thru 0xa009fb2 (0x6187 bytes) 2024-09-11T07:07:22.240 INFO:teuthology.orchestra.run.smithi079.stdout:4525 write 0xe791fd9 thru 0xe79cb46 (0xab6e bytes) 2024-09-11T07:07:22.253 INFO:teuthology.orchestra.run.smithi079.stdout:4526 trunc from 0xe79cb47 to 0x84e1416 2024-09-11T07:07:22.271 INFO:teuthology.orchestra.run.smithi079.stdout:4527 write 0x4135f1 thru 0x420767 (0xd177 bytes) 2024-09-11T07:07:22.273 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:22.273 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:22.273 INFO:teuthology.orchestra.run.smithi079.stdout:4530 write 0x23f3cc6 thru 0x23f4c30 (0xf6b bytes) 2024-09-11T07:07:22.274 INFO:teuthology.orchestra.run.smithi079.stdout:4531 read 0x1e2d8b2 thru 0x1e3028b (0x29da bytes) 2024-09-11T07:07:22.275 INFO:teuthology.orchestra.run.smithi079.stdout:4533 write 0x3abf3c9 thru 0x3abf688 (0x2c0 bytes) 2024-09-11T07:07:22.276 INFO:teuthology.orchestra.run.smithi079.stdout:4536 punch from 0x7f5c0c7 to 0x7f6be2d, (0xfd66 bytes) 2024-09-11T07:07:22.277 INFO:teuthology.orchestra.run.smithi079.stdout:4537 trunc from 0x84e1416 to 0x799b486 2024-09-11T07:07:22.297 INFO:teuthology.orchestra.run.smithi079.stdout:4538 write 0xa9c0aca thru 0xa9c7f63 (0x749a bytes) 2024-09-11T07:07:22.301 INFO:teuthology.orchestra.run.smithi079.stdout:4539 punch from 0x3dc31a5 to 0x3dc531b, (0x2176 bytes) 2024-09-11T07:07:22.302 INFO:teuthology.orchestra.run.smithi079.stdout:4540 write 0x689f3b8 thru 0x68a40e8 (0x4d31 bytes) 2024-09-11T07:07:22.304 INFO:teuthology.orchestra.run.smithi079.stdout:4542 writesame 0x4080abb thru 0x408bfcb data_size 0x1(0xb511 bytes) 2024-09-11T07:07:22.315 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:22.309+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:22.327 INFO:teuthology.orchestra.run.smithi079.stdout:4543 writesame 0x2fc4480 thru 0x2fceba1 data_size 0x9(0xa722 bytes) 2024-09-11T07:07:22.331 INFO:teuthology.orchestra.run.smithi079.stdout:4544 read 0x68459f7 thru 0x684cbac (0x71b6 bytes) 2024-09-11T07:07:22.331 INFO:teuthology.orchestra.run.smithi079.stdout:4545 write 0x76cbdca thru 0x76cdbb6 (0x1ded bytes) 2024-09-11T07:07:22.338 INFO:teuthology.orchestra.run.smithi079.stdout:4547 read 0x1fa1497 thru 0x1fa5173 (0x3cdd bytes) 2024-09-11T07:07:22.353 INFO:teuthology.orchestra.run.smithi079.stdout:4549 write 0xdd28260 thru 0xdd30f46 (0x8ce7 bytes) 2024-09-11T07:07:22.358 INFO:teuthology.orchestra.run.smithi079.stdout:4550 write 0xa78e295 thru 0xa796039 (0x7da5 bytes) 2024-09-11T07:07:22.376 INFO:teuthology.orchestra.run.smithi079.stdout:4551 writesame 0xea3fc58 thru 0xea4542c data_size 0x5(0x57d5 bytes) 2024-09-11T07:07:22.376 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:22.376 INFO:teuthology.orchestra.run.smithi079.stdout:4553 read 0xa034e84 thru 0xa035ee4 (0x1061 bytes) 2024-09-11T07:07:22.377 INFO:teuthology.orchestra.run.smithi079.stdout:4554 punch from 0x374afad to 0x3755f25, (0xaf78 bytes) 2024-09-11T07:07:22.377 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:22.377 INFO:teuthology.orchestra.run.smithi079.stdout:4556 trunc from 0xea4542d to 0xe4dd417 2024-09-11T07:07:22.385 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:22.385 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:22.390 INFO:teuthology.orchestra.run.smithi079.stdout:4557 write 0x21b649 thru 0x21e234 (0x2bec bytes) 2024-09-11T07:07:22.401 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:22.405 INFO:teuthology.orchestra.run.smithi079.stdout:4558 trunc from 0xe4dd417 to 0x8268065 2024-09-11T07:07:22.417 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:22.413+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:22.433 INFO:teuthology.orchestra.run.smithi079.stdout:4561 trunc from 0x8268065 to 0x61a537c 2024-09-11T07:07:22.461 INFO:teuthology.orchestra.run.smithi079.stdout:4565 trunc from 0x61a537c to 0x153d13e 2024-09-11T07:07:22.499 INFO:teuthology.orchestra.run.smithi079.stdout:4566 writesame 0x4b946c3 thru 0x4b9964f data_size 0x1(0x4f8d bytes) 2024-09-11T07:07:22.499 INFO:teuthology.orchestra.run.smithi079.stdout:4567 writesame 0x2e6d3b5 thru 0x2e719a7 data_size 0x2f(0x45f3 bytes) 2024-09-11T07:07:22.502 INFO:teuthology.orchestra.run.smithi079.stdout:4570 punch from 0x3cbf7e7 to 0x3ccee09, (0xf622 bytes) 2024-09-11T07:07:22.502 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:22.502 INFO:teuthology.orchestra.run.smithi079.stdout:4572 read 0x395ddc7 thru 0x396d414 (0xf64e bytes) 2024-09-11T07:07:22.503 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:22.509 INFO:teuthology.orchestra.run.smithi079.stdout:4578 trunc from 0x4b99650 to 0x6fe1dda 2024-09-11T07:07:22.517 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:22.513+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:22.535 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:22.535 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:22.539 INFO:teuthology.orchestra.run.smithi079.stdout:4579 writesame 0x908e9e9 thru 0x9094b45 data_size 0x5(0x615d bytes) 2024-09-11T07:07:22.539 INFO:teuthology.orchestra.run.smithi079.stdout:4580 punch from 0x6058de9 to 0x60618f5, (0x8b0c bytes) 2024-09-11T07:07:22.539 INFO:teuthology.orchestra.run.smithi079.stdout:4581 write 0x530c21d thru 0x530f7a1 (0x3585 bytes) 2024-09-11T07:07:22.546 INFO:teuthology.orchestra.run.smithi079.stdout:4582 read 0x7d310b4 thru 0x7d404c2 (0xf40f bytes) 2024-09-11T07:07:22.546 INFO:teuthology.orchestra.run.smithi079.stdout:4583 write 0x26c1157 thru 0x26c5d3a (0x4be4 bytes) 2024-09-11T07:07:22.550 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:22.551 INFO:teuthology.orchestra.run.smithi079.stdout:4584 writesame 0x6c145e6 thru 0x6c1d525 data_size 0x60(0x8f40 bytes) 2024-09-11T07:07:22.578 INFO:teuthology.orchestra.run.smithi079.stdout:4585 trunc from 0x9094b46 to 0x5e2adb 2024-09-11T07:07:22.619 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:22.613+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:22.626 INFO:teuthology.orchestra.run.smithi079.stdout:4586 trunc from 0x5e2adb to 0x96022e9 2024-09-11T07:07:22.667 INFO:teuthology.orchestra.run.smithi079.stdout:4587 writesame 0xed8d5ff thru 0xed9b035 data_size 0x9(0xda37 bytes) 2024-09-11T07:07:22.667 INFO:teuthology.orchestra.run.smithi079.stdout:4588 punch from 0x9dc8a02 to 0x9dd1d92, (0x9390 bytes) 2024-09-11T07:07:22.668 INFO:teuthology.orchestra.run.smithi079.stdout:4589 write 0x214de9a thru 0x21572a2 (0x9409 bytes) 2024-09-11T07:07:22.671 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:22.671 INFO:teuthology.orchestra.run.smithi079.stdout:4591 write 0x139c811 thru 0x13a1cd7 (0x54c7 bytes) 2024-09-11T07:07:22.675 INFO:teuthology.orchestra.run.smithi079.stdout:4592 writesame 0x1139bc9 thru 0x1141503 data_size 0x5(0x793b bytes) 2024-09-11T07:07:22.676 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:22.677 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:22.684 INFO:teuthology.orchestra.run.smithi079.stdout:4593 punch from 0x220ad26 to 0x2217ead, (0xd187 bytes) 2024-09-11T07:07:22.692 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:22.706 INFO:teuthology.orchestra.run.smithi079.stdout:4596 trunc from 0xed9b036 to 0x682aec9 2024-09-11T07:07:22.731 INFO:teuthology.orchestra.run.smithi079.stdout:4597 writesame 0x71eb502 thru 0x71f5650 data_size 0x5(0xa14f bytes) 2024-09-11T07:07:22.731 INFO:teuthology.orchestra.run.smithi079.stdout:4600 punch from 0x38a8bc1 to 0x38ad6eb, (0x4b2a bytes) 2024-09-11T07:07:22.740 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:22.740+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:22.743 INFO:teuthology.orchestra.run.smithi079.stdout:4602 write 0x787be2f thru 0x788520d (0x93df bytes) 2024-09-11T07:07:22.759 INFO:teuthology.orchestra.run.smithi079.stdout:4603 trunc from 0x788520e to 0xb1cf938 2024-09-11T07:07:22.780 INFO:teuthology.orchestra.run.smithi079.stdout:4604 trunc from 0xb1cf938 to 0xe14305e 2024-09-11T07:07:22.792 INFO:teuthology.orchestra.run.smithi079.stdout:4605 write 0x248a48c thru 0x249590c (0xb481 bytes) 2024-09-11T07:07:22.797 INFO:teuthology.orchestra.run.smithi079.stdout:4606 writesame 0xbb0a268 thru 0xbb1946b data_size 0x12(0xf204 bytes) 2024-09-11T07:07:22.806 INFO:teuthology.orchestra.run.smithi079.stdout:4608 write 0x33960d4 thru 0x339dcaf (0x7bdc bytes) 2024-09-11T07:07:22.809 INFO:teuthology.orchestra.run.smithi079.stdout:4609 punch from 0x866f2ea to 0x86701f3, (0xf09 bytes) 2024-09-11T07:07:22.810 INFO:teuthology.orchestra.run.smithi079.stdout:4610 write 0x4f94571 thru 0x4f9b946 (0x73d6 bytes) 2024-09-11T07:07:22.817 INFO:teuthology.orchestra.run.smithi079.stdout:4611 punch from 0xbe25354 to 0xbe2c88b, (0x7537 bytes) 2024-09-11T07:07:22.820 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:22.816+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:22.820 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:22.820 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:22.824 INFO:teuthology.orchestra.run.smithi079.stdout:4613 trunc from 0xe14305e to 0xb707ed5 2024-09-11T07:07:22.835 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:22.840 INFO:teuthology.orchestra.run.smithi079.stdout:4614 read 0x92dfd92 thru 0x92dfe6c (0xdb bytes) 2024-09-11T07:07:22.840 INFO:teuthology.orchestra.run.smithi079.stdout:4615 write 0x710d56d thru 0x710f965 (0x23f9 bytes) 2024-09-11T07:07:22.865 INFO:teuthology.orchestra.run.smithi079.stdout:4616 trunc from 0xb707ed5 to 0x309e930 2024-09-11T07:07:22.888 INFO:teuthology.orchestra.run.smithi079.stdout:4617 read 0x278f41f thru 0x279867c (0x925e bytes) 2024-09-11T07:07:22.888 INFO:teuthology.orchestra.run.smithi079.stdout:4619 read 0x20ba51 thru 0x21aa32 (0xefe2 bytes) 2024-09-11T07:07:22.889 INFO:teuthology.orchestra.run.smithi079.stdout:4620 read 0x210317c thru 0x210d0f8 (0x9f7d bytes) 2024-09-11T07:07:22.921 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:22.917+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:22.926 INFO:teuthology.orchestra.run.smithi079.stdout:4621 write 0xd157367 thru 0xd15c6be (0x5358 bytes) 2024-09-11T07:07:22.949 INFO:teuthology.orchestra.run.smithi079.stdout:4622 write 0xeb27859 thru 0xeb36935 (0xf0dd bytes) 2024-09-11T07:07:22.988 INFO:teuthology.orchestra.run.smithi079.stdout:4624 trunc from 0xeb36936 to 0x2424e89 2024-09-11T07:07:23.007 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:23.007 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:23.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:23.022 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:23.020+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:23.037 INFO:teuthology.orchestra.run.smithi079.stdout:4625 writesame 0x6938c4a thru 0x693ce64 data_size 0x1(0x421b bytes) 2024-09-11T07:07:23.037 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:23.038 INFO:teuthology.orchestra.run.smithi079.stdout:4627 read 0x89b2d3 thru 0x8a11d2 (0x5f00 bytes) 2024-09-11T07:07:23.058 INFO:teuthology.orchestra.run.smithi079.stdout:4628 write 0x892585d thru 0x892e002 (0x87a6 bytes) 2024-09-11T07:07:23.064 INFO:teuthology.orchestra.run.smithi079.stdout:4629 writesame 0x438fe2b thru 0x4398234 data_size 0x1(0x840a bytes) 2024-09-11T07:07:23.110 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-11T07:07:23.112 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:23.112 INFO:teuthology.orchestra.run.smithi079.stdout:4633 read 0x67af8fc thru 0x67b4b28 (0x522d bytes) 2024-09-11T07:07:23.123 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:23.117+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:23.125 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:07:23.130 INFO:teuthology.orchestra.run.smithi079.stdout:4634 trunc from 0x892e003 to 0x73dba8 2024-09-11T07:07:23.146 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:23.146 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:23.160 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:23.224 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:23.217+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:23.281 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:23.281 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:23.295 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:23.324 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:23.324+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:23.412 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:23.412 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:23.425 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:23.424+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:23.426 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:23.526 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:23.524+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:23.549 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:23.549 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:23.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:23.626 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:23.624+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:23.627 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:23.684 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:23.685 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:23.699 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:23.728 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:23.724+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:23.769 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:23.769 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:23.785 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:23.785 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:23.802 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:23.817 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:23.817 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:23.817 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:23.817 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:23.818 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:23.818 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:23.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:23.825+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:23.831 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:23.839 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:23.840 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:23.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:23.861 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:23.882 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:23.882 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:23.902 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:23.902 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:23.929 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:23.928+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:23.956 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:23.956 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:23.956 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:23.969 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:24.030 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:24.028+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:24.103 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:07:24.131 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:24.128+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:24.145 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:24.145 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:24.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46274 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5447680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813559879000003, 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042635002999999998, 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46274 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9800000000000004e-07 2024-09-11T07:07:24.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331645+0000", 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331652+0000", 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4159999999999998e-06 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331659+0000", 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2710000000000003e-06 2024-09-11T07:07:24.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374165+0000", 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042505493999999998 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374214+0000", 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8826999999999999e-05 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374277+0000", 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3145000000000006e-05 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46275 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5496832~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813534916999998, 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042748189999999998, 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.150 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46275 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:24.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331669+0000", 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2900000000000001e-06 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331686+0000", 2024-09-11T07:07:24.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6767999999999999e-05 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331693+0000", 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6599999999999998e-06 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374308+0000", 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042614919000000001 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374355+0000", 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7166000000000002e-05 2024-09-11T07:07:24.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374415+0000", 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9893999999999999e-05 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46276 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5545984~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813500490999999, 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042856001999999997, 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.154 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46276 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331702+0000", 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331704+0000", 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5629999999999999e-06 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331712+0000", 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9340000000000006e-06 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331720+0000", 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1049999999999995e-06 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374445+0000", 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042724597000000003 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374494+0000", 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9234999999999999e-05 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374557+0000", 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3058000000000005e-05 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46277 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5595136~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.158 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813450146000001, 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042946033000000002, 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46277 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:24.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331752+0000", 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2500000000000005e-07 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.160 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331755+0000", 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7e-06 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331763+0000", 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331777+0000", 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3749e-05 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374591+0000", 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042813898000000003 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374637+0000", 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6492000000000001e-05 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374697+0000", 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0222e-05 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.162 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46278 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5644288~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813415466999999, 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043078449999999997, 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46278 2024-09-11T07:07:24.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331787+0000", 2024-09-11T07:07:24.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9299999999999997e-07 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331789+0000", 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331797+0000", 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331804+0000", 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3010000000000001e-06 2024-09-11T07:07:24.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374743+0000", 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042938538999999998 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374800+0000", 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6637e-05 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374865+0000", 2024-09-11T07:07:24.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4906999999999994e-05 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46279 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5693440~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813389581000003, 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043192304000000001, 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.167 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46279 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1500000000000005e-07 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331815+0000", 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4080000000000001e-06 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331822+0000", 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3359999999999997e-06 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331831+0000", 2024-09-11T07:07:24.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4530000000000002e-06 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374897+0000", 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043066213999999998 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374944+0000", 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7292000000000001e-05 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375004+0000", 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0086e-05 2024-09-11T07:07:24.170 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46280 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5742592~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813359452999997, 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043330417000000003, 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46280 2024-09-11T07:07:24.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331843+0000", 2024-09-11T07:07:24.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331848+0000", 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5570000000000003e-06 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331857+0000", 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6689999999999995e-06 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331863+0000", 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0610000000000001e-06 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375049+0000", 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043186443999999997 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375104+0000", 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4821999999999998e-05 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375172+0000", 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8371e-05 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46281 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5791744~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813331191000003, 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043441781999999998, 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.175 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.176 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.176 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46281 2024-09-11T07:07:24.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.176 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:24.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331871+0000", 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9900000000000001e-07 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331873+0000", 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.458e-06 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331885+0000", 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1919999999999999e-05 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331891+0000", 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0950000000000001e-06 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375205+0000", 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043314084000000003 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375253+0000", 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8047000000000003e-05 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375312+0000", 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8678999999999998e-05 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46282 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5840896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813254077000003, 2024-09-11T07:07:24.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043532266999999999, 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46282 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331948+0000", 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7199999999999997e-07 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331952+0000", 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4479999999999999e-06 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331962+0000", 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7389999999999994e-06 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331968+0000", 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6789999999999999e-06 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375357+0000", 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043388559 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375413+0000", 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5971999999999999e-05 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375480+0000", 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6997999999999998e-05 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.183 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46283 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5890048~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813219136999997, 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043635858999999999, 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46283 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.184 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331983+0000", 2024-09-11T07:07:24.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3799999999999997e-07 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331985+0000", 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4990000000000001e-06 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331993+0000", 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9629999999999998e-06 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332003+0000", 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8199999999999992e-06 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375512+0000", 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043508865000000001 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375560+0000", 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8004999999999999e-05 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375618+0000", 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8168999999999998e-05 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46284 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5939200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813190749999997, 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043772483000000001, 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46284 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:24.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0699999999999997e-07 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332014+0000", 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4619999999999999e-06 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332021+0000", 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650000000000004e-06 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332029+0000", 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-06 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375663+0000", 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043634233000000001 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375717+0000", 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4209000000000002e-05 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375783+0000", 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6297000000000006e-05 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46285 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5988352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:24.192 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813164309000001, 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043885753, 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46285 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332038+0000", 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332040+0000", 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332048+0000", 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5830000000000001e-06 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332054+0000", 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0340000000000002e-06 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375817+0000", 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043762574999999998 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375865+0000", 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8637000000000002e-05 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375923+0000", 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7757000000000003e-05 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46286 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6037504~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813140122, 2024-09-11T07:07:24.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044027821000000002, 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46286 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332062+0000", 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332064+0000", 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2740000000000002e-06 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332073+0000", 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6719999999999993e-06 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332079+0000", 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8579999999999996e-06 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375967+0000", 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043888476000000003 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376022+0000", 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4208e-05 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376089+0000", 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7688000000000007e-05 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46287 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6086656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813090119999998, 2024-09-11T07:07:24.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044117732999999999, 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46287 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332112+0000", 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332115+0000", 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6680000000000001e-06 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332123+0000", 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3110000000000006e-06 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332129+0000", 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4230000000000002e-06 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376121+0000", 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043991816000000003 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376171+0000", 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9540999999999999e-05 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376229+0000", 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8328999999999997e-05 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46288 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6135808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813063765999999, 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044260648, 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46288 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7000000000000004e-07 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332141+0000", 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4449999999999999e-06 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332153+0000", 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1772e-05 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332159+0000", 2024-09-11T07:07:24.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376274+0000", 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044115170000000002 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376333+0000", 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9017000000000001e-05 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376398+0000", 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5506999999999995e-05 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46289 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6184960~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.813020393000002, 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044357445000000002, 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46289 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332182+0000", 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3200000000000005e-07 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332184+0000", 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332192+0000", 2024-09-11T07:07:24.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332200+0000", 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3170000000000004e-06 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376431+0000", 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044230923999999998 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376479+0000", 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8072999999999999e-05 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376539+0000", 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9789e-05 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46290 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6234112~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:24.213 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.812993785000003, 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044494765999999998, 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46290 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0100000000000005e-07 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332211+0000", 2024-09-11T07:07:24.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099999999999998e-06 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332222+0000", 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1443999999999999e-05 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332228+0000", 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376583+0000", 2024-09-11T07:07:24.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044355252999999997 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376639+0000", 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5278000000000002e-05 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376703+0000", 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3885000000000002e-05 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.217 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46291 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6283264~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.812965482999999, 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044598027999999998, 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46291 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:24.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332237+0000", 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332239+0000", 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4399999999999999e-06 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332246+0000", 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332253+0000", 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0379999999999996e-06 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376728+0000", 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044475317 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376777+0000", 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9475999999999999e-05 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376834+0000", 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6749999999999997e-05 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46955 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9379840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.597040288999999, 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042646256, 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46955 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.222 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3099999999999999e-07 2024-09-11T07:07:24.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548163+0000", 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.127e-06 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548166+0000", 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.179e-06 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548169+0000", 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8609999999999998e-06 2024-09-11T07:07:24.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590717+0000", 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042547883000000002 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590754+0000", 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.765e-05 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590808+0000", 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3325000000000002e-05 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.225 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46956 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9428992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 35.597029024999998, 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042772421999999997, 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46956 2024-09-11T07:07:24.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:07:24.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548174+0000", 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1790000000000001e-06 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548177+0000", 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2119999999999999e-06 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548180+0000", 2024-09-11T07:07:24.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7369999999999998e-06 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590827+0000", 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042647353999999998 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590886+0000", 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8968999999999997e-05 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590945+0000", 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8754e-05 2024-09-11T07:07:24.229 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.230 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.230 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.230 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.230 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:24.231 INFO:teuthology.orchestra.run.smithi079.stdout:4638 writesame 0xaad48a thru 0xab9bd8 data_size 0x25(0xc74f bytes) 2024-09-11T07:07:24.231 INFO:teuthology.orchestra.run.smithi079.stdout:4640 read 0x10284e thru 0x10ee51 (0xc604 bytes) 2024-09-11T07:07:24.231 INFO:teuthology.orchestra.run.smithi079.stdout:4641 read 0x5a16a0 thru 0x5a2513 (0xe74 bytes) 2024-09-11T07:07:24.231 INFO:teuthology.orchestra.run.smithi079.stdout:4642 read 0x21c92c thru 0x224284 (0x7959 bytes) 2024-09-11T07:07:24.232 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:24.233 INFO:teuthology.orchestra.run.smithi079.stdout:4644 writesame 0x911070a thru 0x9115834 data_size 0x1(0x512b bytes) 2024-09-11T07:07:24.233 INFO:teuthology.orchestra.run.smithi079.stdout:4645 read 0x83a2100 thru 0x83a251c (0x41d bytes) 2024-09-11T07:07:24.233 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:24.233 INFO:teuthology.orchestra.run.smithi079.stdout:4647 read 0x63e8dda thru 0x63f89d7 (0xfbfe bytes) 2024-09-11T07:07:24.234 INFO:teuthology.orchestra.run.smithi079.stdout:4650 read 0xe8dff1 thru 0xe957d9 (0x77e9 bytes) 2024-09-11T07:07:24.234 INFO:teuthology.orchestra.run.smithi079.stdout:4651 punch from 0x3d1353f to 0x3d1b68c, (0x814d bytes) 2024-09-11T07:07:24.234 INFO:teuthology.orchestra.run.smithi079.stdout:4653 read 0x1c09119 thru 0x1c15b82 (0xca6a bytes) 2024-09-11T07:07:24.234 INFO:teuthology.orchestra.run.smithi079.stdout:4654 punch from 0x1b9dc24 to 0x1ba4f2d, (0x7309 bytes) 2024-09-11T07:07:24.234 INFO:teuthology.orchestra.run.smithi079.stdout:4655 punch from 0x38019b to 0x38e116, (0xdf7b bytes) 2024-09-11T07:07:24.234 INFO:teuthology.orchestra.run.smithi079.stdout:4656 read 0x643a718 thru 0x643f85f (0x5148 bytes) 2024-09-11T07:07:24.234 INFO:teuthology.orchestra.run.smithi079.stdout:4657 read 0x8e41c26 thru 0x8e4c668 (0xaa43 bytes) 2024-09-11T07:07:24.234 INFO:teuthology.orchestra.run.smithi079.stdout:4658 writesame 0x2c6a091 thru 0x2c7643b data_size 0x3b(0xc3ab bytes) 2024-09-11T07:07:24.234 INFO:teuthology.orchestra.run.smithi079.stdout:4660 clone 38 order 24 su 65536 sc 6 2024-09-11T07:07:24.234 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:24.225+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:24.332 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:24.332+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:24.405 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:24.405 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:24.405 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:24.405 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:24.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:24.433 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:24.432+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:24.534 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:24.532+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:24.543 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:24.543 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:24.543 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:24.543 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:24.543 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:24.557 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:24.635 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:24.632+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:24.676 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:24.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:38225 3.0 e54/21 3:00593585:::rbd_data.11612bf90fc2.0000000000000001:head v 54'264, mlcod=51'262)", 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.199210682, 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095742440000000009, 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:24.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7800000000000001e-07 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478936+0000", 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032745610000000001 2024-09-11T07:07:24.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478959+0000", 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3553e-05 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478975+0000", 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5678000000000001e-05 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.479055+0000", 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9684000000000005e-05 2024-09-11T07:07:24.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.479085+0000", 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9782e-05 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.485183+0000", 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060982140000000002 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.485235+0000", 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2593999999999998e-05 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:41586 3.4 e58/21 3:278deab4:::rbd_data.11612bd38060.0000000000000000:head v 58'75, mlcod=53'73)", 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.865875895000002, 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080719699999999995, 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.681 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:24.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808999+0000", 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2830000000000002e-06 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810913+0000", 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001913402 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810949+0000", 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5954999999999997e-05 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810966+0000", 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7459e-05 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.811079+0000", 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113101 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.811118+0000", 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8937999999999999e-05 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.816962+0000", 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005843488 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.817068+0000", 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106344 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.685 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59289 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:head [stat,truncate 11010048] snapc 20=[20] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.659408640999999, 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024828697, 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.686 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59289 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015467+0000", 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6200000000000001e-06 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015483+0000", 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5962999999999999e-05 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015531+0000", 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7964999999999999e-05 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015554+0000", 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3493e-05 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015723+0000", 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169121 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016035+0000", 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031174000000000002 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016468+0000", 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043272900000000002 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.039067+0000", 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022598894000000001 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040107+0000", 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010398860000000001 2024-09-11T07:07:24.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040212+0000", 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010577399999999999 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040292+0000", 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9511999999999994e-05 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62059 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.877548514000001, 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080870200000000003, 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62059 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797324+0000", 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797325+0000", 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.175e-06 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797328+0000", 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3519999999999998e-06 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797331+0000", 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9359999999999999e-06 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805061+0000", 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0077296919999999998 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805212+0000", 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015180799999999999 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805410+0000", 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019783999999999999 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62084 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.877228651999999, 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081746579999999996, 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62084 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797644+0000", 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2399999999999996e-07 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797649+0000", 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1410000000000004e-06 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797662+0000", 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3142000000000001e-05 2024-09-11T07:07:24.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797671+0000", 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0599999999999997e-06 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805515+0000", 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078431270000000001 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805666+0000", 2024-09-11T07:07:24.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015186299999999999 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805818+0000", 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015140100000000001 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62085 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3244032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.877174065999998, 2024-09-11T07:07:24.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086787909999999999, 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62085 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:24.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8800000000000002e-07 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797702+0000", 2024-09-11T07:07:24.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4079999999999998e-06 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797714+0000", 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1833e-05 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797721+0000", 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1450000000000002e-06 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805934+0000", 2024-09-11T07:07:24.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008213471 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806175+0000", 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024039600000000001 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806377+0000", 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020185 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62086 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3309568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.877130867999998, 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089940209999999996, 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62086 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1699999999999998e-07 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797745+0000", 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2629999999999999e-06 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797757+0000", 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2214e-05 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797763+0000", 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.609e-06 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806471+0000", 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087085700000000005 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806589+0000", 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000117939 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806735+0000", 2024-09-11T07:07:24.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000145909 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62087 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3375104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.877088006000001, 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095423460000000002, 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.709 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62087 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.13e-07 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797788+0000", 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.349e-06 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797794+0000", 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4999999999999996e-06 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797800+0000", 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8080000000000001e-06 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806844+0000", 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090440060000000003 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807059+0000", 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021471000000000001 2024-09-11T07:07:24.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807326+0000", 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026746000000000002 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62088 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3440640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.877063215, 2024-09-11T07:07:24.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0097044639999999995, 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62088 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5400000000000002e-07 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797812+0000", 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3340000000000002e-06 2024-09-11T07:07:24.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797820+0000", 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1980000000000004e-06 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797825+0000", 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1429999999999997e-06 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807392+0000", 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095677420000000006 2024-09-11T07:07:24.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807443+0000", 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0179999999999997e-05 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807513+0000", 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0413000000000005e-05 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62089 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3506176~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.877041847000001, 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01023572, 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62089 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2500000000000001e-07 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797832+0000", 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4950000000000001e-06 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797836+0000", 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9899999999999999e-06 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797845+0000", 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0839999999999998e-06 2024-09-11T07:07:24.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807583+0000", 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0097380100000000001 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807802+0000", 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021865599999999999 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808066+0000", 2024-09-11T07:07:24.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026415999999999999 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62090 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.877012842999999, 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010367039, 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62090 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:24.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4700000000000002e-07 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797861+0000", 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8390000000000001e-06 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797866+0000", 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9150000000000004e-06 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797869+0000", 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1269999999999999e-06 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808092+0000", 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010222788999999999 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808151+0000", 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9456000000000001e-05 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808226+0000", 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4566000000000004e-05 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62091 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3637248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:24.726 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.876997670000002, 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010935996, 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62091 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5199999999999998e-07 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797876+0000", 2024-09-11T07:07:24.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.277e-06 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797879+0000", 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6890000000000002e-06 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797882+0000", 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6240000000000002e-06 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808306+0000", 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010423946999999999 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808440+0000", 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000133993 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808810+0000", 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000370214 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62116 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3194880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.876317884999999, 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010413343, 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62116 2024-09-11T07:07:24.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798556+0000", 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798581+0000", 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4556e-05 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798618+0000", 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7313e-05 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798632+0000", 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3226e-05 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808844+0000", 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01021238 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808898+0000", 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4534999999999999e-05 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808967+0000", 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8806999999999994e-05 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62117 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3260416~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.876175904, 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010787804999999999, 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.735 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62117 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798697+0000", 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3200000000000005e-07 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798700+0000", 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.517e-06 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798708+0000", 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798715+0000", 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9959999999999996e-06 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809045+0000", 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010329896 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809198+0000", 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015303499999999999 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809484+0000", 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000285968 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.739 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62118 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3325952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.876142989999998, 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010897328, 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62118 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798732+0000", 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0489999999999999e-06 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798740+0000", 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2359999999999998e-06 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798746+0000", 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4980000000000003e-06 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809512+0000", 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010766133000000001 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809560+0000", 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7927999999999999e-05 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809626+0000", 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6006000000000005e-05 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.743 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62119 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3391488~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.876117448999999, 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011339109, 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62119 2024-09-11T07:07:24.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798755+0000", 2024-09-11T07:07:24.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8100000000000001e-07 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798758+0000", 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5119999999999998e-06 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798781+0000", 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3175000000000001e-05 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798788+0000", 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9240000000000001e-06 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809715+0000", 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010927533 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809902+0000", 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000187111 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810093+0000", 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019097299999999999 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62120 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3457024~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.876072665999999, 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011832135000000001, 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.748 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62120 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798800+0000", 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6400000000000002e-07 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798804+0000", 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0419999999999996e-06 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798813+0000", 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6870000000000006e-06 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798819+0000", 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6810000000000003e-06 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810180+0000", 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011361069999999999 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810372+0000", 2024-09-11T07:07:24.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000191456 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810631+0000", 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025963499999999998 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62121 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3522560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.876044486000001, 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01236723, 2024-09-11T07:07:24.752 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62121 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798828+0000", 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798830+0000", 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-06 2024-09-11T07:07:24.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798839+0000", 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3019999999999995e-06 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798844+0000", 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2549999999999997e-06 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810713+0000", 2024-09-11T07:07:24.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011869151 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810925+0000", 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021164999999999999 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811195+0000", 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026976099999999998 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62122 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3588096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.876005558999999, 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012886078, 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62122 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.757 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798867+0000", 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.758 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798870+0000", 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0630000000000002e-06 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798878+0000", 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8669999999999994e-06 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798902+0000", 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4167000000000001e-05 2024-09-11T07:07:24.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811275+0000", 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012373454000000001 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811484+0000", 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020880000000000001 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811752+0000", 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026820099999999998 2024-09-11T07:07:24.760 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62123 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3653632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.875957181, 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013329191000000001, 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:24.761 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62123 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6300000000000004e-07 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798918+0000", 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0750000000000002e-06 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798926+0000", 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8839999999999994e-06 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:24.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798933+0000", 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0169999999999999e-06 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811830+0000", 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012896179000000001 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812072+0000", 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024236200000000001 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:24.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:24.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812244+0000", 2024-09-11T07:07:24.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017191099999999999 2024-09-11T07:07:24.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.765 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.765 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:24.765 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:24.765 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:24.766 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:24.767 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:24.764+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:24.867 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:24.864+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:24.897 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:24.897 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:24.897 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:24.897 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:24.911 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:24.968 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:24.965+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:25.028 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:25.028 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:25.028 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:25.028 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:25.028 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:25.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:25.070 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:25.068+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:25.171 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:25.165+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:25.218 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:25.218 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:25.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:25.218 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:25.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 47.591573553000003, 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59094 3.8 3:14e63fb1:::rbd_data.11616c31e2ad.0000000000000003:1e [read 4554752~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010752+0000", 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.205096369, 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037890938999999998, 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:25.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59094 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010752+0000", 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010752+0000", 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010753+0000", 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.077e-06 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010758+0000", 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0760000000000002e-06 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010776+0000", 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8068999999999999e-05 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010790+0000", 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3813e-05 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048527+0000", 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736727999999997 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048584+0000", 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7049999999999998e-05 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048643+0000", 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9126000000000003e-05 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59112 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5537792~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010819+0000", 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.205029138, 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038152713999999997, 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59112 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010819+0000", 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010819+0000", 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010821+0000", 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2300000000000001e-06 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010826+0000", 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7590000000000003e-06 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010844+0000", 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.787e-05 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010858+0000", 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3633e-05 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048699+0000", 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037841125000000003 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048837+0000", 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013833300000000001 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.048972+0000", 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000134764 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59115 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.204972000000001, 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038255633999999997, 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.232 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59115 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:25.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010877+0000", 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.083e-06 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010885+0000", 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0400000000000004e-06 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010931+0000", 2024-09-11T07:07:25.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6452000000000002e-05 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010947+0000", 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5786000000000001e-05 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049022+0000", 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038075472999999999 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:25.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049076+0000", 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4131000000000001e-05 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049132+0000", 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5668999999999998e-05 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59119 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.20488035, 2024-09-11T07:07:25.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038492673999999998, 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59119 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010969+0000", 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010976+0000", 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4529999999999999e-06 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010994+0000", 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8672999999999999e-05 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011009+0000", 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4122e-05 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049189+0000", 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038180218000000002 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049342+0000", 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015341899999999999 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049461+0000", 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118522 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59138 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.240 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.204821535000001, 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038631255000000003, 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59138 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:25.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011028+0000", 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011034+0000", 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011049+0000", 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5702999999999999e-05 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011063+0000", 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3373000000000001e-05 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049512+0000", 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038449050999999998 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049601+0000", 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9395999999999996e-05 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049658+0000", 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6861999999999999e-05 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59147 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.204582853000002, 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038436533000000002, 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59147 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011267+0000", 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.46e-06 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011278+0000", 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.119e-05 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011457+0000", 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017874699999999999 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011481+0000", 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4283000000000001e-05 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049693+0000", 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038212053000000003 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049702+0000", 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59148 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.248 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.204325675, 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038227694999999999, 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59148 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011525+0000", 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011536+0000", 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011561+0000", 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5494999999999999e-05 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011579+0000", 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7292999999999999e-05 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049739+0000", 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038159803999999999 2024-09-11T07:07:25.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049750+0000", 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59149 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.204244364000001, 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038196747000000003, 2024-09-11T07:07:25.252 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59149 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011605+0000", 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011614+0000", 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3219999999999993e-06 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011634+0000", 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0703000000000002e-05 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011649+0000", 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4603000000000001e-05 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049788+0000", 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038138500999999998 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049801+0000", 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3244000000000001e-05 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59150 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.204178342999999, 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038171956999999999, 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59150 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011671+0000", 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011678+0000", 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011696+0000", 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-05 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011710+0000", 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3516000000000001e-05 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049835+0000", 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038125004999999997 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049842+0000", 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0299999999999996e-06 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59151 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011729+0000", 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.204119220999999, 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038150892999999998, 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.260 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59151 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011729+0000", 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011729+0000", 2024-09-11T07:07:25.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011730+0000", 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.136e-06 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011736+0000", 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0170000000000002e-06 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011754+0000", 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7765999999999999e-05 2024-09-11T07:07:25.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011768+0000", 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3546e-05 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049872+0000", 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038104449999999998 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049880+0000", 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9780000000000005e-06 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59152 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011787+0000", 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.204061252999999, 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038145537, 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.264 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59152 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011787+0000", 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011787+0000", 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011789+0000", 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011795+0000", 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000001e-06 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011812+0000", 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7042e-05 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011826+0000", 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3803e-05 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049921+0000", 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038095496 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049933+0000", 2024-09-11T07:07:25.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1476e-05 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59153 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.204003572000001, 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038163669999999997, 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.268 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59153 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011846+0000", 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1939999999999999e-06 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011853+0000", 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6030000000000001e-06 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011870+0000", 2024-09-11T07:07:25.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7739000000000001e-05 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011884+0000", 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.402e-05 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049993+0000", 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038108988000000003 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050009+0000", 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5126000000000001e-05 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59154 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.203942634000001, 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038170655999999997, 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.272 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59154 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011907+0000", 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1739999999999999e-06 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011974+0000", 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7200999999999996e-05 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011995+0000", 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1058999999999999e-05 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012015+0000", 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9857e-05 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050060+0000", 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038045074999999998 2024-09-11T07:07:25.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050076+0000", 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6290000000000002e-05 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59159 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.012037+0000", 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.203811486999999, 2024-09-11T07:07:25.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038100551000000003, 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59159 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012037+0000", 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012037+0000", 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012038+0000", 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.209e-06 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012044+0000", 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2140000000000001e-06 2024-09-11T07:07:25.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012063+0000", 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8284999999999999e-05 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012076+0000", 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3105000000000001e-05 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050123+0000", 2024-09-11T07:07:25.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038047046000000001 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050137+0000", 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4691999999999999e-05 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59166 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.012104+0000", 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.203744148999998, 2024-09-11T07:07:25.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038101007999999999, 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59166 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012104+0000", 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012104+0000", 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012105+0000", 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.006e-06 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012111+0000", 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6590000000000004e-06 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012128+0000", 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7507999999999999e-05 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012145+0000", 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6511000000000002e-05 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050189+0000", 2024-09-11T07:07:25.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038043862999999997 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050205+0000", 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6461e-05 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.284 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59168 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.012163+0000", 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.203684914, 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038107475000000002, 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59168 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012163+0000", 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012163+0000", 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012165+0000", 2024-09-11T07:07:25.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1769999999999999e-06 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012171+0000", 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2659999999999998e-06 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012193+0000", 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2268000000000001e-05 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012208+0000", 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4382000000000001e-05 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050257+0000", 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038049080999999998 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050271+0000", 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4301000000000001e-05 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.288 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59172 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.012225+0000", 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.203623007000001, 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038113712000000001, 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59172 2024-09-11T07:07:25.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012225+0000", 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012225+0000", 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012227+0000", 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.108e-06 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012232+0000", 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9089999999999997e-06 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012253+0000", 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0412999999999999e-05 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012267+0000", 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4483e-05 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050323+0000", 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038056081999999998 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050339+0000", 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5716999999999999e-05 2024-09-11T07:07:25.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:70560 3.2 3:459eba64:::rbd_data.11618cc4d69.000000000000003a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-11T07:07:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.7557120299999998, 2024-09-11T07:07:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064825956000000004, 2024-09-11T07:07:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.293 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 70560 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460139+0000", 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460150+0000", 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0824e-05 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460178+0000", 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8449000000000002e-05 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460199+0000", 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1075999999999999e-05 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460319+0000", 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119714 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460451+0000", 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013264 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.472543+0000", 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091437 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524779+0000", 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052236339 2024-09-11T07:07:25.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524853+0000", 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524913+0000", 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0825000000000001e-05 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524962+0000", 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8999999999999998e-05 2024-09-11T07:07:25.298 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71632 3.18 3:194b1b54:::rbd_data.1161b94a6d64.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 5.7734547039999997, 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039963481000000002, 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:25.299 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71632 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:25.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442395+0000", 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442403+0000", 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6210000000000004e-06 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:25.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442416+0000", 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3011e-05 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442422+0000", 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2620000000000004e-06 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442495+0000", 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2977000000000003e-05 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442647+0000", 2024-09-11T07:07:25.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015205199999999999 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.450708+0000", 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080612589999999994 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482090+0000", 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031381543999999997 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:25.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482176+0000", 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6302000000000001e-05 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482279+0000", 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010242399999999999 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482357+0000", 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8565000000000004e-05 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:25.305 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:25.305 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:25.306 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:25.307 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone37 from 0x9115835 (overlap 0x5e2adb) to 0x12d55f 2024-09-11T07:07:25.307 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:25.301+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:25.378 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #36, image image_client.0-clone36 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent37 2024-09-11T07:07:25.407 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:25.404+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:25.416 INFO:teuthology.orchestra.run.smithi079.stdout:4661 punch from 0x8f3db35 to 0x8f48422, (0xa8ed bytes) 2024-09-11T07:07:25.426 INFO:teuthology.orchestra.run.smithi079.stdout:4662 read 0x7ac7311 thru 0x7acd593 (0x6283 bytes) 2024-09-11T07:07:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:25.443 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:25.443 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:25.443 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:25.451 INFO:teuthology.orchestra.run.smithi079.stdout:4664 write 0xd46e823 thru 0xd478205 (0x99e3 bytes) 2024-09-11T07:07:25.458 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:25.459 INFO:teuthology.orchestra.run.smithi079.stdout:4666 write 0x10d4ba3 thru 0x10dcb64 (0x7fc2 bytes) 2024-09-11T07:07:25.490 INFO:teuthology.orchestra.run.smithi079.stdout:4667 trunc from 0xd478206 to 0xc9fa424 2024-09-11T07:07:25.508 INFO:teuthology.orchestra.run.smithi079.stdout:4669 read 0x6309fbd thru 0x630ce14 (0x2e58 bytes) 2024-09-11T07:07:25.508 INFO:teuthology.orchestra.run.smithi079.stdout:4670 read 0x1fa0baf thru 0x1fa4378 (0x37ca bytes) 2024-09-11T07:07:25.527 INFO:teuthology.orchestra.run.smithi079.stdout:4671 write 0xea3ab5f thru 0xea411dd (0x667f bytes) 2024-09-11T07:07:25.533 INFO:teuthology.orchestra.run.smithi079.stdout:4672 writesame 0x66b7885 thru 0x66c63af data_size 0xd(0xeb2b bytes) 2024-09-11T07:07:25.544 INFO:teuthology.orchestra.run.smithi079.stdout:4673 write 0x22507d1 thru 0x225541f (0x4c4f bytes) 2024-09-11T07:07:25.545 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:25.544+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:25.574 INFO:teuthology.orchestra.run.smithi079.stdout:4674 write 0x22f6880 thru 0x23035c9 (0xcd4a bytes) 2024-09-11T07:07:25.609 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:25.605+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:25.630 INFO:teuthology.orchestra.run.smithi079.stdout:4675 write 0x43d918d thru 0x43e029b (0x710f bytes) 2024-09-11T07:07:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:25.643 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:25.657 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:25.660 INFO:teuthology.orchestra.run.smithi079.stdout:4676 read 0x7ef934 thru 0x7f78ca (0x7f97 bytes) 2024-09-11T07:07:25.661 INFO:teuthology.orchestra.run.smithi079.stdout:4677 punch from 0x9eacda to 0x9ee889, (0x3baf bytes) 2024-09-11T07:07:25.661 INFO:teuthology.orchestra.run.smithi079.stdout:4678 read 0x245d7e6 thru 0x2465f98 (0x87b3 bytes) 2024-09-11T07:07:25.662 INFO:teuthology.orchestra.run.smithi079.stdout:4680 write 0x8f3d5d thru 0x903d25 (0xffc9 bytes) 2024-09-11T07:07:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:4682 punch from 0x9d472e3 to 0x9d52800, (0xb51d bytes) 2024-09-11T07:07:25.665 INFO:teuthology.orchestra.run.smithi079.stdout:4685 write 0xca0f859 thru 0xca1978c (0x9f34 bytes) 2024-09-11T07:07:25.669 INFO:teuthology.orchestra.run.smithi079.stdout:4686 write 0x9d3c849 thru 0x9d45684 (0x8e3c bytes) 2024-09-11T07:07:25.693 INFO:teuthology.orchestra.run.smithi079.stdout:4687 trunc from 0xea411de to 0x89bf608 2024-09-11T07:07:25.719 INFO:teuthology.orchestra.run.smithi079.stdout:4688 read 0x886b472 thru 0x887702c (0xbbbb bytes) 2024-09-11T07:07:25.720 INFO:teuthology.orchestra.run.smithi079.stdout:4689 write 0x2ebbf86 thru 0x2ec5ab1 (0x9b2c bytes) 2024-09-11T07:07:25.744 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:25.744+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:25.751 INFO:teuthology.orchestra.run.smithi079.stdout:4690 read 0x7d0130d thru 0x7d0ce44 (0xbb38 bytes) 2024-09-11T07:07:25.752 INFO:teuthology.orchestra.run.smithi079.stdout:4691 read 0x60f106 thru 0x615780 (0x667b bytes) 2024-09-11T07:07:25.780 INFO:teuthology.orchestra.run.smithi079.stdout:4692 write 0xd258aee thru 0xd25b2ca (0x27dd bytes) 2024-09-11T07:07:25.785 INFO:teuthology.orchestra.run.smithi079.stdout:4693 write 0xa8608c5 thru 0xa864193 (0x38cf bytes) 2024-09-11T07:07:25.788 INFO:teuthology.orchestra.run.smithi079.stdout:4694 read 0x2657a71 thru 0x26604e9 (0x8a79 bytes) 2024-09-11T07:07:25.789 INFO:teuthology.orchestra.run.smithi079.stdout:4695 read 0x9e02849 thru 0x9e103e9 (0xdba1 bytes) 2024-09-11T07:07:25.790 INFO:teuthology.orchestra.run.smithi079.stdout:4696 writesame 0x7b2b551 thru 0x7b38d82 data_size 0x1(0xd832 bytes) 2024-09-11T07:07:25.811 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:25.808+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:25.827 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:25.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.538070746999999, 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:07:25.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:25.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.832 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.537998664, 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.836 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.537943171000002, 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:07:25.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:07:25.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:07:25.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:07:25.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.336071203000003, 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:07:25.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.845 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.336008612999997, 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:07:25.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.335951557000001, 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:07:25.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.335895440000002, 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.855 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:07:25.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:07:25.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.335774178000001, 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:07:25.860 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:07:25.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.335669909000003, 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.865 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:07:25.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.869 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.33556437, 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.870 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:07:25.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:07:25.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:07:25.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:07:25.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.335497207000003, 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.875 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.876 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:07:25.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.876 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:25.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:07:25.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.879 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.335398001000001, 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.880 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:07:25.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.881 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:25.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.335311042000001, 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:25.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:25.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:07:25.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:07:25.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:07:25.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:25.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:07:25.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:07:25.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.335250764999998, 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.891 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:25.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:25.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:07:25.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:07:25.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:07:25.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:07:25.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:07:25.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:07:25.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:07:25.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.335097060000003, 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:25.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:07:25.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:07:25.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.335009884000002, 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:07:25.901 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:25.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:07:25.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:07:25.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:07:25.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.334945980999997, 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:07:25.906 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:25.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:07:25.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:07:25.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:25.911 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.334886138000002, 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:07:25.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:07:25.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:07:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:07:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:07:25.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:25.916 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.334808056, 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:07:25.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:07:25.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:07:25.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:07:25.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:07:25.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:07:25.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:07:25.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.921 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.334750286000002, 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:25.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:07:25.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:07:25.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:25.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:07:25.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:07:25.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:25.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:07:25.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:25.927 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:25.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:25.930 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:25.931 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:25.928+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:25.931 INFO:teuthology.orchestra.run.smithi079.stdout:4697 read 0x2cfacd4 thru 0x2d042e8 (0x9615 bytes) 2024-09-11T07:07:25.931 INFO:teuthology.orchestra.run.smithi079.stdout:4698 read 0xcb57be5 thru 0xcb5b847 (0x3c63 bytes) 2024-09-11T07:07:25.931 INFO:teuthology.orchestra.run.smithi079.stdout:4699 writesame 0x25fb47e thru 0x2600332 data_size 0x1(0x4eb5 bytes) 2024-09-11T07:07:25.931 INFO:teuthology.orchestra.run.smithi079.stdout:4700 read 0x638ba15 thru 0x638c897 (0xe83 bytes) 2024-09-11T07:07:25.931 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:25.931 INFO:teuthology.orchestra.run.smithi079.stdout:4702 trunc from 0xd25b2cb to 0x3e31748 2024-09-11T07:07:25.931 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:25.932 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:25.932 INFO:teuthology.orchestra.run.smithi079.stdout:4705 trunc from 0x3e31748 to 0x2d1abf 2024-09-11T07:07:25.956 INFO:teuthology.orchestra.run.smithi079.stdout:4706 write 0x29d59af thru 0x29e585b (0xfead bytes) 2024-09-11T07:07:25.987 INFO:teuthology.orchestra.run.smithi079.stdout:4707 writesame 0x9a204c3 thru 0x9a20ba4 data_size 0x1(0x6e2 bytes) 2024-09-11T07:07:25.987 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:25.987 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:25.987 INFO:teuthology.orchestra.run.smithi079.stdout:4711 read 0x49969ca thru 0x499ecd9 (0x8310 bytes) 2024-09-11T07:07:25.987 INFO:teuthology.orchestra.run.smithi079.stdout:4712 read 0x1164485 thru 0x116e589 (0xa105 bytes) 2024-09-11T07:07:25.988 INFO:teuthology.orchestra.run.smithi079.stdout:4713 writesame 0x4df2bf3 thru 0x4e0031c data_size 0x1(0xd72a bytes) 2024-09-11T07:07:26.029 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:26.025+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:26.032 INFO:teuthology.orchestra.run.smithi079.stdout:4714 trunc from 0x9a20ba5 to 0x637bfa6 2024-09-11T07:07:26.054 INFO:teuthology.orchestra.run.smithi079.stdout:4715 write 0x69e0ca8 thru 0x69f052f (0xf888 bytes) 2024-09-11T07:07:26.061 INFO:teuthology.orchestra.run.smithi079.stdout:4716 writesame 0x2885823 thru 0x288bfab data_size 0x39(0x6789 bytes) 2024-09-11T07:07:26.077 INFO:teuthology.orchestra.run.smithi079.stdout:4718 write 0xa2c5314 thru 0xa2d3864 (0xe551 bytes) 2024-09-11T07:07:26.084 INFO:teuthology.orchestra.run.smithi079.stdout:4719 punch from 0x8043168 to 0x8045ff6, (0x2e8e bytes) 2024-09-11T07:07:26.084 INFO:teuthology.orchestra.run.smithi079.stdout:4720 writesame 0x2f5bbf9 thru 0x2f69e66 data_size 0x3(0xe26e bytes) 2024-09-11T07:07:26.086 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:26.086 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:26.097 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.103 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:26.103 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:26.110 INFO:teuthology.orchestra.run.smithi079.stdout:4722 trunc from 0xa2d3865 to 0x13c70ab 2024-09-11T07:07:26.111 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:26.111 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:26.111 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:26.121 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:26.121 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:26.127 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:07:26.129 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:26.131 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:26.125+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:26.140 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:26.140 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:26.155 INFO:teuthology.orchestra.run.smithi079.stdout:4723 write 0xb50a43a thru 0xb51a373 (0xff3a bytes) 2024-09-11T07:07:26.160 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:26.160 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:26.160 INFO:teuthology.orchestra.run.smithi079.stdout:4724 writesame 0x6abcbf0 thru 0x6ac6284 data_size 0x1(0x9695 bytes) 2024-09-11T07:07:26.178 INFO:teuthology.orchestra.run.smithi079.stdout:4726 punch from 0x7b85391 to 0x7b8e173, (0x8de2 bytes) 2024-09-11T07:07:26.179 INFO:teuthology.orchestra.run.smithi079.stdout:4728 write 0x1a6dc9d thru 0x1a6e976 (0xcda bytes) 2024-09-11T07:07:26.180 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:26.180 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:26.187 INFO:teuthology.orchestra.run.smithi079.stdout:4729 write 0xbf8b705 thru 0xbf97974 (0xc270 bytes) 2024-09-11T07:07:26.189 INFO:teuthology.orchestra.run.smithi079.stdout:4731 read 0x748f262 thru 0x749434c (0x50eb bytes) 2024-09-11T07:07:26.198 INFO:teuthology.orchestra.run.smithi079.stdout:4732 write 0xd691314 thru 0xd695a2c (0x4719 bytes) 2024-09-11T07:07:26.201 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:26.201 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:26.202 INFO:teuthology.orchestra.run.smithi079.stdout:4733 read 0xbc098fb thru 0xbc17b0b (0xe211 bytes) 2024-09-11T07:07:26.203 INFO:teuthology.orchestra.run.smithi079.stdout:4734 flatten 2024-09-11T07:07:26.211 INFO:teuthology.orchestra.run.smithi079.stdout:4735 punch from 0x6ff5978 to 0x70014bf, (0xbb47 bytes) 2024-09-11T07:07:26.215 INFO:teuthology.orchestra.run.smithi079.stdout:4736 trunc from 0xd695a2d to 0xa8e5d86 2024-09-11T07:07:26.220 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:26.221 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:26.231 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:26.228+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:26.232 INFO:teuthology.orchestra.run.smithi079.stdout:4737 write 0x5e0f853 thru 0x5e1460a (0x4db8 bytes) 2024-09-11T07:07:26.235 INFO:teuthology.orchestra.run.smithi079.stdout:4740 punch from 0x5f89acd to 0x5f89d3b, (0x26e bytes) 2024-09-11T07:07:26.235 INFO:teuthology.orchestra.run.smithi079.stdout:4741 write 0x364b527 thru 0x36549e1 (0x94bb bytes) 2024-09-11T07:07:26.237 INFO:teuthology.orchestra.run.smithi079.stdout:4742 read 0x25d61dd thru 0x25e4648 (0xe46c bytes) 2024-09-11T07:07:26.237 INFO:teuthology.orchestra.run.smithi079.stdout:4744 read 0x36622f3 thru 0x3663293 (0xfa1 bytes) 2024-09-11T07:07:26.238 INFO:teuthology.orchestra.run.smithi079.stdout:4747 writesame 0xa0d50de thru 0xa0d6435 data_size 0x4(0x1358 bytes) 2024-09-11T07:07:26.240 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.240 INFO:teuthology.orchestra.run.smithi079.stdout:4750 read 0x1a0c3f3 thru 0x1a160ad (0x9cbb bytes) 2024-09-11T07:07:26.241 INFO:teuthology.orchestra.run.smithi079.stdout:4751 write 0x16bb06c thru 0x16c62cd (0xb262 bytes) 2024-09-11T07:07:26.243 INFO:teuthology.orchestra.run.smithi079.stdout:4752 writesame 0x671df8 thru 0x67979b data_size 0x5a(0x79a4 bytes) 2024-09-11T07:07:26.254 INFO:teuthology.orchestra.run.smithi079.stdout:4753 write 0xc830f47 thru 0xc837d2b (0x6de5 bytes) 2024-09-11T07:07:26.262 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:26.262 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:26.276 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:26.277 INFO:teuthology.orchestra.run.smithi079.stdout:4754 trunc from 0xc837d2c to 0x564bea 2024-09-11T07:07:26.295 INFO:teuthology.orchestra.run.smithi079.stdout:4755 read 0x534606 thru 0x539703 (0x50fe bytes) 2024-09-11T07:07:26.300 INFO:teuthology.orchestra.run.smithi079.stdout:4756 trunc from 0x564bea to 0x4141678 2024-09-11T07:07:26.307 INFO:teuthology.orchestra.run.smithi079.stdout:4757 punch from 0x2843661 to 0x284dc0a, (0xa5a9 bytes) 2024-09-11T07:07:26.308 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.308 INFO:teuthology.orchestra.run.smithi079.stdout:4759 write 0x126105f thru 0x126e150 (0xd0f2 bytes) 2024-09-11T07:07:26.320 INFO:teuthology.orchestra.run.smithi079.stdout:4760 trunc from 0x4141678 to 0xb7d88eb 2024-09-11T07:07:26.341 INFO:teuthology.orchestra.run.smithi079.stdout:4762 write 0xdfafed0 thru 0xdfb0e4d (0xf7e bytes) 2024-09-11T07:07:26.363 INFO:teuthology.orchestra.run.smithi079.stdout:4763 trunc from 0xdfb0e4e to 0xa4b44a 2024-09-11T07:07:26.368 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:26.368+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:26.383 INFO:teuthology.orchestra.run.smithi079.stdout:4764 read 0x216924 thru 0x220d4a (0xa427 bytes) 2024-09-11T07:07:26.384 INFO:teuthology.orchestra.run.smithi079.stdout:4765 read 0x46bc68 thru 0x478d61 (0xd0fa bytes) 2024-09-11T07:07:26.393 INFO:teuthology.orchestra.run.smithi079.stdout:4766 writesame 0xd8abb0 thru 0xd95197 data_size 0x4(0xa5e8 bytes) 2024-09-11T07:07:26.425 INFO:teuthology.orchestra.run.smithi079.stdout:4767 writesame 0xb51b5f7 thru 0xb5200fc data_size 0x61(0x4b06 bytes) 2024-09-11T07:07:26.425 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.429 INFO:teuthology.orchestra.run.smithi079.stdout:4769 trunc from 0xb5200fd to 0xdba2ff0 2024-09-11T07:07:26.432 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:26.432+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:26.438 INFO:teuthology.orchestra.run.smithi079.stdout:4770 read 0x79a21de thru 0x79b0637 (0xe45a bytes) 2024-09-11T07:07:26.438 INFO:teuthology.orchestra.run.smithi079.stdout:4772 read 0x569de99 thru 0x56a2091 (0x41f9 bytes) 2024-09-11T07:07:26.439 INFO:teuthology.orchestra.run.smithi079.stdout:4773 write 0x9a4a680 thru 0x9a59f4d (0xf8ce bytes) 2024-09-11T07:07:26.446 INFO:teuthology.orchestra.run.smithi079.stdout:4774 writesame 0x2ae3cc4 thru 0x2ae8458 data_size 0x5(0x4795 bytes) 2024-09-11T07:07:26.450 INFO:teuthology.orchestra.run.smithi079.stdout:4775 read 0xb743be9 thru 0xb748e6e (0x5286 bytes) 2024-09-11T07:07:26.450 INFO:teuthology.orchestra.run.smithi079.stdout:4776 writesame 0x754153b thru 0x7545e5e data_size 0x4(0x4924 bytes) 2024-09-11T07:07:26.457 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:26.457 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:26.458 INFO:teuthology.orchestra.run.smithi079.stdout:4778 punch from 0x9c0e901 to 0x9c1515f, (0x685e bytes) 2024-09-11T07:07:26.472 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:26.488 INFO:teuthology.orchestra.run.smithi079.stdout:4779 trunc from 0xdba2ff0 to 0x456e6a 2024-09-11T07:07:26.507 INFO:teuthology.orchestra.run.smithi079.stdout:4780 read 0x18f27c thru 0x19e732 (0xf4b7 bytes) 2024-09-11T07:07:26.532 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:26.529+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:26.538 INFO:teuthology.orchestra.run.smithi079.stdout:4782 write 0x9608932 thru 0x960e35a (0x5a29 bytes) 2024-09-11T07:07:26.543 INFO:teuthology.orchestra.run.smithi079.stdout:4783 punch from 0x3045ee0 to 0x304cf64, (0x7084 bytes) 2024-09-11T07:07:26.543 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.566 INFO:teuthology.orchestra.run.smithi079.stdout:4785 writesame 0xe696cfa thru 0xe6a364c data_size 0x1(0xc953 bytes) 2024-09-11T07:07:26.590 INFO:teuthology.orchestra.run.smithi079.stdout:4786 trunc from 0xe6a364d to 0x38d1fcb 2024-09-11T07:07:26.617 INFO:teuthology.orchestra.run.smithi079.stdout:4787 read 0x34a6155 thru 0x34aa0da (0x3f86 bytes) 2024-09-11T07:07:26.618 INFO:teuthology.orchestra.run.smithi079.stdout:4790 read 0x25c7fe8 thru 0x25d0cd7 (0x8cf0 bytes) 2024-09-11T07:07:26.619 INFO:teuthology.orchestra.run.smithi079.stdout:4792 writesame 0x125b3f1 thru 0x1265bea data_size 0x9(0xa7fa bytes) 2024-09-11T07:07:26.627 INFO:teuthology.orchestra.run.smithi079.stdout:4793 punch from 0x2a489be to 0x2a4d87a, (0x4ebc bytes) 2024-09-11T07:07:26.629 INFO:teuthology.orchestra.run.smithi079.stdout:4794 trunc from 0x38d1fcb to 0x4780842 2024-09-11T07:07:26.633 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:26.629+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:26.643 INFO:teuthology.orchestra.run.smithi079.stdout:4795 read 0x2d52480 thru 0x2d5df09 (0xba8a bytes) 2024-09-11T07:07:26.645 INFO:teuthology.orchestra.run.smithi079.stdout:4796 read 0x217ecd2 thru 0x218a516 (0xb845 bytes) 2024-09-11T07:07:26.646 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:26.646 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:26.660 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:26.669 INFO:teuthology.orchestra.run.smithi079.stdout:4797 write 0x7afe6aa thru 0x7b081c9 (0x9b20 bytes) 2024-09-11T07:07:26.676 INFO:teuthology.orchestra.run.smithi079.stdout:4798 read 0x1d17e59 thru 0x1d247ae (0xc956 bytes) 2024-09-11T07:07:26.698 INFO:teuthology.orchestra.run.smithi079.stdout:4799 write 0xaf74933 thru 0xaf7c8a3 (0x7f71 bytes) 2024-09-11T07:07:26.700 INFO:teuthology.orchestra.run.smithi079.stdout:4801 write 0x6bb3d55 thru 0x6bb64f7 (0x27a3 bytes) 2024-09-11T07:07:26.707 INFO:teuthology.orchestra.run.smithi079.stdout:4802 read 0x36aafac thru 0x36b9b37 (0xeb8c bytes) 2024-09-11T07:07:26.708 INFO:teuthology.orchestra.run.smithi079.stdout:4803 read 0x6bf673d thru 0x6c01d28 (0xb5ec bytes) 2024-09-11T07:07:26.710 INFO:teuthology.orchestra.run.smithi079.stdout:4805 punch from 0xa4aa62e to 0xa4b589d, (0xb26f bytes) 2024-09-11T07:07:26.710 INFO:teuthology.orchestra.run.smithi079.stdout:4807 read 0xb8971b thru 0xb8a3e9 (0xccf bytes) 2024-09-11T07:07:26.710 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.710 INFO:teuthology.orchestra.run.smithi079.stdout:4809 punch from 0x78062d4 to 0x7810bc6, (0xa8f2 bytes) 2024-09-11T07:07:26.726 INFO:teuthology.orchestra.run.smithi079.stdout:4810 write 0xc25a407 thru 0xc2672e1 (0xcedb bytes) 2024-09-11T07:07:26.734 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:26.729+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:26.735 INFO:teuthology.orchestra.run.smithi079.stdout:4811 read 0x53592b4 thru 0x53667e9 (0xd536 bytes) 2024-09-11T07:07:26.736 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.755 INFO:teuthology.orchestra.run.smithi079.stdout:4815 trunc from 0xc2672e2 to 0x4cb1a20 2024-09-11T07:07:26.783 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:26.784 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:26.784 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:26.808 INFO:teuthology.orchestra.run.smithi079.stdout:4818 trunc from 0x4cb1a20 to 0xdad5338 2024-09-11T07:07:26.820 INFO:teuthology.orchestra.run.smithi079.stdout:4819 write 0xd69d13b thru 0xd6a8e27 (0xbced bytes) 2024-09-11T07:07:26.829 INFO:teuthology.orchestra.run.smithi079.stdout:4821 writesame 0xa2c4ea8 thru 0xa2cfafd data_size 0x39(0xac56 bytes) 2024-09-11T07:07:26.834 INFO:teuthology.orchestra.run.smithi079.stdout:4822 write 0x3aeb06 thru 0x3b8540 (0x9a3b bytes) 2024-09-11T07:07:26.837 INFO:teuthology.orchestra.run.smithi079.stdout:4823 read 0x9f15836 thru 0x9f225a9 (0xcd74 bytes) 2024-09-11T07:07:26.837 INFO:teuthology.orchestra.run.smithi079.stdout:4824 punch from 0x96799ef to 0x9685eed, (0xc4fe bytes) 2024-09-11T07:07:26.838 INFO:teuthology.orchestra.run.smithi079.stdout:4825 writesame 0x39e1a66 thru 0x39e9c68 data_size 0x1(0x8203 bytes) 2024-09-11T07:07:26.844 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:26.844+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:26.858 INFO:teuthology.orchestra.run.smithi079.stdout:4826 punch from 0xa829b7b to 0xa8374e4, (0xd969 bytes) 2024-09-11T07:07:26.858 INFO:teuthology.orchestra.run.smithi079.stdout:4827 read 0xa5e7700 thru 0xa5e9362 (0x1c63 bytes) 2024-09-11T07:07:26.858 INFO:teuthology.orchestra.run.smithi079.stdout:4828 write 0x17116db thru 0x171e956 (0xd27c bytes) 2024-09-11T07:07:26.861 INFO:teuthology.orchestra.run.smithi079.stdout:4832 write 0x444c771 thru 0x444eb57 (0x23e7 bytes) 2024-09-11T07:07:26.863 INFO:teuthology.orchestra.run.smithi079.stdout:4834 write 0x5760e2b thru 0x576923a (0x8410 bytes) 2024-09-11T07:07:26.867 INFO:teuthology.orchestra.run.smithi079.stdout:4835 write 0x8b8d6f9 thru 0x8b982bf (0xabc7 bytes) 2024-09-11T07:07:26.875 INFO:teuthology.orchestra.run.smithi079.stdout:4836 writesame 0x7970ded thru 0x7974134 data_size 0x18(0x3348 bytes) 2024-09-11T07:07:26.880 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.880 INFO:teuthology.orchestra.run.smithi079.stdout:4838 write 0x13ec1c4 thru 0x13f4c35 (0x8a72 bytes) 2024-09-11T07:07:26.883 INFO:teuthology.orchestra.run.smithi079.stdout:4839 write 0x6f3c936 thru 0x6f3e67a (0x1d45 bytes) 2024-09-11T07:07:26.889 INFO:teuthology.orchestra.run.smithi079.stdout:4841 write 0x429b0d7 thru 0x429c5b6 (0x14e0 bytes) 2024-09-11T07:07:26.892 INFO:teuthology.orchestra.run.smithi079.stdout:4842 read 0x71978cd thru 0x71a44ab (0xcbdf bytes) 2024-09-11T07:07:26.908 INFO:teuthology.orchestra.run.smithi079.stdout:4844 writesame 0xe871fdf thru 0xe878a1e data_size 0x44(0x6a40 bytes) 2024-09-11T07:07:26.909 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.909 INFO:teuthology.orchestra.run.smithi079.stdout:4847 read 0xd643a3f thru 0xd64ae53 (0x7415 bytes) 2024-09-11T07:07:26.909 INFO:teuthology.orchestra.run.smithi079.stdout:4848 read 0x3f068bf thru 0x3f08854 (0x1f96 bytes) 2024-09-11T07:07:26.910 INFO:teuthology.orchestra.run.smithi079.stdout:4850 punch from 0x2835b79 to 0x284423b, (0xe6c2 bytes) 2024-09-11T07:07:26.910 INFO:teuthology.orchestra.run.smithi079.stdout:4851 writesame 0x24fbd68 thru 0x2506e87 data_size 0x34(0xb120 bytes) 2024-09-11T07:07:26.915 INFO:teuthology.orchestra.run.smithi079.stdout:4852 punch from 0x2d08d7a to 0x2d18cc8, (0xff4e bytes) 2024-09-11T07:07:26.915 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.915 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:26.915 INFO:teuthology.orchestra.run.smithi079.stdout:4855 write 0x3fffe98 thru 0x400f90f (0xfa78 bytes) 2024-09-11T07:07:26.930 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:26.930 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:26.935 INFO:teuthology.orchestra.run.smithi079.stdout:4857 trunc from 0xe878a1f to 0x870f999 2024-09-11T07:07:26.935 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:26.929+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:26.945 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:26.961 INFO:teuthology.orchestra.run.smithi079.stdout:4859 trunc from 0x870f999 to 0x92ef70c 2024-09-11T07:07:26.972 INFO:teuthology.orchestra.run.smithi079.stdout:4862 punch from 0x40347b8 to 0x4040338, (0xbb80 bytes) 2024-09-11T07:07:26.973 INFO:teuthology.orchestra.run.smithi079.stdout:4863 punch from 0x6c97fc0 to 0x6ca3c22, (0xbc62 bytes) 2024-09-11T07:07:26.973 INFO:teuthology.orchestra.run.smithi079.stdout:4864 read 0x92564b7 thru 0x92620c3 (0xbc0d bytes) 2024-09-11T07:07:26.975 INFO:teuthology.orchestra.run.smithi079.stdout:4865 trunc from 0x92ef70c to 0x9f9a779 2024-09-11T07:07:26.986 INFO:teuthology.orchestra.run.smithi079.stdout:4866 read 0x1d66a3e thru 0x1d6e86b (0x7e2e bytes) 2024-09-11T07:07:26.987 INFO:teuthology.orchestra.run.smithi079.stdout:4867 write 0x9eabf6d thru 0x9eacb74 (0xc08 bytes) 2024-09-11T07:07:26.990 INFO:teuthology.orchestra.run.smithi079.stdout:4868 read 0x52cdc53 thru 0x52db262 (0xd610 bytes) 2024-09-11T07:07:26.990 INFO:teuthology.orchestra.run.smithi079.stdout:4869 read 0x5dcb3eb thru 0x5dd5250 (0x9e66 bytes) 2024-09-11T07:07:26.991 INFO:teuthology.orchestra.run.smithi079.stdout:4871 read 0x9de9381 thru 0x9deffcf (0x6c4f bytes) 2024-09-11T07:07:26.992 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:27.013 INFO:teuthology.orchestra.run.smithi079.stdout:4874 write 0xd88c6f6 thru 0xd897bc4 (0xb4cf bytes) 2024-09-11T07:07:27.019 INFO:teuthology.orchestra.run.smithi079.stdout:4875 read 0x23027bc thru 0x2310cdf (0xe524 bytes) 2024-09-11T07:07:27.020 INFO:teuthology.orchestra.run.smithi079.stdout:4876 read 0xcbc2a98 thru 0xcbc4670 (0x1bd9 bytes) 2024-09-11T07:07:27.021 INFO:teuthology.orchestra.run.smithi079.stdout:4877 writesame 0xa74cc5a thru 0xa7589aa data_size 0x2d(0xbd51 bytes) 2024-09-11T07:07:27.025 INFO:teuthology.orchestra.run.smithi079.stdout:4879 write 0xbbea28 thru 0xbc951b (0xaaf4 bytes) 2024-09-11T07:07:27.028 INFO:teuthology.orchestra.run.smithi079.stdout:4882 write 0xbaaeb26 thru 0xbab2290 (0x376b bytes) 2024-09-11T07:07:27.035 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:27.032+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:27.065 INFO:teuthology.orchestra.run.smithi079.stdout:4883 trunc from 0xd897bc5 to 0x17263a1 2024-09-11T07:07:27.105 INFO:teuthology.orchestra.run.smithi079.stdout:4884 write 0x1d47507 thru 0x1d5546a (0xdf64 bytes) 2024-09-11T07:07:27.108 INFO:teuthology.orchestra.run.smithi079.stdout:4885 punch from 0x1c91622 to 0x1ca15f1, (0xffcf bytes) 2024-09-11T07:07:27.120 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:27.120 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:27.135 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:27.140 INFO:teuthology.orchestra.run.smithi079.stdout:4886 write 0x8bfdd7f thru 0x8c09903 (0xbb85 bytes) 2024-09-11T07:07:27.147 INFO:teuthology.orchestra.run.smithi079.stdout:4887 punch from 0x2392bcc to 0x239c81b, (0x9c4f bytes) 2024-09-11T07:07:27.147 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:27.147 INFO:teuthology.orchestra.run.smithi079.stdout:4889 punch from 0x25e5137 to 0x25f013f, (0xb008 bytes) 2024-09-11T07:07:27.147 INFO:teuthology.orchestra.run.smithi079.stdout:4891 write 0x162acea thru 0x16313f0 (0x6707 bytes) 2024-09-11T07:07:27.152 INFO:teuthology.orchestra.run.smithi079.stdout:4893 writesame 0x697fefb thru 0x698ca4d data_size 0x1(0xcb53 bytes) 2024-09-11T07:07:27.153 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:07:27.176 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:27.176+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:27.187 INFO:teuthology.orchestra.run.smithi079.stdout:4894 read 0xced794 thru 0xcfd365 (0xfbd2 bytes) 2024-09-11T07:07:27.190 INFO:teuthology.orchestra.run.smithi079.stdout:4895 trunc from 0x8c09904 to 0x76c08ed 2024-09-11T07:07:27.203 INFO:teuthology.orchestra.run.smithi079.stdout:4897 writesame 0x1ca3a33 thru 0x1cb27e4 data_size 0x19(0xedb2 bytes) 2024-09-11T07:07:27.207 INFO:teuthology.orchestra.run.smithi079.stdout:4898 writesame 0x23ab958 thru 0x23b5e62 data_size 0x17(0xa50b bytes) 2024-09-11T07:07:27.229 INFO:teuthology.orchestra.run.smithi079.stdout:4899 writesame 0xb52193f thru 0xb52253c data_size 0x5(0xbfe bytes) 2024-09-11T07:07:27.229 INFO:teuthology.orchestra.run.smithi079.stdout:4900 write 0x8f004b7 thru 0x8f0f263 (0xedad bytes) 2024-09-11T07:07:27.232 INFO:teuthology.orchestra.run.smithi079.stdout:4904 write 0x462c546 thru 0x46395b2 (0xd06d bytes) 2024-09-11T07:07:27.236 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:27.237 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:27.233+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:27.246 INFO:teuthology.orchestra.run.smithi079.stdout:4908 trunc from 0xb52253d to 0x6d09b90 2024-09-11T07:07:27.259 INFO:teuthology.orchestra.run.smithi079.stdout:4909 clone 39 order 25 su 262144 sc 9 2024-09-11T07:07:27.303 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:27.303 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:27.318 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:27.364 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:27.364+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:27.438 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:27.436+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:27.439 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:27.439 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:27.453 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:27.540 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:27.536+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:27.586 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:27.587 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:27.601 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:27.641 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:27.640+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:27.724 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:27.724 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:27.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:27.741 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:27.740+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:27.842 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:27.837+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:27.864 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:27.864 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:27.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:27.943 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:27.940+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:28.045 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:28.044+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:28.046 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:28.046 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:28.062 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:28.139 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:07:28.139 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:07:28.140 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T07:07:28.140 INFO:tasks.thrashosds.thrasher:Setting osd 6 primary_affinity to 0.372818 2024-09-11T07:07:28.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 0.37281800299890466 2024-09-11T07:07:28.184 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:28.181+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:28.192 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:28.192 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:28.209 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:28.242 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:28.247 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:28.244+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:28.347 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:28.341+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:28.374 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #37, image image_client.0-clone37 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent38 2024-09-11T07:07:28.379 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:28.379 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:28.383 INFO:teuthology.orchestra.run.smithi079.stdout:4910 read 0x1008a07 thru 0x1016a93 (0xe08d bytes) 2024-09-11T07:07:28.386 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:28.389 INFO:teuthology.orchestra.run.smithi079.stdout:4913 trunc from 0x6d09b90 to 0x93bca09 2024-09-11T07:07:28.399 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:28.399 INFO:teuthology.orchestra.run.smithi079.stdout:4915 writesame 0x2c77841 thru 0x2c7f1eb data_size 0x1(0x79ab bytes) 2024-09-11T07:07:28.416 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:28.416 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:28.435 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:28.436 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:28.448 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:28.445+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:28.466 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:28.466 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:28.480 INFO:teuthology.orchestra.run.smithi079.stdout:4916 write 0xd096f53 thru 0xd0971ef (0x29d bytes) 2024-09-11T07:07:28.483 INFO:teuthology.orchestra.run.smithi079.stdout:4917 writesame 0x1e2bbaa thru 0x1e33aff data_size 0x9(0x7f56 bytes) 2024-09-11T07:07:28.489 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:28.489 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:28.513 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:28.514 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:28.521 INFO:teuthology.orchestra.run.smithi079.stdout:4920 clone 40 order 18 su 8192 sc 7 2024-09-11T07:07:28.535 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:28.535 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:28.538 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:28.538 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:28.538 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:28.538 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:28.548 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:28.545+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:28.552 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:28.554 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:28.555 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:28.575 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:28.575 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:28.649 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:28.648+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:28.666 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:28.666 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:28.666 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:28.666 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:28.667 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:28.679 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:28.750 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:28.748+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:28.802 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:38225 3.0 e54/21 3:00593585:::rbd_data.11612bf90fc2.0000000000000001:head v 54'264, mlcod=51'262)", 2024-09-11T07:07:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 50.324497350000001, 2024-09-11T07:07:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095742440000000009, 2024-09-11T07:07:28.803 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.475661+0000", 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7800000000000001e-07 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478936+0000", 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032745610000000001 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478959+0000", 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3553e-05 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.478975+0000", 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5678000000000001e-05 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.479055+0000", 2024-09-11T07:07:28.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9684000000000005e-05 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.479085+0000", 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9782e-05 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.485183+0000", 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0060982140000000002 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:38.485235+0000", 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2593999999999998e-05 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:41586 3.4 e58/21 3:278deab4:::rbd_data.11612bd38060.0000000000000000:head v 58'75, mlcod=53'73)", 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.991162563000003, 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080719699999999995, 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808996+0000", 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.808999+0000", 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2830000000000002e-06 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810913+0000", 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001913402 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810949+0000", 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5954999999999997e-05 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.810966+0000", 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7459e-05 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.811079+0000", 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000113101 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.811118+0000", 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8937999999999999e-05 2024-09-11T07:07:28.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.816962+0000", 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.005843488 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:42.817068+0000", 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000106344 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59289 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:head [stat,truncate 11010048] snapc 20=[20] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.784695309, 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024828697, 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59289 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.813 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015467+0000", 2024-09-11T07:07:28.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6200000000000001e-06 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015483+0000", 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5962999999999999e-05 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015531+0000", 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7964999999999999e-05 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015554+0000", 2024-09-11T07:07:28.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3493e-05 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015723+0000", 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169121 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016035+0000", 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031174000000000002 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016468+0000", 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043272900000000002 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.039067+0000", 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022598894000000001 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040107+0000", 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010398860000000001 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040212+0000", 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010577399999999999 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040292+0000", 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9511999999999994e-05 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.818 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62059 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3620864~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.002835181999998, 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080870200000000003, 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62059 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797323+0000", 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797324+0000", 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797325+0000", 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.175e-06 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797328+0000", 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3519999999999998e-06 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797331+0000", 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9359999999999999e-06 2024-09-11T07:07:28.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805061+0000", 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0077296919999999998 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805212+0000", 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015180799999999999 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805410+0000", 2024-09-11T07:07:28.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019783999999999999 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62084 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.002515320000001, 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0081746579999999996, 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62084 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797643+0000", 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797644+0000", 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2399999999999996e-07 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797649+0000", 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1410000000000004e-06 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797662+0000", 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3142000000000001e-05 2024-09-11T07:07:28.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797671+0000", 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0599999999999997e-06 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805515+0000", 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0078431270000000001 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805666+0000", 2024-09-11T07:07:28.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015186299999999999 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805818+0000", 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015140100000000001 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62085 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3244032~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:28.827 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.002460734, 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086787909999999999, 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62085 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797698+0000", 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8800000000000002e-07 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797702+0000", 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4079999999999998e-06 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797714+0000", 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1833e-05 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797721+0000", 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1450000000000002e-06 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.805934+0000", 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.008213471 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806175+0000", 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024039600000000001 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806377+0000", 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020185 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62086 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3309568~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.002417535999999, 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089940209999999996, 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62086 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797741+0000", 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1699999999999998e-07 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797745+0000", 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2629999999999999e-06 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797757+0000", 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2214e-05 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797763+0000", 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.609e-06 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806471+0000", 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087085700000000005 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806589+0000", 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000117939 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806735+0000", 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000145909 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.836 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62087 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3375104~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.002374673999999, 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095423460000000002, 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.837 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62087 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797784+0000", 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.13e-07 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797788+0000", 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.349e-06 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797794+0000", 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4999999999999996e-06 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797800+0000", 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8080000000000001e-06 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.806844+0000", 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0090440060000000003 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807059+0000", 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021471000000000001 2024-09-11T07:07:28.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807326+0000", 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026746000000000002 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62088 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3440640~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.002349883000001, 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0097044639999999995, 2024-09-11T07:07:28.841 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62088 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797809+0000", 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5400000000000002e-07 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797812+0000", 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3340000000000002e-06 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797820+0000", 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1980000000000004e-06 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797825+0000", 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1429999999999997e-06 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807392+0000", 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0095677420000000006 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807443+0000", 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0179999999999997e-05 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807513+0000", 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0413000000000005e-05 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62089 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3506176~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.002328514999999, 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01023572, 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62089 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797830+0000", 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2500000000000001e-07 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797832+0000", 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4950000000000001e-06 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797836+0000", 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9899999999999999e-06 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797845+0000", 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0839999999999998e-06 2024-09-11T07:07:28.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807583+0000", 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0097380100000000001 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.807802+0000", 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021865599999999999 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808066+0000", 2024-09-11T07:07:28.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026415999999999999 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62090 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3571712~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.002299511, 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010367039, 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.850 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62090 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797859+0000", 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4700000000000002e-07 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797861+0000", 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8390000000000001e-06 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797866+0000", 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9150000000000004e-06 2024-09-11T07:07:28.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797869+0000", 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1269999999999999e-06 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808092+0000", 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010222788999999999 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808151+0000", 2024-09-11T07:07:28.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9456000000000001e-05 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808226+0000", 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4566000000000004e-05 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62091 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3637248~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.002284337999999, 2024-09-11T07:07:28.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010935996, 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62091 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.855 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797874+0000", 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5199999999999998e-07 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797876+0000", 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.277e-06 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797879+0000", 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6890000000000002e-06 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.797882+0000", 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6240000000000002e-06 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808306+0000", 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010423946999999999 2024-09-11T07:07:28.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808440+0000", 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000133993 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808810+0000", 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000370214 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.858 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62116 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3194880~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.001604553, 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010413343, 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62116 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798554+0000", 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798556+0000", 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.526e-06 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798581+0000", 2024-09-11T07:07:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4556e-05 2024-09-11T07:07:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798618+0000", 2024-09-11T07:07:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7313e-05 2024-09-11T07:07:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798632+0000", 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3226e-05 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808844+0000", 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01021238 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808898+0000", 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4534999999999999e-05 2024-09-11T07:07:28.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.808967+0000", 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8806999999999994e-05 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62117 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3260416~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.001462572000001, 2024-09-11T07:07:28.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010787804999999999, 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62117 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798696+0000", 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798697+0000", 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3200000000000005e-07 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798700+0000", 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.517e-06 2024-09-11T07:07:28.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798708+0000", 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7610000000000007e-06 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798715+0000", 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9959999999999996e-06 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809045+0000", 2024-09-11T07:07:28.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010329896 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809198+0000", 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015303499999999999 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809484+0000", 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000285968 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.867 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62118 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3325952~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.001429657999999, 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010897328, 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62118 2024-09-11T07:07:28.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798729+0000", 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798732+0000", 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0489999999999999e-06 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798740+0000", 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2359999999999998e-06 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798746+0000", 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4980000000000003e-06 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809512+0000", 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010766133000000001 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809560+0000", 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7927999999999999e-05 2024-09-11T07:07:28.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809626+0000", 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6006000000000005e-05 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62119 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3391488~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.001404117, 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011339109, 2024-09-11T07:07:28.872 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62119 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798754+0000", 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798755+0000", 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8100000000000001e-07 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798758+0000", 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5119999999999998e-06 2024-09-11T07:07:28.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798781+0000", 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3175000000000001e-05 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798788+0000", 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9240000000000001e-06 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809715+0000", 2024-09-11T07:07:28.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.010927533 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.809902+0000", 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000187111 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810093+0000", 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019097299999999999 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62120 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3457024~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.001359334, 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011832135000000001, 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62120 2024-09-11T07:07:28.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798800+0000", 2024-09-11T07:07:28.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6400000000000002e-07 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798804+0000", 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0419999999999996e-06 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798813+0000", 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6870000000000006e-06 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798819+0000", 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6810000000000003e-06 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810180+0000", 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011361069999999999 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810372+0000", 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000191456 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810631+0000", 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025963499999999998 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62121 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3522560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.001331153999999, 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01236723, 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.881 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62121 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798828+0000", 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798830+0000", 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-06 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798839+0000", 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3019999999999995e-06 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798844+0000", 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2549999999999997e-06 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810713+0000", 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011869151 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810925+0000", 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021164999999999999 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811195+0000", 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026976099999999998 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.885 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62122 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3588096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.001292227, 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012886078, 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62122 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798867+0000", 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798870+0000", 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0630000000000002e-06 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798878+0000", 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8669999999999994e-06 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798902+0000", 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4167000000000001e-05 2024-09-11T07:07:28.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811275+0000", 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012373454000000001 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811484+0000", 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020880000000000001 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811752+0000", 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026820099999999998 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62123 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3653632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.001243849000002, 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013329191000000001, 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:28.890 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62123 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:28.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6300000000000004e-07 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798918+0000", 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0750000000000002e-06 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:28.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798926+0000", 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8839999999999994e-06 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798933+0000", 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0169999999999999e-06 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811830+0000", 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012896179000000001 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812072+0000", 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024236200000000001 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812244+0000", 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017191099999999999 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:28.894 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:28.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:28.896 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:28.897+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:28.996 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:28.996+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:29.069 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:29.069 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:29.069 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:29.083 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:29.098 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:29.096+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:29.167 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.6 primary-affinity to 0.372818 (8244332) 2024-09-11T07:07:29.176 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:07:29.208 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:29.208 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:29.209 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:29.209 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:29.209 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:29.209+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:29.223 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:29.247 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone39 from 0xd0971f0 (overlap 0x6d09b90) to 0x3684dc8 2024-09-11T07:07:29.299 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:29.297+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:29.390 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 51.764692373000003, 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:29.391 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:29.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:07:29.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:07:29.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:07:29.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59115 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.378090820000001, 2024-09-11T07:07:29.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038255633999999997, 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59115 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:29.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:29.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010877+0000", 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.083e-06 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010885+0000", 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0400000000000004e-06 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010931+0000", 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6452000000000002e-05 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010947+0000", 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5786000000000001e-05 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049022+0000", 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038075472999999999 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049076+0000", 2024-09-11T07:07:29.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4131000000000001e-05 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049132+0000", 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5668999999999998e-05 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59119 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.377999169999999, 2024-09-11T07:07:29.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038492673999999998, 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59119 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:29.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010969+0000", 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010976+0000", 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4529999999999999e-06 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010994+0000", 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8672999999999999e-05 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011009+0000", 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4122e-05 2024-09-11T07:07:29.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049189+0000", 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038180218000000002 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049342+0000", 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015341899999999999 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049461+0000", 2024-09-11T07:07:29.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118522 2024-09-11T07:07:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59138 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.377940355, 2024-09-11T07:07:29.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038631255000000003, 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59138 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:29.408 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011028+0000", 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.409 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011034+0000", 2024-09-11T07:07:29.410 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:07:29.410 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.410 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.412 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.412 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011049+0000", 2024-09-11T07:07:29.412 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5702999999999999e-05 2024-09-11T07:07:29.412 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011063+0000", 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3373000000000001e-05 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049512+0000", 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038449050999999998 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.413 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049601+0000", 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9395999999999996e-05 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049658+0000", 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6861999999999999e-05 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.414 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59147 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.377701673000001, 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038436533000000002, 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59147 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.415 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011267+0000", 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.46e-06 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.416 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011278+0000", 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.119e-05 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011457+0000", 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017874699999999999 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011481+0000", 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4283000000000001e-05 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.417 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049693+0000", 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038212053000000003 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049702+0000", 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.418 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59148 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.377444494999999, 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038227694999999999, 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59148 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.419 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011525+0000", 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-11T07:07:29.420 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011536+0000", 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011561+0000", 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5494999999999999e-05 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011579+0000", 2024-09-11T07:07:29.421 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7292999999999999e-05 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049739+0000", 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038159803999999999 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049750+0000", 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.422 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59149 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.377363184, 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038196747000000003, 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.423 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59149 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.424 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011605+0000", 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011614+0000", 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3219999999999993e-06 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011634+0000", 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0703000000000002e-05 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.425 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011649+0000", 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4603000000000001e-05 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049788+0000", 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038138500999999998 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049801+0000", 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3244000000000001e-05 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.426 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59150 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.377297163000001, 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038171956999999999, 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59150 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.427 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.428 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011671+0000", 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011678+0000", 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011696+0000", 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-05 2024-09-11T07:07:29.429 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011710+0000", 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3516000000000001e-05 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049835+0000", 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038125004999999997 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.430 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.431 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049842+0000", 2024-09-11T07:07:29.431 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0299999999999996e-06 2024-09-11T07:07:29.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.431 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.431 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.431 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59153 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.377122392, 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038163669999999997, 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.432 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59153 2024-09-11T07:07:29.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.433 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:29.433 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.433 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.433 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.433 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.433 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011846+0000", 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1939999999999999e-06 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011853+0000", 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6030000000000001e-06 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.434 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011870+0000", 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7739000000000001e-05 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011884+0000", 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.402e-05 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049993+0000", 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038108988000000003 2024-09-11T07:07:29.435 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050009+0000", 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5126000000000001e-05 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59154 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.377061454, 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038170655999999997, 2024-09-11T07:07:29.436 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59154 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:29.437 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011907+0000", 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1739999999999999e-06 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011974+0000", 2024-09-11T07:07:29.438 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7200999999999996e-05 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011995+0000", 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1058999999999999e-05 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012015+0000", 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9857e-05 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.439 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050060+0000", 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038045074999999998 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050076+0000", 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6290000000000002e-05 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:70560 3.2 3:459eba64:::rbd_data.11618cc4d69.000000000000003a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-11T07:07:29.440 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 13.928830850000001, 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064825956000000004, 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 70560 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.441 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460139+0000", 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.442 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460150+0000", 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0824e-05 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460178+0000", 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8449000000000002e-05 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460199+0000", 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1075999999999999e-05 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.443 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460319+0000", 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119714 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460451+0000", 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013264 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.472543+0000", 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091437 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.444 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524779+0000", 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052236339 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524853+0000", 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524913+0000", 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0825000000000001e-05 2024-09-11T07:07:29.445 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524962+0000", 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8999999999999998e-05 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71632 3.18 3:194b1b54:::rbd_data.1161b94a6d64.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:29.446 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 9.9465735239999997, 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039963481000000002, 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71632 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.447 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442395+0000", 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.448 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442403+0000", 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6210000000000004e-06 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442416+0000", 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3011e-05 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442422+0000", 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2620000000000004e-06 2024-09-11T07:07:29.449 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442495+0000", 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2977000000000003e-05 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442647+0000", 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015205199999999999 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.450708+0000", 2024-09-11T07:07:29.450 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080612589999999994 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482090+0000", 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031381543999999997 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482176+0000", 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6302000000000001e-05 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:29.451 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482279+0000", 2024-09-11T07:07:29.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010242399999999999 2024-09-11T07:07:29.452 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.452 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.452 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.452 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482357+0000", 2024-09-11T07:07:29.452 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8565000000000004e-05 2024-09-11T07:07:29.452 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.452 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.452 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73806 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14024704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.8061666990000003, 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038245594000000001, 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73806 2024-09-11T07:07:29.453 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:29.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582804+0000", 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.836e-06 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582813+0000", 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030000000000003e-06 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582820+0000", 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9e-06 2024-09-11T07:07:29.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620766+0000", 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037946800000000003 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620895+0000", 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012861799999999999 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621046+0000", 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015100700000000001 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73807 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14417920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.8061389970000001, 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038841537000000002, 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.457 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73807 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582829+0000", 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582857+0000", 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.779e-05 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582874+0000", 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7584999999999999e-05 2024-09-11T07:07:29.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582882+0000", 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7999999999999999e-06 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621135+0000", 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038253044 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621390+0000", 2024-09-11T07:07:29.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000254689 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621670+0000", 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027999500000000001 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73808 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14811136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.8060739379999999, 2024-09-11T07:07:29.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039162267000000001, 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73808 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582894+0000", 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582897+0000", 2024-09-11T07:07:29.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4240000000000002e-06 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582907+0000", 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4299999999999995e-06 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582919+0000", 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1826e-05 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621769+0000", 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038850735999999997 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621898+0000", 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012898099999999999 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622056+0000", 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015718000000000001 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73809 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15204352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.8060398219999998, 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039738290000000002, 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.466 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73809 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:07:29.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582928+0000", 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9999999999999997e-07 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582932+0000", 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8029999999999998e-06 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582947+0000", 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5099999999999999e-05 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582959+0000", 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.206e-05 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622144+0000", 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039184999999999998 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622390+0000", 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024606600000000003 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622666+0000", 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027566100000000002 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73810 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15597568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.8059911230000001, 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040289497000000001, 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73810 2024-09-11T07:07:29.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582977+0000", 2024-09-11T07:07:29.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0100000000000001e-06 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582983+0000", 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583000+0000", 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7237000000000001e-05 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583014+0000", 2024-09-11T07:07:29.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4076999999999999e-05 2024-09-11T07:07:29.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.474 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622759+0000", 2024-09-11T07:07:29.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039744806000000001 2024-09-11T07:07:29.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622998+0000", 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000239385 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623266+0000", 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026730900000000003 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.476 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73811 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15990784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:29.476 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:07:29.476 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.805935104, 2024-09-11T07:07:29.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040666513000000001, 2024-09-11T07:07:29.476 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.476 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.476 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:29.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.476 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73811 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583033+0000", 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.037e-06 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583039+0000", 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583079+0000", 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0438999999999997e-05 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583092+0000", 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2367e-05 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623365+0000", 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040273182999999997 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.479 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623518+0000", 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015322099999999999 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623699+0000", 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018055299999999999 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.480 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73812 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 16384000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.8058627249999999, 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041168972999999998, 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73812 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.481 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583109+0000", 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1799999999999998e-06 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583120+0000", 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0380000000000001e-05 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583127+0000", 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.029e-06 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623766+0000", 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040639210000000002 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624006+0000", 2024-09-11T07:07:29.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240466 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624273+0000", 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026699100000000001 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:74137 3.1 3:833ccc20:::rbd_data.1161634664ee.0000000000000009:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:07:29.485 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 3.5966150580000003, 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045679127999999999, 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 74137 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:29.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:29.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:07:29.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:29.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:07:29.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:29.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:29.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792355+0000", 2024-09-11T07:07:29.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.23e-06 2024-09-11T07:07:29.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:29.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792368+0000", 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449000000000001e-05 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792398+0000", 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0519999999999999e-05 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792413+0000", 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4216000000000001e-05 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792538+0000", 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012526099999999999 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792679+0000", 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014143099999999999 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.800911+0000", 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082317989999999997 2024-09-11T07:07:29.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837839+0000", 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036927588999999997 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837869+0000", 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0355999999999999e-05 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837956+0000", 2024-09-11T07:07:29.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6967999999999998e-05 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.838031+0000", 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5308999999999993e-05 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:29.492 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:29.494 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:29.494 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #38, image image_client.0-clone38 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent39 2024-09-11T07:07:29.495 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:29.493+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:29.595 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:29.593+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:29.625 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:29.625 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:29.625 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:29.639 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:29.682 INFO:teuthology.orchestra.run.smithi079.stdout:4921 read 0xcfa51ee thru 0xcfa5bc2 (0x9d5 bytes) 2024-09-11T07:07:29.683 INFO:teuthology.orchestra.run.smithi079.stdout:4922 writesame 0x9f8103c thru 0x9f8186a data_size 0x1(0x82f bytes) 2024-09-11T07:07:29.696 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:29.693+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:29.696 INFO:teuthology.orchestra.run.smithi079.stdout:4923 write 0x6cec379 thru 0x6cf2c5b (0x68e3 bytes) 2024-09-11T07:07:29.728 INFO:teuthology.orchestra.run.smithi079.stdout:4924 writesame 0xed72b88 thru 0xed740a1 data_size 0x2(0x151a bytes) 2024-09-11T07:07:29.728 INFO:teuthology.orchestra.run.smithi079.stdout:4926 write 0x6c66a9f thru 0x6c69058 (0x25ba bytes) 2024-09-11T07:07:29.742 INFO:teuthology.orchestra.run.smithi079.stdout:4927 read 0xd0ad856 thru 0xd0b7456 (0x9c01 bytes) 2024-09-11T07:07:29.742 INFO:teuthology.orchestra.run.smithi079.stdout:4928 punch from 0x980fdc1 to 0x98155be, (0x57fd bytes) 2024-09-11T07:07:29.742 INFO:teuthology.orchestra.run.smithi079.stdout:4929 punch from 0x6c414fb to 0x6c41ab7, (0x5bc bytes) 2024-09-11T07:07:29.742 INFO:teuthology.orchestra.run.smithi079.stdout:4930 write 0xbca0d7e thru 0xbcad56f (0xc7f2 bytes) 2024-09-11T07:07:29.773 INFO:teuthology.orchestra.run.smithi079.stdout:4931 read 0xce7f6a4 thru 0xce882e3 (0x8c40 bytes) 2024-09-11T07:07:29.773 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:29.773 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:29.774 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:29.774 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:29.774 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:29.774 INFO:teuthology.orchestra.run.smithi079.stdout:4932 write 0x786ca7c thru 0x7875eec (0x9471 bytes) 2024-09-11T07:07:29.792 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:29.793 INFO:teuthology.orchestra.run.smithi079.stdout:4933 clone 41 order 22 su 2097152 sc 3 2024-09-11T07:07:29.796 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:29.797+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:29.897 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:29.896+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:29.913 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.623555945000007, 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:07:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.623483862, 2024-09-11T07:07:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:07:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.623428368999996, 2024-09-11T07:07:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:07:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:07:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:07:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:07:29.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.421556401000004, 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:07:29.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.932 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.421493811000005, 2024-09-11T07:07:29.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:07:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.934 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:07:29.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:07:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:07:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:07:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:07:29.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.938 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.421436755000002, 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:07:29.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:07:29.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.421380638000002, 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:07:29.943 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.947 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.421259375999995, 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.948 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:07:29.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:07:29.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.952 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.421155107000004, 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:07:29.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:07:29.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.421049568000001, 2024-09-11T07:07:29.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:29.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.961 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.420982405000004, 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.962 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:07:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:07:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.966 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.420883199000002, 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.967 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:29.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.971 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.420796240000001, 2024-09-11T07:07:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:07:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:07:29.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:07:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.420735962999998, 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:07:29.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:29.981 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.420582257999996, 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:29.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:07:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:07:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:07:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:07:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.420495082000002, 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.986 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.987 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:07:29.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.987 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:29.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:07:29.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:29.991 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.420431179000005, 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:29.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:07:29.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:07:29.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:29.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.420371336000002, 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:29.996 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:07:29.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.001 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:30.001 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:30.001 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.420293254000001, 2024-09-11T07:07:30.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:07:30.001 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.001 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.001 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.001 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:07:30.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:07:30.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:07:30.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:07:30.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:07:30.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.420235484000003, 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.006 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:30.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:07:30.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.011 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.011 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.011 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:30.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:30.013 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:30.012+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:30.113 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:30.113+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:30.178 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:07:30.185 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:30.185 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:30.185 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:30.185 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:30.199 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:30.244 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:30.244+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:30.302 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone40 from 0xed740a2 (overlap 0xd0971f0) to 0x29b7d30 2024-09-11T07:07:30.315 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:30.313+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:30.331 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:30.331 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:30.332 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:30.332 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:30.332 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:30.350 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:30.415 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:30.413+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:30.516 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:30.517+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:30.583 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:30.583 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.271551536000004, 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.584 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:30.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:07:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:07:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:07:30.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:07:30.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.271483982000007, 2024-09-11T07:07:30.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:30.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:07:30.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:07:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:07:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.271403144999994, 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.595 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:07:30.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.271359798999995, 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.599 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.603 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.271289674000002, 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.604 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:07:30.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:07:30.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.271221550000007, 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:30.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:30.612 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.271181084000006, 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:07:30.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.271143042999995, 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:07:30.617 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:07:30.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.621 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.271104073000004, 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.622 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.626 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.271063198999997, 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:07:30.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:07:30.630 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.270735426000002, 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.631 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:07:30.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.270668916000005, 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:07:30.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:07:30.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:07:30.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:07:30.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.642 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.270601197000005, 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:30.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:07:30.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.270556259000003, 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.647 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:07:30.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.269756634000004, 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:07:30.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:07:30.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:07:30.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:07:30.656 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.656 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.656 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.656 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.269722291999997, 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:07:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:07:30.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.269359617000006, 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.661 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.268096592000006, 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:07:30.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:30.670 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.268064093000007, 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:30.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:07:30.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 62.331458666000003, 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:30.675 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.676 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:07:30.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.676 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:30.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:07:30.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:07:30.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:07:30.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:07:30.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:30.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:30.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:07:30.681 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.682 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.682 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.682 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:30.682 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:30.684 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:30.685 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:30.681+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:30.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:30.785+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:30.858 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:30.858 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:87620 3.3 3:c6d95aea:::rbd_data.1161250241b0.00000000000001e7:head [stat,delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.857040+0000", 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.0010446940000000001, 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0010728409999999999, 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.859 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87620 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857040+0000", 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857040+0000", 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857041+0000", 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4200000000000004e-07 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857046+0000", 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7500000000000003e-06 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857061+0000", 2024-09-11T07:07:30.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4973e-05 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857069+0000", 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7620000000000001e-06 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857129+0000", 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9970999999999999e-05 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:30.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857236+0000", 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000106502 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:87623 3.a 3.a1a2316a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.857828+0000", 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00025648700000000001, 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00036152100000000001, 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "reached pg", 2024-09-11T07:07:30.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87623 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857828+0000", 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857828+0000", 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857829+0000", 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5999999999999999e-07 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857834+0000", 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7389999999999996e-06 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857841+0000", 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0859999999999998e-06 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857846+0000", 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0769999999999998e-06 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858183+0000", 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00033786800000000001 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.866 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:87624 3.a 3.a1a2316a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.857853+0000", 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.00023192500000000001, 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00042561699999999999, 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.867 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87624 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857853+0000", 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857853+0000", 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857853+0000", 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.96e-07 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857857+0000", 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2440000000000004e-06 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857864+0000", 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0929999999999999e-06 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.857869+0000", 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5060000000000003e-06 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:87653 3.a 3.a1a2316a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.858115+0000", 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999695, 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022307100000000001, 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.870 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87653 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858115+0000", 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858115+0000", 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858116+0000", 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4099999999999998e-07 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858120+0000", 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9570000000000004e-06 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858132+0000", 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1331999999999999e-05 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858138+0000", 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5919999999999997e-06 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.873 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:87654 3.a 3.a1a2316a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.858153+0000", 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999313, 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00029409, 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.874 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87654 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858153+0000", 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858153+0000", 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858154+0000", 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7199999999999999e-07 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858156+0000", 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3989999999999998e-06 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858164+0000", 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7770000000000002e-06 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858168+0000", 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.76e-06 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:87655 3.a 3.a1a2316a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:30.877 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.858173+0000", 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9999118, 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034573600000000003, 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87655 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858173+0000", 2024-09-11T07:07:30.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858173+0000", 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858173+0000", 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2000000000000001e-07 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858175+0000", 2024-09-11T07:07:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.437e-06 2024-09-11T07:07:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858178+0000", 2024-09-11T07:07:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.455e-06 2024-09-11T07:07:30.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858181+0000", 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.337e-06 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:87656 3.a 3.a1a2316a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.858185+0000", 2024-09-11T07:07:30.881 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9998999, 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000391343, 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87656 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858185+0000", 2024-09-11T07:07:30.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858185+0000", 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858185+0000", 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3900000000000001e-07 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858187+0000", 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7060000000000001e-06 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858190+0000", 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1420000000000002e-06 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858193+0000", 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8499999999999998e-06 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:87685 3.a 3.a1a2316a (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.858222+0000", 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4294967295.9998627, 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00042073700000000002, 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "queued for pg", 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:30.885 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 87685 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858222+0000", 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858222+0000", 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858222+0000", 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9099999999999999e-07 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858224+0000", 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1660000000000001e-06 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858229+0000", 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7060000000000003e-06 2024-09-11T07:07:30.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.858232+0000", 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.207e-06 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 8 2024-09-11T07:07:30.888 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:30.890 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:30.890 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:30.891 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:30.891 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:30.888+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:30.921 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:30.921 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:30.950 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:30.950 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:30.977 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:30.977 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:30.990 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:30.988+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:31.005 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:31.005 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:31.036 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:31.036 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:31.062 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:31.063 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:31.091 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:31.092 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:31.093 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:31.088+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:31.100 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:31.100 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:31.120 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:31.209 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:31.208+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:31.292 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:31.293+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:31.339 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:31.339 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:31.363 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:31.393 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:31.393+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:31.485 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #39, image image_client.0-clone39 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent40 2024-09-11T07:07:31.494 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:31.493+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:31.514 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:31.514 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:31.527 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:31.595 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:31.593+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:31.637 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:31.637 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:31.639 INFO:teuthology.orchestra.run.smithi079.stdout:4934 write 0xb89689b thru 0xb898217 (0x197d bytes) 2024-09-11T07:07:31.652 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:31.680 INFO:teuthology.orchestra.run.smithi079.stdout:4935 write 0x45b572c thru 0x45bc87f (0x7154 bytes) 2024-09-11T07:07:31.696 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:31.693+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:31.716 INFO:teuthology.orchestra.run.smithi079.stdout:4937 read 0x82e2f thru 0x92002 (0xf1d4 bytes) 2024-09-11T07:07:31.731 INFO:teuthology.orchestra.run.smithi079.stdout:4938 trunc from 0xed740a2 to 0x64cc35c 2024-09-11T07:07:31.796 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:31.796 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:31.796 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:31.796+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:31.800 INFO:teuthology.orchestra.run.smithi079.stdout:4939 read 0x3af181d thru 0x3af8dc5 (0x75a9 bytes) 2024-09-11T07:07:31.801 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:31.801 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:31.801 INFO:teuthology.orchestra.run.smithi079.stdout:4946 punch from 0x2a2e7a5 to 0x2a311e5, (0x2a40 bytes) 2024-09-11T07:07:31.801 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:31.801 INFO:teuthology.orchestra.run.smithi079.stdout:4948 writesame 0x51b9f05 thru 0x51be018 data_size 0x55(0x4114 bytes) 2024-09-11T07:07:31.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:31.845 INFO:teuthology.orchestra.run.smithi079.stdout:4949 write 0xe6c8625 thru 0xe6cd073 (0x4a4f bytes) 2024-09-11T07:07:31.848 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:31.848 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:31.864 INFO:teuthology.orchestra.run.smithi079.stdout:4954 trunc from 0xe6cd074 to 0x39df864 2024-09-11T07:07:31.897 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:31.897+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:31.926 INFO:teuthology.orchestra.run.smithi079.stdout:4955 read 0x13ad83a thru 0x13b1326 (0x3aed bytes) 2024-09-11T07:07:31.935 INFO:teuthology.orchestra.run.smithi079.stdout:4956 write 0x5f2bce4 thru 0x5f33692 (0x79af bytes) 2024-09-11T07:07:31.939 INFO:teuthology.orchestra.run.smithi079.stdout:4957 read 0x429da93 thru 0x42a4795 (0x6d03 bytes) 2024-09-11T07:07:31.939 INFO:teuthology.orchestra.run.smithi079.stdout:4959 read 0x358b817 thru 0x3594a3f (0x9229 bytes) 2024-09-11T07:07:31.949 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:31.950 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:31.957 INFO:teuthology.orchestra.run.smithi079.stdout:4960 write 0xd3875fa thru 0xd38f5ce (0x7fd5 bytes) 2024-09-11T07:07:31.964 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:31.985 INFO:teuthology.orchestra.run.smithi079.stdout:4961 trunc from 0xd38f5cf to 0x38d5e7 2024-09-11T07:07:32.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:32.029+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:32.099 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:32.096+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:32.105 INFO:teuthology.orchestra.run.smithi079.stdout:4962 write 0x7bc3575 thru 0x7bcb303 (0x7d8f bytes) 2024-09-11T07:07:32.110 INFO:teuthology.orchestra.run.smithi079.stdout:4963 writesame 0x20bf885 thru 0x20bfbaf data_size 0x1(0x32b bytes) 2024-09-11T07:07:32.115 INFO:teuthology.orchestra.run.smithi079.stdout:4964 read 0x741a5e6 thru 0x74241f4 (0x9c0f bytes) 2024-09-11T07:07:32.116 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:32.116 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:32.131 INFO:teuthology.orchestra.run.smithi079.stdout:4965 write 0xb95487c thru 0xb961b33 (0xd2b8 bytes) 2024-09-11T07:07:32.134 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:32.138 INFO:teuthology.orchestra.run.smithi079.stdout:4966 read 0x5847898 thru 0x58534bb (0xbc24 bytes) 2024-09-11T07:07:32.138 INFO:teuthology.orchestra.run.smithi079.stdout:4967 write 0x1d04cc7 thru 0x1d0f309 (0xa643 bytes) 2024-09-11T07:07:32.148 INFO:teuthology.orchestra.run.smithi079.stdout:4970 trunc from 0xb961b34 to 0xd608762 2024-09-11T07:07:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:32.159 INFO:teuthology.orchestra.run.smithi079.stdout:4972 read 0xaedeeff thru 0xaeebefa (0xcffc bytes) 2024-09-11T07:07:32.169 INFO:teuthology.orchestra.run.smithi079.stdout:4974 trunc from 0xd608762 to 0x8575883 2024-09-11T07:07:32.189 INFO:teuthology.orchestra.run.smithi079.stdout:4975 write 0x7960da7 thru 0x796da35 (0xcc8f bytes) 2024-09-11T07:07:32.200 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:32.200+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:32.207 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:07:32.212 INFO:teuthology.orchestra.run.smithi079.stdout:4976 writesame 0xb85e393 thru 0xb85fa3a data_size 0x14(0x16a8 bytes) 2024-09-11T07:07:32.212 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:32.224 INFO:teuthology.orchestra.run.smithi079.stdout:4980 writesame 0xca76d68 thru 0xca8373f data_size 0xc(0xc9d8 bytes) 2024-09-11T07:07:32.224 INFO:teuthology.orchestra.run.smithi079.stdout:4981 write 0xc2982da thru 0xc2a156d (0x9294 bytes) 2024-09-11T07:07:32.231 INFO:teuthology.orchestra.run.smithi079.stdout:4982 trunc from 0xca83740 to 0xb6b6a69 2024-09-11T07:07:32.251 INFO:teuthology.orchestra.run.smithi079.stdout:4983 writesame 0x7901f34 thru 0x790f6a4 data_size 0x1(0xd771 bytes) 2024-09-11T07:07:32.273 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:32.273 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:32.288 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:32.301 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:32.300+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:32.312 INFO:teuthology.orchestra.run.smithi079.stdout:4984 punch from 0x89b0f0c to 0x89bbda9, (0xae9d bytes) 2024-09-11T07:07:32.316 INFO:teuthology.orchestra.run.smithi079.stdout:4986 trunc from 0xb6b6a69 to 0xe24ccae 2024-09-11T07:07:32.329 INFO:teuthology.orchestra.run.smithi079.stdout:4987 read 0xb068477 thru 0xb078175 (0xfcff bytes) 2024-09-11T07:07:32.329 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:32.329 INFO:teuthology.orchestra.run.smithi079.stdout:4989 write 0x8509af1 thru 0x851609a (0xc5aa bytes) 2024-09-11T07:07:32.337 INFO:teuthology.orchestra.run.smithi079.stdout:4990 writesame 0x645be10 thru 0x646a927 data_size 0x4(0xeb18 bytes) 2024-09-11T07:07:32.362 INFO:teuthology.orchestra.run.smithi079.stdout:4991 read 0xbef53c0 thru 0xbf03597 (0xe1d8 bytes) 2024-09-11T07:07:32.362 INFO:teuthology.orchestra.run.smithi079.stdout:4992 writesame 0x78a97eb thru 0x78b57bb data_size 0x73(0xbfd1 bytes) 2024-09-11T07:07:32.366 INFO:teuthology.orchestra.run.smithi079.stdout:4993 writesame 0xb638275 thru 0xb63f8b2 data_size 0xf(0x763e bytes) 2024-09-11T07:07:32.374 INFO:teuthology.orchestra.run.smithi079.stdout:4995 write 0x8bd0381 thru 0x8bd391a (0x359a bytes) 2024-09-11T07:07:32.391 INFO:teuthology.orchestra.run.smithi079.stdout:4998 write 0xe971100 thru 0xe97a1b7 (0x90b8 bytes) 2024-09-11T07:07:32.398 INFO:teuthology.orchestra.run.smithi079.stdout:4999 read 0xce5a713 thru 0xce64edf (0xa7cd bytes) 2024-09-11T07:07:32.398 INFO:teuthology.orchestra.run.smithi079.stdout:5001 write 0x8468c53 thru 0x84739dd (0xad8b bytes) 2024-09-11T07:07:32.402 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:32.400+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:32.403 INFO:teuthology.orchestra.run.smithi079.stdout:5003 read 0x11ed78f thru 0x11f8a45 (0xb2b7 bytes) 2024-09-11T07:07:32.403 INFO:teuthology.orchestra.run.smithi079.stdout:5005 read 0x3d43c86 thru 0x3d4e7a0 (0xab1b bytes) 2024-09-11T07:07:32.403 INFO:teuthology.orchestra.run.smithi079.stdout:5006 write 0x2beb03d thru 0x2bf2b9b (0x7b5f bytes) 2024-09-11T07:07:32.411 INFO:teuthology.orchestra.run.smithi079.stdout:5008 writesame 0xc5c5fdd thru 0xc5c760b data_size 0x3(0x162f bytes) 2024-09-11T07:07:32.420 INFO:teuthology.orchestra.run.smithi079.stdout:5009 write 0x1d1847d thru 0x1d20008 (0x7b8c bytes) 2024-09-11T07:07:32.424 INFO:teuthology.orchestra.run.smithi079.stdout:5010 write 0x8d72834 thru 0x8d7ead0 (0xc29d bytes) 2024-09-11T07:07:32.434 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:32.435 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:32.435 INFO:teuthology.orchestra.run.smithi079.stdout:5012 trunc from 0xe97a1b8 to 0xd28b17b 2024-09-11T07:07:32.450 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:32.459 INFO:teuthology.orchestra.run.smithi079.stdout:5013 read 0x8189a5c thru 0x8196930 (0xced5 bytes) 2024-09-11T07:07:32.474 INFO:teuthology.orchestra.run.smithi079.stdout:5015 writesame 0xe4945fc thru 0xe49f47e data_size 0x5(0xae83 bytes) 2024-09-11T07:07:32.475 INFO:teuthology.orchestra.run.smithi079.stdout:5016 write 0x5da1d1c thru 0x5da406f (0x2354 bytes) 2024-09-11T07:07:32.482 INFO:teuthology.orchestra.run.smithi079.stdout:5017 write 0x93c0a4d thru 0x93cf41e (0xe9d2 bytes) 2024-09-11T07:07:32.490 INFO:teuthology.orchestra.run.smithi079.stdout:5018 writesame 0x982e79d thru 0x983b56a data_size 0x9(0xcdce bytes) 2024-09-11T07:07:32.499 INFO:teuthology.orchestra.run.smithi079.stdout:5020 writesame 0x12a6c6c thru 0x12a8db6 data_size 0x1(0x214b bytes) 2024-09-11T07:07:32.503 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:32.500+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:32.509 INFO:teuthology.orchestra.run.smithi079.stdout:5021 write 0x9017325 thru 0x9024d1d (0xd9f9 bytes) 2024-09-11T07:07:32.516 INFO:teuthology.orchestra.run.smithi079.stdout:5023 write 0x5fba425 thru 0x5fbe071 (0x3c4d bytes) 2024-09-11T07:07:32.524 INFO:teuthology.orchestra.run.smithi079.stdout:5024 write 0x277cf0e thru 0x2786eaf (0x9fa2 bytes) 2024-09-11T07:07:32.532 INFO:teuthology.orchestra.run.smithi079.stdout:5025 read 0xb959ac4 thru 0xb95feb2 (0x63ef bytes) 2024-09-11T07:07:32.532 INFO:teuthology.orchestra.run.smithi079.stdout:5027 punch from 0x3c69c4a to 0x3c7324a, (0x9600 bytes) 2024-09-11T07:07:32.532 INFO:teuthology.orchestra.run.smithi079.stdout:5028 write 0x6dc8f81 thru 0x6dd844e (0xf4ce bytes) 2024-09-11T07:07:32.540 INFO:teuthology.orchestra.run.smithi079.stdout:5029 write 0x10ef012 thru 0x10f5561 (0x6550 bytes) 2024-09-11T07:07:32.549 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:32.549 INFO:teuthology.orchestra.run.smithi079.stdout:5031 read 0x1d21466 thru 0x1d27b61 (0x66fc bytes) 2024-09-11T07:07:32.550 INFO:teuthology.orchestra.run.smithi079.stdout:5032 write 0xdde17e6 thru 0xdde9174 (0x798f bytes) 2024-09-11T07:07:32.569 INFO:teuthology.orchestra.run.smithi079.stdout:5033 trunc from 0xe49f47f to 0x75cb7ec 2024-09-11T07:07:32.585 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:32.585 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:32.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:32.601 INFO:teuthology.orchestra.run.smithi079.stdout:5034 trunc from 0x75cb7ec to 0x5d68a87 2024-09-11T07:07:32.630 INFO:teuthology.orchestra.run.smithi079.stdout:5036 read 0x4af5be5 thru 0x4afa8c1 (0x4cdd bytes) 2024-09-11T07:07:32.630 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:32.628+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:32.646 INFO:teuthology.orchestra.run.smithi079.stdout:5037 writesame 0x83adf49 thru 0x83b92da data_size 0x5(0xb392 bytes) 2024-09-11T07:07:32.646 INFO:teuthology.orchestra.run.smithi079.stdout:5038 writesame 0x8328d1b thru 0x832ac9a data_size 0x48(0x1f80 bytes) 2024-09-11T07:07:32.661 INFO:teuthology.orchestra.run.smithi079.stdout:5040 trunc from 0x83b92db to 0x35f38be 2024-09-11T07:07:32.704 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:32.704+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:32.715 INFO:teuthology.orchestra.run.smithi079.stdout:5042 write 0x8355356 thru 0x8355c22 (0x8cd bytes) 2024-09-11T07:07:32.722 INFO:teuthology.orchestra.run.smithi079.stdout:5043 write 0x40b4866 thru 0x40c24e2 (0xdc7d bytes) 2024-09-11T07:07:32.728 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:32.728 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:32.731 INFO:teuthology.orchestra.run.smithi079.stdout:5044 read 0x2c658a5 thru 0x2c6b357 (0x5ab3 bytes) 2024-09-11T07:07:32.732 INFO:teuthology.orchestra.run.smithi079.stdout:5045 punch from 0x64049fa to 0x64104f9, (0xbaff bytes) 2024-09-11T07:07:32.732 INFO:teuthology.orchestra.run.smithi079.stdout:5046 read 0x7c095b0 thru 0x7c1573d (0xc18e bytes) 2024-09-11T07:07:32.733 INFO:teuthology.orchestra.run.smithi079.stdout:5047 write 0x253c3fc thru 0x254258c (0x6191 bytes) 2024-09-11T07:07:32.737 INFO:teuthology.orchestra.run.smithi079.stdout:5049 write 0x1b7dfa7 thru 0x1b8d8e8 (0xf942 bytes) 2024-09-11T07:07:32.744 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:32.773 INFO:teuthology.orchestra.run.smithi079.stdout:5050 write 0xdb38c31 thru 0xdb3ac38 (0x2008 bytes) 2024-09-11T07:07:32.795 INFO:teuthology.orchestra.run.smithi079.stdout:5051 trunc from 0xdb3ac39 to 0x7dbd787 2024-09-11T07:07:32.805 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:32.804+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:32.821 INFO:teuthology.orchestra.run.smithi079.stdout:5052 write 0x2e87b54 thru 0x2e892e4 (0x1791 bytes) 2024-09-11T07:07:32.849 INFO:teuthology.orchestra.run.smithi079.stdout:5055 write 0xae7c2b4 thru 0xae7c89c (0x5e9 bytes) 2024-09-11T07:07:32.856 INFO:teuthology.orchestra.run.smithi079.stdout:5056 write 0x3b8fb1d thru 0x3b9cc2e (0xd112 bytes) 2024-09-11T07:07:32.865 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:32.865 INFO:teuthology.orchestra.run.smithi079.stdout:5058 write 0x24002e6 thru 0x2401119 (0xe34 bytes) 2024-09-11T07:07:32.873 INFO:teuthology.orchestra.run.smithi079.stdout:5059 trunc from 0xae7c89d to 0xca23821 2024-09-11T07:07:32.886 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:32.886 INFO:teuthology.orchestra.run.smithi079.stdout:5062 read 0xb9eb968 thru 0xb9ec1ba (0x853 bytes) 2024-09-11T07:07:32.902 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:32.902 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:32.905 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:32.904+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:32.914 INFO:teuthology.orchestra.run.smithi079.stdout:5063 trunc from 0xca23821 to 0x1699d9 2024-09-11T07:07:32.923 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:32.953 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:32.971 INFO:teuthology.orchestra.run.smithi079.stdout:5065 trunc from 0x1699d9 to 0xaac0ab4 2024-09-11T07:07:32.984 INFO:teuthology.orchestra.run.smithi079.stdout:5066 writesame 0x1f6fa27 thru 0x1f7ba39 data_size 0x1(0xc013 bytes) 2024-09-11T07:07:33.007 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:33.004+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:33.049 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:33.049 INFO:teuthology.orchestra.run.smithi079.stdout:5068 punch from 0x55af09c to 0x55b34c4, (0x4428 bytes) 2024-09-11T07:07:33.049 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:33.057 INFO:teuthology.orchestra.run.smithi079.stdout:5070 trunc from 0xaac0ab4 to 0x740928f 2024-09-11T07:07:33.071 INFO:teuthology.orchestra.run.smithi079.stdout:5071 write 0x35ead8d thru 0x35ee470 (0x36e4 bytes) 2024-09-11T07:07:33.085 INFO:teuthology.orchestra.run.smithi079.stdout:5072 trunc from 0x740928f to 0xa177e0d 2024-09-11T07:07:33.087 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:33.087 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:33.102 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:33.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:33.117 INFO:teuthology.orchestra.run.smithi079.stdout:5073 trunc from 0xa177e0d to 0x281423f 2024-09-11T07:07:33.117 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:33.116+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:33.157 INFO:teuthology.orchestra.run.smithi079.stdout:5077 write 0x52e0929 thru 0x52e27c7 (0x1e9f bytes) 2024-09-11T07:07:33.163 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:33.163 INFO:teuthology.orchestra.run.smithi079.stdout:5079 write 0xe0b693 thru 0xe19030 (0xd99e bytes) 2024-09-11T07:07:33.171 INFO:teuthology.orchestra.run.smithi079.stdout:5080 punch from 0x30f534a to 0x30f5f15, (0xbcb bytes) 2024-09-11T07:07:33.172 INFO:teuthology.orchestra.run.smithi079.stdout:5081 punch from 0x43541d8 to 0x435918e, (0x4fb6 bytes) 2024-09-11T07:07:33.172 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:33.172 INFO:teuthology.orchestra.run.smithi079.stdout:5083 write 0x410d519 thru 0x41119c2 (0x44aa bytes) 2024-09-11T07:07:33.191 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:07:33.205 INFO:teuthology.orchestra.run.smithi079.stdout:5084 writesame 0xa9e1694 thru 0xa9ed01f data_size 0x7d(0xb98c bytes) 2024-09-11T07:07:33.205 INFO:teuthology.orchestra.run.smithi079.stdout:5085 trunc from 0xa9ed020 to 0xaf390a4 2024-09-11T07:07:33.208 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:33.208+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout:5087 write 0xed12971 thru 0xed15b90 (0x3220 bytes) 2024-09-11T07:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:33.243 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:33.250 INFO:teuthology.orchestra.run.smithi079.stdout:5089 punch from 0x8161db8 to 0x8167b41, (0x5d89 bytes) 2024-09-11T07:07:33.250 INFO:teuthology.orchestra.run.smithi079.stdout:5091 write 0xa3bfaa9 thru 0xa3c47d3 (0x4d2b bytes) 2024-09-11T07:07:33.259 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:33.260 INFO:teuthology.orchestra.run.smithi079.stdout:5092 clone 42 order 22 su 524288 sc 15 2024-09-11T07:07:33.265 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:33.265 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:33.282 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:33.282 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:33.300 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:33.300 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:33.310 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:33.308+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:33.316 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:33.317 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:33.337 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:33.337 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:33.358 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:33.378 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:33.379 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:33.381 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:33.381 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:33.381 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:33.381 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:33.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:33.400 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:33.400 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:33.411 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:33.408+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:33.512 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:33.508+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:33.513 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:33.513 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:33.513 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:33.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:33.614 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:33.612+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:33.648 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:33.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 56.021728588999999, 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.649 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:07:33.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:07:33.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59115 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.635127036, 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038255633999999997, 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59115 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010877+0000", 2024-09-11T07:07:33.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.083e-06 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010885+0000", 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0400000000000004e-06 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010931+0000", 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6452000000000002e-05 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010947+0000", 2024-09-11T07:07:33.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5786000000000001e-05 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049022+0000", 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038075472999999999 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049076+0000", 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4131000000000001e-05 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049132+0000", 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5668999999999998e-05 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59119 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.635035385999998, 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038492673999999998, 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.659 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59119 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010969+0000", 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010976+0000", 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4529999999999999e-06 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010994+0000", 2024-09-11T07:07:33.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8672999999999999e-05 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011009+0000", 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4122e-05 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049189+0000", 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038180218000000002 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049342+0000", 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015341899999999999 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049461+0000", 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118522 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59138 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.634976571000003, 2024-09-11T07:07:33.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038631255000000003, 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59138 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011028+0000", 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011034+0000", 2024-09-11T07:07:33.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011049+0000", 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5702999999999999e-05 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011063+0000", 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3373000000000001e-05 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049512+0000", 2024-09-11T07:07:33.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038449050999999998 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049601+0000", 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9395999999999996e-05 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049658+0000", 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6861999999999999e-05 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59147 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.634737889, 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038436533000000002, 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59147 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.668 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011267+0000", 2024-09-11T07:07:33.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.46e-06 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011278+0000", 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.119e-05 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011457+0000", 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017874699999999999 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011481+0000", 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4283000000000001e-05 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049693+0000", 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038212053000000003 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049702+0000", 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.671 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59148 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.634480711000002, 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038227694999999999, 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59148 2024-09-11T07:07:33.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011525+0000", 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011536+0000", 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011561+0000", 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5494999999999999e-05 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011579+0000", 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7292999999999999e-05 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049739+0000", 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038159803999999999 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049750+0000", 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59149 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.6343994, 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038196747000000003, 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.676 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59149 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011605+0000", 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011614+0000", 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3219999999999993e-06 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011634+0000", 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0703000000000002e-05 2024-09-11T07:07:33.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011649+0000", 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4603000000000001e-05 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049788+0000", 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038138500999999998 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049801+0000", 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3244000000000001e-05 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59150 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.634333378999997, 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038171956999999999, 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:33.680 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59150 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:33.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011671+0000", 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011678+0000", 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011696+0000", 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-05 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011710+0000", 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3516000000000001e-05 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049835+0000", 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038125004999999997 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049842+0000", 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0299999999999996e-06 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59153 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.634158608, 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038163669999999997, 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59153 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011846+0000", 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1939999999999999e-06 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011853+0000", 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6030000000000001e-06 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011870+0000", 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7739000000000001e-05 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011884+0000", 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.402e-05 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049993+0000", 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038108988000000003 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050009+0000", 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5126000000000001e-05 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59154 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.634097670000003, 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038170655999999997, 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.688 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59154 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011907+0000", 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1739999999999999e-06 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011974+0000", 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7200999999999996e-05 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011995+0000", 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1058999999999999e-05 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012015+0000", 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9857e-05 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050060+0000", 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038045074999999998 2024-09-11T07:07:33.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050076+0000", 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6290000000000002e-05 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:70560 3.2 3:459eba64:::rbd_data.11618cc4d69.000000000000003a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.185867066, 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064825956000000004, 2024-09-11T07:07:33.692 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 70560 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460139+0000", 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460150+0000", 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0824e-05 2024-09-11T07:07:33.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460178+0000", 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8449000000000002e-05 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460199+0000", 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1075999999999999e-05 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460319+0000", 2024-09-11T07:07:33.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119714 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460451+0000", 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013264 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.472543+0000", 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091437 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524779+0000", 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052236339 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524853+0000", 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524913+0000", 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0825000000000001e-05 2024-09-11T07:07:33.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524962+0000", 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8999999999999998e-05 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71632 3.18 3:194b1b54:::rbd_data.1161b94a6d64.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.203609739999999, 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039963481000000002, 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71632 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442395+0000", 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442403+0000", 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6210000000000004e-06 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442416+0000", 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3011e-05 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442422+0000", 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2620000000000004e-06 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442495+0000", 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2977000000000003e-05 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442647+0000", 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015205199999999999 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.450708+0000", 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080612589999999994 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482090+0000", 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031381543999999997 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482176+0000", 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6302000000000001e-05 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482279+0000", 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010242399999999999 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482357+0000", 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8565000000000004e-05 2024-09-11T07:07:33.703 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73806 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14024704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0632029149999997, 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038245594000000001, 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.704 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73806 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582804+0000", 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.836e-06 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582813+0000", 2024-09-11T07:07:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030000000000003e-06 2024-09-11T07:07:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582820+0000", 2024-09-11T07:07:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9e-06 2024-09-11T07:07:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620766+0000", 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037946800000000003 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620895+0000", 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012861799999999999 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621046+0000", 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015100700000000001 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.709 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73807 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14417920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0631752129999992, 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038841537000000002, 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.710 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73807 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.711 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582829+0000", 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582857+0000", 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.779e-05 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582874+0000", 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7584999999999999e-05 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.712 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582882+0000", 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7999999999999999e-06 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621135+0000", 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038253044 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621390+0000", 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000254689 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621670+0000", 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027999500000000001 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73808 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14811136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0631101540000003, 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039162267000000001, 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.714 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73808 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:07:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582894+0000", 2024-09-11T07:07:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-09-11T07:07:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582897+0000", 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4240000000000002e-06 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582907+0000", 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4299999999999995e-06 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582919+0000", 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1826e-05 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621769+0000", 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038850735999999997 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621898+0000", 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012898099999999999 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622056+0000", 2024-09-11T07:07:33.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015718000000000001 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73809 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15204352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0630760380000002, 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039738290000000002, 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.719 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73809 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.720 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582928+0000", 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9999999999999997e-07 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582932+0000", 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8029999999999998e-06 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582947+0000", 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5099999999999999e-05 2024-09-11T07:07:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582959+0000", 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.206e-05 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622144+0000", 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039184999999999998 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622390+0000", 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024606600000000003 2024-09-11T07:07:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622666+0000", 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027566100000000002 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73810 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15597568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0630273389999996, 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040289497000000001, 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73810 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582977+0000", 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0100000000000001e-06 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582983+0000", 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583000+0000", 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7237000000000001e-05 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583014+0000", 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4076999999999999e-05 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622759+0000", 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039744806000000001 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622998+0000", 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000239385 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623266+0000", 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026730900000000003 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.727 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73811 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15990784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0629713200000008, 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040666513000000001, 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73811 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583033+0000", 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.037e-06 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583039+0000", 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583079+0000", 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0438999999999997e-05 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583092+0000", 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2367e-05 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623365+0000", 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040273182999999997 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623518+0000", 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015322099999999999 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623699+0000", 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018055299999999999 2024-09-11T07:07:33.731 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73812 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 16384000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 8.0628989410000003, 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041168972999999998, 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.732 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73812 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583109+0000", 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1799999999999998e-06 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583120+0000", 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0380000000000001e-05 2024-09-11T07:07:33.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583127+0000", 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.029e-06 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623766+0000", 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040639210000000002 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624006+0000", 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240466 2024-09-11T07:07:33.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624273+0000", 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026699100000000001 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:74137 3.1 3:833ccc20:::rbd_data.1161634664ee.0000000000000009:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 7.8536512739999997, 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045679127999999999, 2024-09-11T07:07:33.736 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 74137 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792355+0000", 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.23e-06 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792368+0000", 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449000000000001e-05 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792398+0000", 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0519999999999999e-05 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792413+0000", 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4216000000000001e-05 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792538+0000", 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012526099999999999 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792679+0000", 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014143099999999999 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.800911+0000", 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082317989999999997 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837839+0000", 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036927588999999997 2024-09-11T07:07:33.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837869+0000", 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0355999999999999e-05 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837956+0000", 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6967999999999998e-05 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:33.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.838031+0000", 2024-09-11T07:07:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5308999999999993e-05 2024-09-11T07:07:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:33.742 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:33.742 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:33.743 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:33.744 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:33.740+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:33.845 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:33.844+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:33.874 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:33.874 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:33.874 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:33.888 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:33.946 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:33.944+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:34.010 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:34.011 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:34.011 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:34.011 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:34.011 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:34.024 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:34.068 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:34.068+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:34.148 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:34.148+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.863457764000003, 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.863385680999997, 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.863330188000006, 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:34.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.66145822, 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:07:34.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.661395630000001, 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:07:34.171 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:07:34.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.661338573999998, 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.176 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.180 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.661282456999999, 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:07:34.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.661161195000005, 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.661056926000001, 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.189 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.193 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660951386999997, 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:07:34.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660884224, 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.198 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:07:34.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.202 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660785017999999, 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:07:34.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660698058999998, 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.211 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660637781999995, 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:07:34.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:07:34.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660484077000007, 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:07:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:07:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:07:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:07:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.220 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660396900999999, 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.221 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:07:34.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660332998000001, 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:07:34.225 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:07:34.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.229 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660273154999999, 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:07:34.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:07:34.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660195072999997, 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.234 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:07:34.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:34.238 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.660137302999999, 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:34.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:07:34.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.243 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.243 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:34.243 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:07:34.243 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:07:34.243 INFO:tasks.thrashosds.thrasher:reset_purged_snaps_last 2024-09-11T07:07:34.243 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 reset_purged_snaps_last 2024-09-11T07:07:34.245 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:34.289 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:34.288+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:34.350 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:34.348+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:34.418 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:34.418 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:34.418 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:34.420 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 reset_purged_snaps_last 2024-09-11T07:07:34.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:34.465 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:34.464+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:34.552 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:34.552+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:34.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 reset_purged_snaps_last 2024-09-11T07:07:34.593 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:34.593 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:34.593 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:34.606 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:34.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:34.664+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:34.754 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:34.752+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:34.774 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461882994000007, 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:07:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461815439999995, 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:07:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:07:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461734602999996, 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:07:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:07:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461691256999998, 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461621132000005, 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:07:34.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461553007999996, 2024-09-11T07:07:34.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:34.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461512541999994, 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:07:34.802 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:07:34.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461474500999998, 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:07:34.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:07:34.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:07:34.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:07:34.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:07:34.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461435531000006, 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.812 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:34.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461394657, 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.816 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:07:34.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:07:34.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:07:34.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:07:34.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461066884000005, 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.821 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:07:34.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:07:34.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.461000373999994, 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:07:34.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.460932654999993, 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.830 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:34.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.834 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.460887717000006, 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:07:34.838 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.460088092000007, 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:07:34.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:07:34.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.46005375, 2024-09-11T07:07:34.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:34.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:07:34.847 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.459691074999995, 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.848 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19174 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 4096~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.458428049999995, 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061111327, 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19174 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312931+0000", 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312932+0000", 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6199999999999998e-07 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312934+0000", 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3089999999999998e-06 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312941+0000", 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5780000000000004e-06 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312946+0000", 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9799999999999998e-06 2024-09-11T07:07:34.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373883+0000", 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060937844999999997 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373954+0000", 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0197000000000006e-05 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374042+0000", 2024-09-11T07:07:34.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8856000000000004e-05 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19175 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 40960~4096] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.458395550999995, 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061263959999999999, 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19175 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312964+0000", 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315149+0000", 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0021848739999999998 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315156+0000", 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2980000000000003e-06 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315171+0000", 2024-09-11T07:07:34.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.543e-05 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.315183+0000", 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2079000000000001e-05 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374073+0000", 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058890102 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374145+0000", 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1074000000000004e-05 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.374228+0000", 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3102999999999994e-05 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.861 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.521790124000006, 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:07:34.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:07:34.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:34.867 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:34.869 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 reset_purged_snaps_last 2024-09-11T07:07:34.870 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:34.868+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:34.870 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:34.969 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:34.968+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:35.039 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:35.039 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:35.039 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:35.054 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:35.070 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:35.068+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:35.088 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 reset_purged_snaps_last 2024-09-11T07:07:35.177 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:35.176+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:35.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:07:35.223 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:35.223 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:35.223 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:35.223 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:35.223 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:35.237 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:35.285 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:35.284+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:35.325 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 reset_purged_snaps_last 2024-09-11T07:07:35.362 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 81.037147868000005, 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:07:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.734208773000006, 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.734145656999999, 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:07:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:07:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.734070664000001, 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:07:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.734006108000003, 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.733950879000005, 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:07:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:07:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:07:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:07:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:07:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:07:35.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:35.392 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.733896982000005, 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.396 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.733836483000005, 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:07:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:07:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.733780469999999, 2024-09-11T07:07:35.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:35.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:07:35.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:07:35.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:07:35.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.733701116999995, 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:07:35.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:35.410 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.733644814000002, 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:07:35.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.733572374999994, 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.415 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:07:35.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:07:35.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.733516254999998, 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:07:35.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:07:35.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.733442788999994, 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:07:35.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:07:35.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:35.429 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.733364395999999, 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:07:35.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:07:35.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.824188382000003, 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:35.434 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:07:35.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.5676027969999993, 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:35.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:07:35.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:35.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:07:35.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81868 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 262144 write_size 262144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561574+0000", 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.7978050410000002, 2024-09-11T07:07:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012397137000000001, 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81868 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561574+0000", 2024-09-11T07:07:35.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561574+0000", 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561575+0000", 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2399999999999999e-07 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561743+0000", 2024-09-11T07:07:35.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016862299999999999 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561753+0000", 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.9490000000000008e-06 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561760+0000", 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.55e-06 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.564919+0000", 2024-09-11T07:07:35.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0031593939999999998 2024-09-11T07:07:35.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.564999+0000", 2024-09-11T07:07:35.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9369999999999994e-05 2024-09-11T07:07:35.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:35.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.565241+0000", 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024243100000000001 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570362+0000", 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0051203999999999998 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.573829+0000", 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034676109999999998 2024-09-11T07:07:35.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.573923+0000", 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3721999999999995e-05 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.573972+0000", 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8763000000000001e-05 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.7976087859999996, 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:07:35.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.453 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:35.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:35.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:07:35.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:07:35.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.7896188909999999, 2024-09-11T07:07:35.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:35.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.462 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.463 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.463 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:35.463 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:35.463 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:35.463 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:35.465 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:35.460+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:35.465 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:35.504 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 reset_purged_snaps_last 2024-09-11T07:07:35.596 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:35.596 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:35.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:35.596+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:35.612 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:35.612 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:35.629 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:35.629 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:35.637 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:35.637 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:35.637 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:35.644 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:35.645 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:35.651 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:35.663 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:35.663 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:35.680 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:35.681 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:35.697 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:35.696+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:35.697 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:35.697 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:35.713 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:35.713 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:35.767 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:35.764+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:35.781 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:35.781 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:35.795 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:35.881 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:35.880+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:35.956 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:35.957 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:35.968 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:35.968+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:35.970 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:36.069 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:36.068+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:36.098 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:36.098 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:36.112 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:36.170 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:36.168+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:36.225 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:07:36.235 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:36.235 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:36.253 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:36.271 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone41 from 0xed15b91 (overlap 0x1699d9) to 0x4852b 2024-09-11T07:07:36.272 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:36.268+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:36.372 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:36.371+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:36.413 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:36.446 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:36.447 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #40, image image_client.0-clone40 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent41 2024-09-11T07:07:36.448 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:36.493 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:36.492+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:36.577 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:36.571+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:36.626 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:36.626 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:36.645 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:36.674 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:36.671+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:36.777 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:36.775+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:36.827 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:36.827 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:36.828 INFO:teuthology.orchestra.run.smithi079.stdout:5093 write 0xd775dcf thru 0xd77b7d5 (0x5a07 bytes) 2024-09-11T07:07:36.843 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:36.843 INFO:teuthology.orchestra.run.smithi079.stdout:5094 read 0x7c8bc0 thru 0x7d67ac (0xdbed bytes) 2024-09-11T07:07:36.844 INFO:teuthology.orchestra.run.smithi079.stdout:5095 write 0xe62408f thru 0xe6297e0 (0x5752 bytes) 2024-09-11T07:07:36.845 INFO:teuthology.orchestra.run.smithi079.stdout:5096 punch from 0x22f5da3 to 0x22ffff3, (0xa250 bytes) 2024-09-11T07:07:36.845 INFO:teuthology.orchestra.run.smithi079.stdout:5097 write 0x9789bd0 thru 0x979569b (0xbacc bytes) 2024-09-11T07:07:36.852 INFO:teuthology.orchestra.run.smithi079.stdout:5101 write 0x1a4999e thru 0x1a51b6b (0x81ce bytes) 2024-09-11T07:07:36.857 INFO:teuthology.orchestra.run.smithi079.stdout:5104 punch from 0x1e92004 to 0x1e99ca0, (0x7c9c bytes) 2024-09-11T07:07:36.857 INFO:teuthology.orchestra.run.smithi079.stdout:5106 read 0x5409467 thru 0x5411e9b (0x8a35 bytes) 2024-09-11T07:07:36.857 INFO:teuthology.orchestra.run.smithi079.stdout:5108 read 0xdaba505 thru 0xdac5596 (0xb092 bytes) 2024-09-11T07:07:36.857 INFO:teuthology.orchestra.run.smithi079.stdout:5109 writesame 0xa2d3d19 thru 0xa2d61d2 data_size 0x3(0x24ba bytes) 2024-09-11T07:07:36.863 INFO:teuthology.orchestra.run.smithi079.stdout:5110 write 0x8e808ba thru 0x8e8b840 (0xaf87 bytes) 2024-09-11T07:07:36.869 INFO:teuthology.orchestra.run.smithi079.stdout:5111 write 0x947bed0 thru 0x947cf8b (0x10bc bytes) 2024-09-11T07:07:36.874 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:36.874 INFO:teuthology.orchestra.run.smithi079.stdout:5115 write 0xd5e0ecc thru 0xd5e495c (0x3a91 bytes) 2024-09-11T07:07:36.878 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:36.876+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:36.879 INFO:teuthology.orchestra.run.smithi079.stdout:5116 clone 43 order 23 su 524288 sc 15 2024-09-11T07:07:36.956 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:36.957 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:36.969 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:36.979 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:36.975+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:37.079 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:37.075+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:37.133 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:37.133 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:37.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:37.181 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:37.179+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:37.280 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:37.280 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:37.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:37.280+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:37.296 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:37.385 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:37.383+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:37.451 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:37.451 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:37.465 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:37.486 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:37.483+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:37.587 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:37.584+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:37.587 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:37.587 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:37.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:37.689 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:37.688+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:37.729 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:37.765 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:37.765 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:37.778 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:37.789 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:37.787+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:37.866 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:37.866 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:37.883 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:37.883 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:37.890 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:37.887+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:37.900 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:37.901 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:37.917 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:37.917 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:37.938 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:37.938 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:37.947 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.947 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:07:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 60.321639116, 2024-09-11T07:07:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:07:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.948 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:07:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:07:37.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:37.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:37.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59115 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.935037563000002, 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038255633999999997, 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59115 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010877+0000", 2024-09-11T07:07:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.083e-06 2024-09-11T07:07:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010885+0000", 2024-09-11T07:07:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0400000000000004e-06 2024-09-11T07:07:37.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010931+0000", 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6452000000000002e-05 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010947+0000", 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5786000000000001e-05 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049022+0000", 2024-09-11T07:07:37.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038075472999999999 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049076+0000", 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4131000000000001e-05 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049132+0000", 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5668999999999998e-05 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59119 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.934945913, 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038492673999999998, 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59119 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.960 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010969+0000", 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010976+0000", 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4529999999999999e-06 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010994+0000", 2024-09-11T07:07:37.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8672999999999999e-05 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011009+0000", 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4122e-05 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049189+0000", 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038180218000000002 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049342+0000", 2024-09-11T07:07:37.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015341899999999999 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049461+0000", 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118522 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59138 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.934887097999997, 2024-09-11T07:07:37.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038631255000000003, 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59138 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011028+0000", 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011034+0000", 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011049+0000", 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5702999999999999e-05 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011063+0000", 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3373000000000001e-05 2024-09-11T07:07:37.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049512+0000", 2024-09-11T07:07:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038449050999999998 2024-09-11T07:07:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049601+0000", 2024-09-11T07:07:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9395999999999996e-05 2024-09-11T07:07:37.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049658+0000", 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6861999999999999e-05 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59147 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.934648416000002, 2024-09-11T07:07:37.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038436533000000002, 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59147 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011267+0000", 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.46e-06 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011278+0000", 2024-09-11T07:07:37.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.119e-05 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011457+0000", 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017874699999999999 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011481+0000", 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4283000000000001e-05 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:37.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049693+0000", 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038212053000000003 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049702+0000", 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59148 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:37.973 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.934391238000003, 2024-09-11T07:07:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038227694999999999, 2024-09-11T07:07:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59148 2024-09-11T07:07:37.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011525+0000", 2024-09-11T07:07:37.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011536+0000", 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011561+0000", 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5494999999999999e-05 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011579+0000", 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7292999999999999e-05 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049739+0000", 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038159803999999999 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049750+0000", 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.977 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59149 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.934309927000001, 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038196747000000003, 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.978 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59149 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011605+0000", 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011614+0000", 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3219999999999993e-06 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011634+0000", 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0703000000000002e-05 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011649+0000", 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4603000000000001e-05 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:37.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049788+0000", 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038138500999999998 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049801+0000", 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3244000000000001e-05 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.982 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59150 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.934243905999999, 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038171956999999999, 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59150 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011671+0000", 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011678+0000", 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011696+0000", 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-05 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011710+0000", 2024-09-11T07:07:37.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3516000000000001e-05 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049835+0000", 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038125004999999997 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049842+0000", 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0299999999999996e-06 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59153 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.934069135000001, 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038163669999999997, 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59153 2024-09-11T07:07:37.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011845+0000", 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011846+0000", 2024-09-11T07:07:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1939999999999999e-06 2024-09-11T07:07:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011853+0000", 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6030000000000001e-06 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011870+0000", 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7739000000000001e-05 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011884+0000", 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.402e-05 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049993+0000", 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038108988000000003 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050009+0000", 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5126000000000001e-05 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.991 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59154 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:07:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.934008196999997, 2024-09-11T07:07:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038170655999999997, 2024-09-11T07:07:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:07:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59154 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011907+0000", 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1739999999999999e-06 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011974+0000", 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7200999999999996e-05 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011995+0000", 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1058999999999999e-05 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012015+0000", 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9857e-05 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050060+0000", 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038045074999999998 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050076+0000", 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6290000000000002e-05 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:70560 3.2 3:459eba64:::rbd_data.11618cc4d69.000000000000003a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 22.485777593000002, 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064825956000000004, 2024-09-11T07:07:37.996 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 70560 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:37.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460139+0000", 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:37.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460150+0000", 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0824e-05 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460178+0000", 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8449000000000002e-05 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460199+0000", 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1075999999999999e-05 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:37.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460319+0000", 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119714 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460451+0000", 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013264 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.472543+0000", 2024-09-11T07:07:38.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091437 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524779+0000", 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052236339 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524853+0000", 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:38.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524913+0000", 2024-09-11T07:07:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0825000000000001e-05 2024-09-11T07:07:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524962+0000", 2024-09-11T07:07:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8999999999999998e-05 2024-09-11T07:07:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71632 3.18 3:194b1b54:::rbd_data.1161b94a6d64.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.503520266999999, 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039963481000000002, 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71632 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.003 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:38.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442395+0000", 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442403+0000", 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6210000000000004e-06 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442416+0000", 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3011e-05 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442422+0000", 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2620000000000004e-06 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442495+0000", 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2977000000000003e-05 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442647+0000", 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015205199999999999 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.450708+0000", 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080612589999999994 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482090+0000", 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031381543999999997 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482176+0000", 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6302000000000001e-05 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482279+0000", 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010242399999999999 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482357+0000", 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8565000000000004e-05 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73806 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14024704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.363113442, 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038245594000000001, 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73806 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.009 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:38.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582804+0000", 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.836e-06 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582813+0000", 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030000000000003e-06 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582820+0000", 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9e-06 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620766+0000", 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037946800000000003 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:38.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620895+0000", 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012861799999999999 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621046+0000", 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015100700000000001 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73807 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14417920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.363085740000001, 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038841537000000002, 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73807 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.014 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:38.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582829+0000", 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582857+0000", 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.779e-05 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582874+0000", 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7584999999999999e-05 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582882+0000", 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7999999999999999e-06 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621135+0000", 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038253044 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621390+0000", 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000254689 2024-09-11T07:07:38.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621670+0000", 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027999500000000001 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73808 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14811136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.363020681, 2024-09-11T07:07:38.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039162267000000001, 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73808 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:07:38.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:38.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:07:38.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:38.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582894+0000", 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582897+0000", 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4240000000000002e-06 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582907+0000", 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4299999999999995e-06 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582919+0000", 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1826e-05 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621769+0000", 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038850735999999997 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621898+0000", 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012898099999999999 2024-09-11T07:07:38.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622056+0000", 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015718000000000001 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73809 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15204352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.362986565, 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039738290000000002, 2024-09-11T07:07:38.023 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73809 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:07:38.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582928+0000", 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9999999999999997e-07 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:38.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582932+0000", 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8029999999999998e-06 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582947+0000", 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5099999999999999e-05 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582959+0000", 2024-09-11T07:07:38.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.206e-05 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622144+0000", 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039184999999999998 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622390+0000", 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024606600000000003 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:38.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622666+0000", 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027566100000000002 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73810 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15597568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.362937865999999, 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040289497000000001, 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:38.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73810 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:38.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582977+0000", 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0100000000000001e-06 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582983+0000", 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583000+0000", 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7237000000000001e-05 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583014+0000", 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4076999999999999e-05 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622759+0000", 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039744806000000001 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622998+0000", 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000239385 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623266+0000", 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026730900000000003 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.032 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73811 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15990784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.362881847000001, 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040666513000000001, 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73811 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583033+0000", 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.037e-06 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583039+0000", 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583079+0000", 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0438999999999997e-05 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583092+0000", 2024-09-11T07:07:38.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2367e-05 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623365+0000", 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040273182999999997 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623518+0000", 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015322099999999999 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:38.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623699+0000", 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018055299999999999 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73812 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 16384000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.362809468, 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041168972999999998, 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:38.037 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73812 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:38.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583109+0000", 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1799999999999998e-06 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583120+0000", 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0380000000000001e-05 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583127+0000", 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.029e-06 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623766+0000", 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040639210000000002 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624006+0000", 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240466 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624273+0000", 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026699100000000001 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.041 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:74137 3.1 3:833ccc20:::rbd_data.1161634664ee.0000000000000009:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 12.153561801, 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045679127999999999, 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 74137 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:38.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792355+0000", 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.23e-06 2024-09-11T07:07:38.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792368+0000", 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449000000000001e-05 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792398+0000", 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0519999999999999e-05 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792413+0000", 2024-09-11T07:07:38.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4216000000000001e-05 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792538+0000", 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012526099999999999 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792679+0000", 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014143099999999999 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:38.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.800911+0000", 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082317989999999997 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837839+0000", 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036927588999999997 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837869+0000", 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0355999999999999e-05 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837956+0000", 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6967999999999998e-05 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.838031+0000", 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5308999999999993e-05 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:38.047 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:38.048 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:38.049 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:38.050 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:38.050 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:38.050 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:38.051 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:38.051 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:38.052 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:38.048+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:38.150 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:38.147+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:38.182 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:38.182 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:38.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:38.250 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:38.248+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:38.253 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:07:38.277 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone42 from 0xed15b91 (overlap 0xed15b91) to 0x17b55f4 2024-09-11T07:07:38.351 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:38.348+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:38.383 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:38.384 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:38.384 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:38.384 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:38.384 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:38.398 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:38.452 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:38.451+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:38.463 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #41, image image_client.0-clone41 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent42 2024-09-11T07:07:38.468 INFO:teuthology.orchestra.run.smithi079.stdout:5117 writesame 0xd84b6fa thru 0xd84cdb2 data_size 0x7(0x16b9 bytes) 2024-09-11T07:07:38.486 INFO:teuthology.orchestra.run.smithi079.stdout:5119 read 0x2b38c9c thru 0x2b404ba (0x781f bytes) 2024-09-11T07:07:38.486 INFO:teuthology.orchestra.run.smithi079.stdout:5120 read 0x2f745df thru 0x2f7dc27 (0x9649 bytes) 2024-09-11T07:07:38.486 INFO:teuthology.orchestra.run.smithi079.stdout:5121 punch from 0x91188c2 to 0x911b797, (0x2ed5 bytes) 2024-09-11T07:07:38.486 INFO:teuthology.orchestra.run.smithi079.stdout:5122 punch from 0xd475364 to 0xd4788e4, (0x3580 bytes) 2024-09-11T07:07:38.486 INFO:teuthology.orchestra.run.smithi079.stdout:5123 read 0xbd32492 thru 0xbd32c06 (0x775 bytes) 2024-09-11T07:07:38.486 INFO:teuthology.orchestra.run.smithi079.stdout:5125 write 0xbad07ba thru 0xbada3a9 (0x9bf0 bytes) 2024-09-11T07:07:38.492 INFO:teuthology.orchestra.run.smithi079.stdout:5127 write 0xd16aa21 thru 0xd16f6f2 (0x4cd2 bytes) 2024-09-11T07:07:38.494 INFO:teuthology.orchestra.run.smithi079.stdout:5128 read 0xd6dd596 thru 0xd6e084c (0x32b7 bytes) 2024-09-11T07:07:38.494 INFO:teuthology.orchestra.run.smithi079.stdout:5129 write 0x2c03ae0 thru 0x2c133ad (0xf8ce bytes) 2024-09-11T07:07:38.513 INFO:teuthology.orchestra.run.smithi079.stdout:5130 read 0xcb146c9 thru 0xcb19a1d (0x5355 bytes) 2024-09-11T07:07:38.513 INFO:teuthology.orchestra.run.smithi079.stdout:5131 read 0x504975c thru 0x504bc73 (0x2518 bytes) 2024-09-11T07:07:38.513 INFO:teuthology.orchestra.run.smithi079.stdout:5133 writesame 0xc4b9106 thru 0xc4c2d6f data_size 0x1(0x9c6a bytes) 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.240300578000003, 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.530 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:07:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:07:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:07:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:07:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:07:38.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.240228494999997, 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.535 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.536 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.536 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:07:38.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.536 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:07:38.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.240173002000006, 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.540 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:07:38.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.038301034, 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.545 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:07:38.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.038238444000001, 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.549 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:07:38.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.038181387999998, 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.554 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:07:38.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.038125270999998, 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.558 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:07:38.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.038004009000005, 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.563 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:07:38.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.03789974, 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:07:38.567 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:07:38.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.571 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.037794200999997, 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:07:38.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:07:38.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:38.576 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.037727038, 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:07:38.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.037627831999998, 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.581 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:07:38.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.037540872999998, 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:07:38.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.037480595999995, 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.590 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:07:38.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.037326891000006, 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:07:38.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:07:38.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:07:38.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.037239714999998, 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.599 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:38.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.603 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.037175812000001, 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:07:38.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:07:38.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.037115968999998, 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:38.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.612 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.037037886999997, 2024-09-11T07:07:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:07:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:07:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:38.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.619 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.036980116999999, 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:38.620 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:07:38.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:07:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:07:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:38.624 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:38.624 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:38.626 INFO:teuthology.orchestra.run.smithi079.stdout:5134 write 0x332a645 thru 0x33358c7 (0xb283 bytes) 2024-09-11T07:07:38.626 INFO:teuthology.orchestra.run.smithi079.stdout:5136 read 0x1d6363d thru 0x1d6ff01 (0xc8c5 bytes) 2024-09-11T07:07:38.626 INFO:teuthology.orchestra.run.smithi079.stdout:5137 writesame 0xac48a4 thru 0xad35c2 data_size 0x1(0xed1f bytes) 2024-09-11T07:07:38.626 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:38.624+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:38.627 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:38.692 INFO:teuthology.orchestra.run.smithi079.stdout:5138 trunc from 0xed15b91 to 0x578dfa6 2024-09-11T07:07:38.727 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:38.724+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:38.768 INFO:teuthology.orchestra.run.smithi079.stdout:5139 punch from 0x2786706 to 0x2788194, (0x1a8e bytes) 2024-09-11T07:07:38.768 INFO:teuthology.orchestra.run.smithi079.stdout:5140 read 0x302d377 thru 0x3035d48 (0x89d2 bytes) 2024-09-11T07:07:38.768 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:38.793 INFO:teuthology.orchestra.run.smithi079.stdout:5142 write 0xa4299ec thru 0xa439619 (0xfc2e bytes) 2024-09-11T07:07:38.800 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:38.800 INFO:teuthology.orchestra.run.smithi079.stdout:5146 writesame 0x56bb43e thru 0x56bff6e data_size 0x1(0x4b31 bytes) 2024-09-11T07:07:38.820 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:38.821 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:38.821 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:38.821 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:38.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:38.824+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:38.835 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:38.839 INFO:teuthology.orchestra.run.smithi079.stdout:5147 writesame 0xe6e9b7c thru 0xe6f61a3 data_size 0x44(0xc628 bytes) 2024-09-11T07:07:38.839 INFO:teuthology.orchestra.run.smithi079.stdout:5149 write 0x2583343 thru 0x25842cd (0xf8b bytes) 2024-09-11T07:07:38.843 INFO:teuthology.orchestra.run.smithi079.stdout:5150 writesame 0xab9e280 thru 0xaba7e37 data_size 0xc(0x9bb8 bytes) 2024-09-11T07:07:38.848 INFO:teuthology.orchestra.run.smithi079.stdout:5151 write 0x2bf2cb9 thru 0x2bfffd4 (0xd31c bytes) 2024-09-11T07:07:38.852 INFO:teuthology.orchestra.run.smithi079.stdout:5152 punch from 0xe0608f0 to 0xe06708a, (0x679a bytes) 2024-09-11T07:07:38.884 INFO:teuthology.orchestra.run.smithi079.stdout:5153 trunc from 0xe6f61a4 to 0x1274a28 2024-09-11T07:07:38.912 INFO:teuthology.orchestra.run.smithi079.stdout:5154 read 0x169157 thru 0x16f05e (0x5f08 bytes) 2024-09-11T07:07:38.912 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:38.913 INFO:teuthology.orchestra.run.smithi079.stdout:5157 read 0x12659de thru 0x126ae5d (0x5480 bytes) 2024-09-11T07:07:38.913 INFO:teuthology.orchestra.run.smithi079.stdout:5158 punch from 0x818431 to 0x8214a5, (0x9074 bytes) 2024-09-11T07:07:38.928 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:38.924+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:38.930 INFO:teuthology.orchestra.run.smithi079.stdout:5160 write 0x3595d6f thru 0x3596c1e (0xeb0 bytes) 2024-09-11T07:07:38.963 INFO:teuthology.orchestra.run.smithi079.stdout:5162 writesame 0x915b1d9 thru 0x91642f6 data_size 0x19(0x911e bytes) 2024-09-11T07:07:38.964 INFO:teuthology.orchestra.run.smithi079.stdout:5163 punch from 0xef0c51 to 0xeff71d, (0xeacc bytes) 2024-09-11T07:07:38.964 INFO:teuthology.orchestra.run.smithi079.stdout:5164 read 0x68c072c thru 0x68c4bf9 (0x44ce bytes) 2024-09-11T07:07:38.964 INFO:teuthology.orchestra.run.smithi079.stdout:5165 read 0x34223d0 thru 0x342aaf3 (0x8724 bytes) 2024-09-11T07:07:38.965 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:38.965 INFO:teuthology.orchestra.run.smithi079.stdout:5167 punch from 0x156df7e to 0x1573a74, (0x5af6 bytes) 2024-09-11T07:07:38.965 INFO:teuthology.orchestra.run.smithi079.stdout:5168 read 0x1eeac5d thru 0x1ef8dd5 (0xe179 bytes) 2024-09-11T07:07:38.966 INFO:teuthology.orchestra.run.smithi079.stdout:5169 punch from 0x7c53d2e to 0x7c58593, (0x4865 bytes) 2024-09-11T07:07:38.966 INFO:teuthology.orchestra.run.smithi079.stdout:5171 write 0x64451dc thru 0x644ff3f (0xad64 bytes) 2024-09-11T07:07:38.967 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:38.967 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:38.967 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:38.970 INFO:teuthology.orchestra.run.smithi079.stdout:5172 punch from 0x4ed4de2 to 0x4ee278f, (0xd9ad bytes) 2024-09-11T07:07:38.978 INFO:teuthology.orchestra.run.smithi079.stdout:5173 trunc from 0x91642f7 to 0xc15c285 2024-09-11T07:07:38.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:38.989 INFO:teuthology.orchestra.run.smithi079.stdout:5174 read 0x416bc4d thru 0x416d76c (0x1b20 bytes) 2024-09-11T07:07:38.990 INFO:teuthology.orchestra.run.smithi079.stdout:5175 write 0xb49c881 thru 0xb4aba65 (0xf1e5 bytes) 2024-09-11T07:07:38.997 INFO:teuthology.orchestra.run.smithi079.stdout:5178 write 0x5f8c7e thru 0x60553e (0xc8c1 bytes) 2024-09-11T07:07:39.003 INFO:teuthology.orchestra.run.smithi079.stdout:5179 trunc from 0xc15c285 to 0xb34cfe8 2024-09-11T07:07:39.016 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.016 INFO:teuthology.orchestra.run.smithi079.stdout:5181 read 0x713bc10 thru 0x714a306 (0xe6f7 bytes) 2024-09-11T07:07:39.017 INFO:teuthology.orchestra.run.smithi079.stdout:5182 read 0x1e6cf5f thru 0x1e7335f (0x6401 bytes) 2024-09-11T07:07:39.018 INFO:teuthology.orchestra.run.smithi079.stdout:5184 read 0xadc2393 thru 0xadcfba0 (0xd80e bytes) 2024-09-11T07:07:39.018 INFO:teuthology.orchestra.run.smithi079.stdout:5185 write 0xa3b4681 thru 0xa3bd8a1 (0x9221 bytes) 2024-09-11T07:07:39.024 INFO:teuthology.orchestra.run.smithi079.stdout:5186 writesame 0x5d84c9f thru 0x5d8ebed data_size 0x1(0x9f4f bytes) 2024-09-11T07:07:39.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:39.028+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:39.072 INFO:teuthology.orchestra.run.smithi079.stdout:5187 write 0x9076dfa thru 0x9085d9a (0xefa1 bytes) 2024-09-11T07:07:39.083 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.093 INFO:teuthology.orchestra.run.smithi079.stdout:5189 trunc from 0xb34cfe8 to 0xeaa18c8 2024-09-11T07:07:39.105 INFO:teuthology.orchestra.run.smithi079.stdout:5190 write 0x58e925a thru 0x58ed5cf (0x4376 bytes) 2024-09-11T07:07:39.109 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.109 INFO:teuthology.orchestra.run.smithi079.stdout:5192 write 0x785e247 thru 0x7868d91 (0xab4b bytes) 2024-09-11T07:07:39.115 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:39.115 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:39.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:39.115 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:39.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.116 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.116 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:39.116 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.801420222000004, 2024-09-11T07:07:39.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:07:39.116 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.116 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:07:39.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.118 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:39.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:39.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:07:39.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:07:39.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:07:39.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:07:39.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:07:39.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:07:39.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:07:39.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:07:39.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:07:39.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:07:39.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:07:39.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:07:39.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:07:39.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:07:39.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.125 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.801352668000007, 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.126 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:07:39.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:07:39.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:07:39.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:07:39.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:07:39.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.801271830999994, 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.131 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:07:39.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:07:39.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:07:39.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:07:39.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.135 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.801228484999996, 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.136 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:07:39.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.140 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.801158360000002, 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:07:39.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:07:39.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.801090235999993, 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.145 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:07:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:07:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:07:39.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.150 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.801049770000006, 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.151 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:07:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:07:39.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:07:39.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:07:39.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:07:39.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:07:39.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.156 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.801011728999995, 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:39.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:07:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:07:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:07:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:07:39.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:07:39.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:07:39.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:07:39.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:07:39.161 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.161 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.800972759000004, 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.162 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:39.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:39.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:07:39.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:07:39.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:07:39.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:07:39.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:07:39.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:07:39.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:07:39.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:07:39.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.167 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.800931884999997, 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.168 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:07:39.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:07:39.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:39.172 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.800604112000002, 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:07:39.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:07:39.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:39.177 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.800537602000006, 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.800469883000005, 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:07:39.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:07:39.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.800424945000003, 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.187 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:39.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:07:39.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.799625320000004, 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:07:39.192 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.193 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.193 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.193 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.193 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:07:39.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.193 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:39.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:39.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:07:39.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:07:39.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:07:39.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:07:39.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:07:39.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:07:39.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:07:39.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:39.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:07:39.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:07:39.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:07:39.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:07:39.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:07:39.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:07:39.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.200 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.201 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.201 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.201 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:39.201 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.799590977999998, 2024-09-11T07:07:39.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:07:39.202 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.202 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.202 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.202 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.202 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:07:39.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:07:39.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:07:39.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:07:39.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:07:39.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:07:39.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.206 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.799228303000007, 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:07:39.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:07:39.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 70.861327352000004, 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:07:39.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:07:39.217 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109724 3.1d 3:bd9f0dd6:::rbd_data.1161dd0f3253.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.59145211399999997, 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.063964249000000001, 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.218 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109724 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519447+0000", 2024-09-11T07:07:39.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1799999999999999e-06 2024-09-11T07:07:39.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523605+0000", 2024-09-11T07:07:39.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041584270000000001 2024-09-11T07:07:39.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523644+0000", 2024-09-11T07:07:39.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8908000000000001e-05 2024-09-11T07:07:39.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523661+0000", 2024-09-11T07:07:39.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7198999999999999e-05 2024-09-11T07:07:39.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523781+0000", 2024-09-11T07:07:39.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011950799999999999 2024-09-11T07:07:39.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.524055+0000", 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027451199999999998 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.548286+0000", 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.024231249 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:39.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583267+0000", 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.034980245 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583326+0000", 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9815999999999998e-05 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583372+0000", 2024-09-11T07:07:39.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6074e-05 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583409+0000", 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6130999999999997e-05 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.225 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109733 3.5 3:a2b45ebf:::rbd_data.1161dd0f3253.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.50985140900000003, 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067924668999999993, 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109733 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601047+0000", 2024-09-11T07:07:39.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.029e-06 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601058+0000", 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0974e-05 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601083+0000", 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4757999999999999e-05 2024-09-11T07:07:39.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601099+0000", 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5733e-05 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601212+0000", 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113857 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601453+0000", 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240657 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.613355+0000", 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01190186 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668765+0000", 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055410261000000002 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668796+0000", 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0833000000000001e-05 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668891+0000", 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4708000000000002e-05 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668970+0000", 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8998999999999994e-05 2024-09-11T07:07:39.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.232 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.232 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.232 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:39.234 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:39.235 INFO:teuthology.orchestra.run.smithi079.stdout:5195 write 0xa65447f thru 0xa66098a (0xc50c bytes) 2024-09-11T07:07:39.235 INFO:teuthology.orchestra.run.smithi079.stdout:5196 read 0x4648167 thru 0x4656058 (0xdef2 bytes) 2024-09-11T07:07:39.235 INFO:teuthology.orchestra.run.smithi079.stdout:5197 punch from 0x236b16a to 0x237ad83, (0xfc19 bytes) 2024-09-11T07:07:39.235 INFO:teuthology.orchestra.run.smithi079.stdout:5199 read 0x4b0115d thru 0x4b063ce (0x5272 bytes) 2024-09-11T07:07:39.235 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.235 INFO:teuthology.orchestra.run.smithi079.stdout:5204 write 0x456c511 thru 0x4578eb4 (0xc9a4 bytes) 2024-09-11T07:07:39.235 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.235 INFO:teuthology.orchestra.run.smithi079.stdout:5206 trunc from 0xeaa18c8 to 0x5714ad5 2024-09-11T07:07:39.235 INFO:teuthology.orchestra.run.smithi079.stdout:5208 write 0xc4911b7 thru 0xc4927f9 (0x1643 bytes) 2024-09-11T07:07:39.235 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.236 INFO:teuthology.orchestra.run.smithi079.stdout:5210 write 0x82b129b thru 0x82bae22 (0x9b88 bytes) 2024-09-11T07:07:39.236 INFO:teuthology.orchestra.run.smithi079.stdout:5211 write 0x959dbf3 thru 0x95acea2 (0xf2b0 bytes) 2024-09-11T07:07:39.236 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:39.232+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:39.237 INFO:teuthology.orchestra.run.smithi079.stdout:5212 write 0x48e46d4 thru 0x48e494c (0x279 bytes) 2024-09-11T07:07:39.239 INFO:teuthology.orchestra.run.smithi079.stdout:5213 write 0xb81e71c thru 0xb82574a (0x702f bytes) 2024-09-11T07:07:39.247 INFO:teuthology.orchestra.run.smithi079.stdout:5214 write 0x9db4732 thru 0x9db8d7a (0x4649 bytes) 2024-09-11T07:07:39.249 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:07:39.256 INFO:teuthology.orchestra.run.smithi079.stdout:5215 punch from 0xb5413f9 to 0xb54b444, (0xa04b bytes) 2024-09-11T07:07:39.256 INFO:teuthology.orchestra.run.smithi079.stdout:5216 write 0xa67a3d1 thru 0xa67efa2 (0x4bd2 bytes) 2024-09-11T07:07:39.260 INFO:teuthology.orchestra.run.smithi079.stdout:5217 writesame 0x5855f83 thru 0x5862dbb data_size 0x1f(0xce39 bytes) 2024-09-11T07:07:39.282 INFO:teuthology.orchestra.run.smithi079.stdout:5218 trunc from 0xc4927fa to 0x528b5b 2024-09-11T07:07:39.318 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.318 INFO:teuthology.orchestra.run.smithi079.stdout:5220 writesame 0x789c2 thru 0x83373 data_size 0x1d(0xa9b2 bytes) 2024-09-11T07:07:39.334 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:39.331+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:39.339 INFO:teuthology.orchestra.run.smithi079.stdout:5221 write 0x61b1efa thru 0x61c015c (0xe263 bytes) 2024-09-11T07:07:39.342 INFO:teuthology.orchestra.run.smithi079.stdout:5222 punch from 0x2bc7879 to 0x2bcfe0c, (0x8593 bytes) 2024-09-11T07:07:39.342 INFO:teuthology.orchestra.run.smithi079.stdout:5223 read 0x5f6e012 thru 0x5f7b859 (0xd848 bytes) 2024-09-11T07:07:39.342 INFO:teuthology.orchestra.run.smithi079.stdout:5224 read 0x27e0d3a thru 0x27e1da7 (0x106e bytes) 2024-09-11T07:07:39.343 INFO:teuthology.orchestra.run.smithi079.stdout:5227 read 0x5a4fc94 thru 0x5a5dbb1 (0xdf1e bytes) 2024-09-11T07:07:39.343 INFO:teuthology.orchestra.run.smithi079.stdout:5230 read 0x2874e9f thru 0x2884266 (0xf3c8 bytes) 2024-09-11T07:07:39.366 INFO:teuthology.orchestra.run.smithi079.stdout:5231 writesame 0xc9b8981 thru 0xc9c2a45 data_size 0x33(0xa0c5 bytes) 2024-09-11T07:07:39.366 INFO:teuthology.orchestra.run.smithi079.stdout:5232 read 0x8e14a26 thru 0x8e24113 (0xf6ee bytes) 2024-09-11T07:07:39.366 INFO:teuthology.orchestra.run.smithi079.stdout:5233 write 0x72b14a1 thru 0x72b8d97 (0x78f7 bytes) 2024-09-11T07:07:39.379 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:39.379 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:39.379 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:39.391 INFO:teuthology.orchestra.run.smithi079.stdout:5234 trunc from 0xc9c2a46 to 0x14bc818 2024-09-11T07:07:39.394 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:39.403 INFO:teuthology.orchestra.run.smithi079.stdout:5235 punch from 0xf68ca6 to 0xf78025, (0xf37f bytes) 2024-09-11T07:07:39.404 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.404 INFO:teuthology.orchestra.run.smithi079.stdout:5237 punch from 0xe6aaf7 to 0xe720bb, (0x75c4 bytes) 2024-09-11T07:07:39.414 INFO:teuthology.orchestra.run.smithi079.stdout:5239 trunc from 0x14bc818 to 0x7624643 2024-09-11T07:07:39.425 INFO:teuthology.orchestra.run.smithi079.stdout:5240 punch from 0x4e8eb60 to 0x4e99f57, (0xb3f7 bytes) 2024-09-11T07:07:39.425 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.425 INFO:teuthology.orchestra.run.smithi079.stdout:5242 write 0x232f469 thru 0x233b0b8 (0xbc50 bytes) 2024-09-11T07:07:39.428 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.428 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.429 INFO:teuthology.orchestra.run.smithi079.stdout:5245 read 0x261759 thru 0x26830f (0x6bb7 bytes) 2024-09-11T07:07:39.429 INFO:teuthology.orchestra.run.smithi079.stdout:5246 writesame 0x4a0381e thru 0x4a0cc7f data_size 0x3(0x9462 bytes) 2024-09-11T07:07:39.434 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:39.432+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:39.449 INFO:teuthology.orchestra.run.smithi079.stdout:5248 writesame 0x38dd9 thru 0x3e89d data_size 0x1(0x5ac5 bytes) 2024-09-11T07:07:39.476 INFO:teuthology.orchestra.run.smithi079.stdout:5250 read 0x2ca8393 thru 0x2cb0edc (0x8b4a bytes) 2024-09-11T07:07:39.476 INFO:teuthology.orchestra.run.smithi079.stdout:5252 punch from 0x496862d to 0x497809d, (0xfa70 bytes) 2024-09-11T07:07:39.476 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.478 INFO:teuthology.orchestra.run.smithi079.stdout:5254 trunc from 0x7624643 to 0x693abdb 2024-09-11T07:07:39.493 INFO:teuthology.orchestra.run.smithi079.stdout:5257 read 0x44c2e2d thru 0x44c54e5 (0x26b9 bytes) 2024-09-11T07:07:39.508 INFO:teuthology.orchestra.run.smithi079.stdout:5258 trunc from 0x693abdb to 0x197ba51 2024-09-11T07:07:39.535 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:39.531+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:39.569 INFO:teuthology.orchestra.run.smithi079.stdout:5259 write 0xdfff464 thru 0xe0004d4 (0x1071 bytes) 2024-09-11T07:07:39.573 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:39.573 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:39.573 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:39.573 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:39.573 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:39.578 INFO:teuthology.orchestra.run.smithi079.stdout:5261 write 0xa022f5a thru 0xa032657 (0xf6fe bytes) 2024-09-11T07:07:39.586 INFO:teuthology.orchestra.run.smithi079.stdout:5262 read 0xa84dce7 thru 0xa85a3ca (0xc6e4 bytes) 2024-09-11T07:07:39.589 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:39.598 INFO:teuthology.orchestra.run.smithi079.stdout:5263 write 0xe2d6297 thru 0xe2d71a4 (0xf0e bytes) 2024-09-11T07:07:39.604 INFO:teuthology.orchestra.run.smithi079.stdout:5264 writesame 0xc0c1fa0 thru 0xc0ce8b3 data_size 0x11(0xc914 bytes) 2024-09-11T07:07:39.611 INFO:teuthology.orchestra.run.smithi079.stdout:5266 writesame 0x9982099 thru 0x998af24 data_size 0x6(0x8e8c bytes) 2024-09-11T07:07:39.619 INFO:teuthology.orchestra.run.smithi079.stdout:5267 write 0x1bdd264 thru 0x1be18a1 (0x463e bytes) 2024-09-11T07:07:39.623 INFO:teuthology.orchestra.run.smithi079.stdout:5268 read 0xcd810d6 thru 0xcd8edda (0xdd05 bytes) 2024-09-11T07:07:39.626 INFO:teuthology.orchestra.run.smithi079.stdout:5269 trunc from 0xe2d71a5 to 0xd1d2bbe 2024-09-11T07:07:39.641 INFO:teuthology.orchestra.run.smithi079.stdout:5270 trunc from 0xd1d2bbe to 0xdabc686 2024-09-11T07:07:39.652 INFO:teuthology.orchestra.run.smithi079.stdout:5271 writesame 0x57bf779 thru 0x57c6196 data_size 0x2(0x6a1e bytes) 2024-09-11T07:07:39.661 INFO:teuthology.orchestra.run.smithi079.stdout:5272 read 0x3db1e6f thru 0x3dbb779 (0x990b bytes) 2024-09-11T07:07:39.662 INFO:teuthology.orchestra.run.smithi079.stdout:5273 write 0xb9a21a3 thru 0xb9ac4de (0xa33c bytes) 2024-09-11T07:07:39.669 INFO:teuthology.orchestra.run.smithi079.stdout:5274 write 0x9d2a9fc thru 0x9d2f17b (0x4780 bytes) 2024-09-11T07:07:39.675 INFO:teuthology.orchestra.run.smithi079.stdout:5275 write 0x9d0e742 thru 0x9d0f872 (0x1131 bytes) 2024-09-11T07:07:39.676 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:39.675+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:39.678 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.678 INFO:teuthology.orchestra.run.smithi079.stdout:5278 write 0x33e288b thru 0x33ef955 (0xd0cb bytes) 2024-09-11T07:07:39.681 INFO:teuthology.orchestra.run.smithi079.stdout:5279 writesame 0x4f7beb9 thru 0x4f7d6d2 data_size 0x5(0x181a bytes) 2024-09-11T07:07:39.684 INFO:teuthology.orchestra.run.smithi079.stdout:5280 write 0xa52c830 thru 0xa52f11a (0x28eb bytes) 2024-09-11T07:07:39.690 INFO:teuthology.orchestra.run.smithi079.stdout:5281 read 0xa730f43 thru 0xa73ec94 (0xdd52 bytes) 2024-09-11T07:07:39.690 INFO:teuthology.orchestra.run.smithi079.stdout:5282 write 0x681d372 thru 0x68299b5 (0xc644 bytes) 2024-09-11T07:07:39.693 INFO:teuthology.orchestra.run.smithi079.stdout:5283 punch from 0x2c8cab3 to 0x2c8e689, (0x1bd6 bytes) 2024-09-11T07:07:39.693 INFO:teuthology.orchestra.run.smithi079.stdout:5284 write 0xc54ca75 thru 0xc552bac (0x6138 bytes) 2024-09-11T07:07:39.699 INFO:teuthology.orchestra.run.smithi079.stdout:5286 read 0xf5440d thru 0xf64152 (0xfd46 bytes) 2024-09-11T07:07:39.700 INFO:teuthology.orchestra.run.smithi079.stdout:5288 write 0x5e8391a thru 0x5e88aab (0x5192 bytes) 2024-09-11T07:07:39.705 INFO:teuthology.orchestra.run.smithi079.stdout:5289 trunc from 0xdabc686 to 0xd0ff047 2024-09-11T07:07:39.719 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.720 INFO:teuthology.orchestra.run.smithi079.stdout:5292 read 0x857db23 thru 0x858ad33 (0xd211 bytes) 2024-09-11T07:07:39.721 INFO:teuthology.orchestra.run.smithi079.stdout:5293 write 0x8723bae thru 0x87314a4 (0xd8f7 bytes) 2024-09-11T07:07:39.725 INFO:teuthology.orchestra.run.smithi079.stdout:5295 write 0x16ac977 thru 0x16b0e9d (0x4527 bytes) 2024-09-11T07:07:39.737 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:39.736+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:39.743 INFO:teuthology.orchestra.run.smithi079.stdout:5296 write 0xd8590ca thru 0xd864a61 (0xb998 bytes) 2024-09-11T07:07:39.747 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.748 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.748 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.748 INFO:teuthology.orchestra.run.smithi079.stdout:5301 read 0xb7f1e7b thru 0xb80013e (0xe2c4 bytes) 2024-09-11T07:07:39.748 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.749 INFO:teuthology.orchestra.run.smithi079.stdout:5303 read 0x6e4a18 thru 0x6e4f6a (0x553 bytes) 2024-09-11T07:07:39.749 INFO:teuthology.orchestra.run.smithi079.stdout:5304 write 0xd12c17d thru 0xd137f7d (0xbe01 bytes) 2024-09-11T07:07:39.754 INFO:teuthology.orchestra.run.smithi079.stdout:5305 punch from 0x12b00ec to 0x12b7c5b, (0x7b6f bytes) 2024-09-11T07:07:39.754 INFO:teuthology.orchestra.run.smithi079.stdout:5306 write 0x7607889 thru 0x76150ff (0xd877 bytes) 2024-09-11T07:07:39.762 INFO:teuthology.orchestra.run.smithi079.stdout:5307 read 0x9ddca6e thru 0x9de3204 (0x6797 bytes) 2024-09-11T07:07:39.763 INFO:teuthology.orchestra.run.smithi079.stdout:5308 flatten 2024-09-11T07:07:39.767 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:39.767 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:39.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:39.767 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:39.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.767 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.441821164999993, 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:07:39.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:07:39.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:07:39.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138882069999994, 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:07:39.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:07:39.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138818954000001, 2024-09-11T07:07:39.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.782 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138743961000003, 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.783 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:07:39.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138679405000005, 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:07:39.787 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:07:39.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.791 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138624175999993, 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.792 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138570279000007, 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:07:39.796 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:07:39.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:07:39.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138509780000007, 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:07:39.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138453767000001, 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.805 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:07:39.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138374413999998, 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:39.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:07:39.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:07:39.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138318111000004, 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:07:39.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:39.818 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138245671999996, 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:39.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:07:39.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138189552, 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.823 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138116085999997, 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.827 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.831 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 85.138037693000001, 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:07:39.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:07:39.835 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 61.228861678999998, 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:07:39.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:07:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:07:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:07:39.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.840 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.972276094, 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.841 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:07:39.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:07:39.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:07:39.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2022820830000001, 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.847 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:39.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:07:39.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.1942921880000004, 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:07:39.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:07:39.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109791 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 5824422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 1.0352619320000001, 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029141958999999999, 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:39.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109791 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:39.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728800+0000", 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.064e-06 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744261+0000", 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015461523 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744287+0000", 2024-09-11T07:07:39.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5086999999999999e-05 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744298+0000", 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1899000000000001e-05 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744376+0000", 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7465000000000005e-05 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:39.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744514+0000", 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013820400000000001 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.745045+0000", 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053122399999999995 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.751499+0000", 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064538750000000004 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757772+0000", 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062726509999999997 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757865+0000", 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2802999999999999e-05 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757933+0000", 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8164000000000007e-05 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.862 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:39.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:39.863 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:39.865 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:5309 read 0x9f96c07 thru 0x9f99e11 (0x320b bytes) 2024-09-11T07:07:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:5311 writesame 0x716aa03 thru 0x716c914 data_size 0x29(0x1f12 bytes) 2024-09-11T07:07:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:5312 read 0x785bea9 thru 0x785c339 (0x491 bytes) 2024-09-11T07:07:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:5313 write 0x14cebe3 thru 0x14d2e6b (0x4289 bytes) 2024-09-11T07:07:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:5315 punch from 0xd5f4aa to 0xd68679, (0x91cf bytes) 2024-09-11T07:07:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:5316 read 0x601d6c4 thru 0x602b642 (0xdf7f bytes) 2024-09-11T07:07:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:5317 trunc from 0xd864a62 to 0x7db0bed 2024-09-11T07:07:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:5319 punch from 0x1c31553 to 0x1c34ff4, (0x3aa1 bytes) 2024-09-11T07:07:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:39.866 INFO:teuthology.orchestra.run.smithi079.stdout:5323 punch from 0x471ca93 to 0x471e8b3, (0x1e20 bytes) 2024-09-11T07:07:39.867 INFO:teuthology.orchestra.run.smithi079.stdout:5324 read 0x560025f thru 0x56035c6 (0x3368 bytes) 2024-09-11T07:07:39.867 INFO:teuthology.orchestra.run.smithi079.stdout:5325 punch from 0xc90f1b to 0xc925b6, (0x169b bytes) 2024-09-11T07:07:39.867 INFO:teuthology.orchestra.run.smithi079.stdout:5326 punch from 0x564b96 to 0x573535, (0xe99f bytes) 2024-09-11T07:07:39.867 INFO:teuthology.orchestra.run.smithi079.stdout:5327 read 0x4617c16 thru 0x46264b0 (0xe89b bytes) 2024-09-11T07:07:39.867 INFO:teuthology.orchestra.run.smithi079.stdout:5331 writesame 0x2bbfcfb thru 0x2bc67a9 data_size 0x1(0x6aaf bytes) 2024-09-11T07:07:39.867 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:39.860+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:39.895 INFO:teuthology.orchestra.run.smithi079.stdout:5332 write 0xa29651e thru 0xa29f468 (0x8f4b bytes) 2024-09-11T07:07:39.902 INFO:teuthology.orchestra.run.smithi079.stdout:5334 trunc from 0xa29f469 to 0x9159bf2 2024-09-11T07:07:39.922 INFO:teuthology.orchestra.run.smithi079.stdout:5335 read 0x4a76544 thru 0x4a7fd20 (0x97dd bytes) 2024-09-11T07:07:39.938 INFO:teuthology.orchestra.run.smithi079.stdout:5336 writesame 0xa8ae140 thru 0xa8b0ec4 data_size 0x1(0x2d85 bytes) 2024-09-11T07:07:39.941 INFO:teuthology.orchestra.run.smithi079.stdout:5338 read 0x96860c1 thru 0x9686f27 (0xe67 bytes) 2024-09-11T07:07:39.941 INFO:teuthology.orchestra.run.smithi079.stdout:5340 write 0x4b94366 thru 0x4b9591d (0x15b8 bytes) 2024-09-11T07:07:39.944 INFO:teuthology.orchestra.run.smithi079.stdout:5342 write 0x5693edd thru 0x56a26ef (0xe813 bytes) 2024-09-11T07:07:39.955 INFO:teuthology.orchestra.run.smithi079.stdout:5344 trunc from 0xa8b0ec5 to 0xdb4f7e8 2024-09-11T07:07:39.965 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:39.963+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:39.967 INFO:teuthology.orchestra.run.smithi079.stdout:5345 write 0x89f61d6 thru 0x8a01157 (0xaf82 bytes) 2024-09-11T07:07:39.986 INFO:teuthology.orchestra.run.smithi079.stdout:5346 writesame 0xeb3538d thru 0xeb40eee data_size 0xa(0xbb62 bytes) 2024-09-11T07:07:39.992 INFO:teuthology.orchestra.run.smithi079.stdout:5347 trunc from 0xeb40eef to 0xd377dc7 2024-09-11T07:07:40.010 INFO:teuthology.orchestra.run.smithi079.stdout:5348 write 0x78653da thru 0x786d72d (0x8354 bytes) 2024-09-11T07:07:40.014 INFO:teuthology.orchestra.run.smithi079.stdout:5349 writesame 0x446f718 thru 0x447363c data_size 0x5(0x3f25 bytes) 2024-09-11T07:07:40.031 INFO:teuthology.orchestra.run.smithi079.stdout:5351 trunc from 0xd377dc7 to 0x886dc53 2024-09-11T07:07:40.048 INFO:teuthology.orchestra.run.smithi079.stdout:5352 write 0x2533322 thru 0x253b10c (0x7deb bytes) 2024-09-11T07:07:40.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:40.055 INFO:teuthology.orchestra.run.smithi079.stdout:5353 read 0x69807bd thru 0x6988327 (0x7b6b bytes) 2024-09-11T07:07:40.056 INFO:teuthology.orchestra.run.smithi079.stdout:5354 read 0x562740c thru 0x5633506 (0xc0fb bytes) 2024-09-11T07:07:40.056 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:40.057 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:40.057 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:40.057 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:40.057 INFO:teuthology.orchestra.run.smithi079.stdout:5355 punch from 0x75bb868 to 0x75c19c3, (0x615b bytes) 2024-09-11T07:07:40.057 INFO:teuthology.orchestra.run.smithi079.stdout:5356 punch from 0x381535f to 0x381b806, (0x64a7 bytes) 2024-09-11T07:07:40.066 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:40.063+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:40.071 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:40.078 INFO:teuthology.orchestra.run.smithi079.stdout:5357 trunc from 0x886dc53 to 0x82f153 2024-09-11T07:07:40.098 INFO:teuthology.orchestra.run.smithi079.stdout:5358 read 0x7fd494 thru 0x80caac (0xf619 bytes) 2024-09-11T07:07:40.098 INFO:teuthology.orchestra.run.smithi079.stdout:5360 read 0x6eaaf8 thru 0x6f5374 (0xa87d bytes) 2024-09-11T07:07:40.113 INFO:teuthology.orchestra.run.smithi079.stdout:5361 trunc from 0x82f153 to 0x674bc29 2024-09-11T07:07:40.122 INFO:teuthology.orchestra.run.smithi079.stdout:5362 read 0x16254c2 thru 0x162d379 (0x7eb8 bytes) 2024-09-11T07:07:40.122 INFO:teuthology.orchestra.run.smithi079.stdout:5363 punch from 0x3163977 to 0x3164997, (0x1020 bytes) 2024-09-11T07:07:40.122 INFO:teuthology.orchestra.run.smithi079.stdout:5364 punch from 0x23bc229 to 0x23c6ca4, (0xaa7b bytes) 2024-09-11T07:07:40.131 INFO:teuthology.orchestra.run.smithi079.stdout:5366 writesame 0x6a7aabe thru 0x6a82413 data_size 0x3e(0x7956 bytes) 2024-09-11T07:07:40.135 INFO:teuthology.orchestra.run.smithi079.stdout:5367 trunc from 0x6a82414 to 0x76c92ad 2024-09-11T07:07:40.146 INFO:teuthology.orchestra.run.smithi079.stdout:5368 punch from 0x67759d3 to 0x67845f3, (0xec20 bytes) 2024-09-11T07:07:40.146 INFO:teuthology.orchestra.run.smithi079.stdout:5369 write 0x3d657cc thru 0x3d72e38 (0xd66d bytes) 2024-09-11T07:07:40.148 INFO:teuthology.orchestra.run.smithi079.stdout:5371 write 0x651dcbc thru 0x6523b0f (0x5e54 bytes) 2024-09-11T07:07:40.166 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:40.163+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:40.174 INFO:teuthology.orchestra.run.smithi079.stdout:5374 write 0xbae1b9d thru 0xbaf0cfd (0xf161 bytes) 2024-09-11T07:07:40.180 INFO:teuthology.orchestra.run.smithi079.stdout:5375 read 0xa96700b thru 0xa969ffc (0x2ff2 bytes) 2024-09-11T07:07:40.180 INFO:teuthology.orchestra.run.smithi079.stdout:5380 read 0xbb46e3 thru 0xbc37be (0xf0dc bytes) 2024-09-11T07:07:40.185 INFO:teuthology.orchestra.run.smithi079.stdout:5381 trunc from 0xbaf0cfe to 0x964b103 2024-09-11T07:07:40.197 INFO:teuthology.orchestra.run.smithi079.stdout:5382 trunc from 0x964b103 to 0x77ddd3a 2024-09-11T07:07:40.211 INFO:teuthology.orchestra.run.smithi079.stdout:5384 writesame 0x94e571 thru 0x95bc59 data_size 0x3(0xd6e9 bytes) 2024-09-11T07:07:40.212 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:40.212 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:40.229 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:40.229 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:40.235 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:40.235 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:40.235 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:40.235 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:40.235 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:40.236 INFO:teuthology.orchestra.run.smithi079.stdout:5386 writesame 0x7b3dbaf thru 0x7b465cb data_size 0x1(0x8a1d bytes) 2024-09-11T07:07:40.236 INFO:teuthology.orchestra.run.smithi079.stdout:5387 write 0x411e2b2 thru 0x411ec06 (0x955 bytes) 2024-09-11T07:07:40.238 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.238 INFO:teuthology.orchestra.run.smithi079.stdout:5389 read 0x4e5e086 thru 0x4e65e1d (0x7d98 bytes) 2024-09-11T07:07:40.238 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.239 INFO:teuthology.orchestra.run.smithi079.stdout:5391 read 0x6a22ad5 thru 0x6a2ad23 (0x824f bytes) 2024-09-11T07:07:40.247 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:40.247 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:40.251 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:40.251 INFO:teuthology.orchestra.run.smithi079.stdout:5393 write 0x97f71d1 thru 0x9801548 (0xa378 bytes) 2024-09-11T07:07:40.258 INFO:teuthology.orchestra.run.smithi079.stdout:5394 read 0x37a195 thru 0x37f886 (0x56f2 bytes) 2024-09-11T07:07:40.259 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.259 INFO:teuthology.orchestra.run.smithi079.stdout:5397 write 0x937769f thru 0x9378861 (0x11c3 bytes) 2024-09-11T07:07:40.264 INFO:teuthology.orchestra.run.smithi079.stdout:5398 read 0x725b4d2 thru 0x726acc9 (0xf7f8 bytes) 2024-09-11T07:07:40.265 INFO:teuthology.orchestra.run.smithi079.stdout:5399 punch from 0x4451c34 to 0x4452754, (0xb20 bytes) 2024-09-11T07:07:40.265 INFO:teuthology.orchestra.run.smithi079.stdout:5400 trunc from 0x9801549 to 0x9a99a7e 2024-09-11T07:07:40.266 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:40.266 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:40.267 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:40.264+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:40.274 INFO:teuthology.orchestra.run.smithi079.stdout:5401 writesame 0x4bef4e5 thru 0x4bf0477 data_size 0x3(0xf93 bytes) 2024-09-11T07:07:40.276 INFO:teuthology.orchestra.run.smithi079.stdout:5402 punch from 0x1c4db9b to 0x1c4e728, (0xb8d bytes) 2024-09-11T07:07:40.281 INFO:teuthology.orchestra.run.smithi079.stdout:5404 trunc from 0x9a99a7e to 0x699ecbb 2024-09-11T07:07:40.287 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:40.287 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:40.300 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.300 INFO:teuthology.orchestra.run.smithi079.stdout:5406 writesame 0x64012f2 thru 0x640c9c1 data_size 0x5a(0xb6d0 bytes) 2024-09-11T07:07:40.308 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:40.308 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:40.313 INFO:teuthology.orchestra.run.smithi079.stdout:5407 write 0x80e0f39 thru 0x80e7e94 (0x6f5c bytes) 2024-09-11T07:07:40.317 INFO:teuthology.orchestra.run.smithi079.stdout:5409 punch from 0x3ee8e15 to 0x3eedd79, (0x4f64 bytes) 2024-09-11T07:07:40.317 INFO:teuthology.orchestra.run.smithi079.stdout:5410 write 0x664d2f2 thru 0x665c747 (0xf456 bytes) 2024-09-11T07:07:40.328 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:40.329 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:40.333 INFO:teuthology.orchestra.run.smithi079.stdout:5411 writesame 0xc6e49bb thru 0xc6e4e8a data_size 0x10(0x4d0 bytes) 2024-09-11T07:07:40.339 INFO:teuthology.orchestra.run.smithi079.stdout:5413 write 0xc815d63 thru 0xc81854a (0x27e8 bytes) 2024-09-11T07:07:40.345 INFO:teuthology.orchestra.run.smithi079.stdout:5414 trunc from 0xc81854b to 0xdaa31c7 2024-09-11T07:07:40.346 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:40.347 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:40.351 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.367 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:40.363+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:40.368 INFO:teuthology.orchestra.run.smithi079.stdout:5416 trunc from 0xdaa31c7 to 0x23735e0 2024-09-11T07:07:40.390 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.419 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:40.420 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:40.423 INFO:teuthology.orchestra.run.smithi079.stdout:5418 write 0xe4a7738 thru 0xe4aba86 (0x434f bytes) 2024-09-11T07:07:40.435 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:40.449 INFO:teuthology.orchestra.run.smithi079.stdout:5419 trunc from 0xe4aba87 to 0x68d4bd1 2024-09-11T07:07:40.470 INFO:teuthology.orchestra.run.smithi079.stdout:5421 write 0x57ef5b1 thru 0x57fecdb (0xf72b bytes) 2024-09-11T07:07:40.473 INFO:teuthology.orchestra.run.smithi079.stdout:5422 read 0x6f5fa2 thru 0x70171c (0xb77b bytes) 2024-09-11T07:07:40.473 INFO:teuthology.orchestra.run.smithi079.stdout:5423 read 0x462ed23 thru 0x4637a69 (0x8d47 bytes) 2024-09-11T07:07:40.474 INFO:teuthology.orchestra.run.smithi079.stdout:5424 punch from 0x5378b5 to 0x53dfc3, (0x670e bytes) 2024-09-11T07:07:40.474 INFO:teuthology.orchestra.run.smithi079.stdout:5425 writesame 0x255f1e1 thru 0x256bd16 data_size 0x26(0xcb36 bytes) 2024-09-11T07:07:40.476 INFO:teuthology.orchestra.run.smithi079.stdout:5426 read 0x4209e49 thru 0x4218662 (0xe81a bytes) 2024-09-11T07:07:40.477 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:40.475+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:40.493 INFO:teuthology.orchestra.run.smithi079.stdout:5428 write 0xa26fa44 thru 0xa274c8a (0x5247 bytes) 2024-09-11T07:07:40.499 INFO:teuthology.orchestra.run.smithi079.stdout:5429 punch from 0x2f9392c to 0x2f99d23, (0x63f7 bytes) 2024-09-11T07:07:40.499 INFO:teuthology.orchestra.run.smithi079.stdout:5430 punch from 0x39bbfda to 0x39c9c31, (0xdc57 bytes) 2024-09-11T07:07:40.499 INFO:teuthology.orchestra.run.smithi079.stdout:5432 write 0xa2464e0 thru 0xa24fd17 (0x9838 bytes) 2024-09-11T07:07:40.501 INFO:teuthology.orchestra.run.smithi079.stdout:5433 punch from 0x216ca90 to 0x216ec0b, (0x217b bytes) 2024-09-11T07:07:40.501 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.501 INFO:teuthology.orchestra.run.smithi079.stdout:5435 punch from 0xa0ae324 to 0xa0bc25e, (0xdf3a bytes) 2024-09-11T07:07:40.501 INFO:teuthology.orchestra.run.smithi079.stdout:5437 write 0x93ed0ca thru 0x93f76a7 (0xa5de bytes) 2024-09-11T07:07:40.508 INFO:teuthology.orchestra.run.smithi079.stdout:5438 read 0x941ac19 thru 0x942539b (0xa783 bytes) 2024-09-11T07:07:40.509 INFO:teuthology.orchestra.run.smithi079.stdout:5439 writesame 0x7c4fde9 thru 0x7c56a6a data_size 0x2b(0x6c82 bytes) 2024-09-11T07:07:40.528 INFO:teuthology.orchestra.run.smithi079.stdout:5441 trunc from 0xa274c8b to 0x8269 2024-09-11T07:07:40.569 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:40.569 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:40.569 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:40.567+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:40.585 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:40.632 INFO:teuthology.orchestra.run.smithi079.stdout:5442 write 0xa09f2a thru 0xa12c7e (0x8d55 bytes) 2024-09-11T07:07:40.640 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.670 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:40.668+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:40.677 INFO:teuthology.orchestra.run.smithi079.stdout:5446 writesame 0xea7cb2a thru 0xea84304 data_size 0x1(0x77db bytes) 2024-09-11T07:07:40.677 INFO:teuthology.orchestra.run.smithi079.stdout:5447 write 0x282649e thru 0x282d3fc (0x6f5f bytes) 2024-09-11T07:07:40.691 INFO:teuthology.orchestra.run.smithi079.stdout:5448 trunc from 0xea84305 to 0x889e386 2024-09-11T07:07:40.701 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 4, 5, 6, 7] out_osds: [0] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:07:40.701 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:07:40.701 INFO:tasks.thrashosds.thrasher:Removing osd 4, in_osds are: [1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:07:40.701 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 4 2024-09-11T07:07:40.705 INFO:teuthology.orchestra.run.smithi079.stdout:5449 read 0x842973b thru 0x8435cfb (0xc5c1 bytes) 2024-09-11T07:07:40.705 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.706 INFO:teuthology.orchestra.run.smithi079.stdout:5451 trunc from 0x889e386 to 0x9696235 2024-09-11T07:07:40.739 INFO:teuthology.orchestra.run.smithi079.stdout:5452 write 0xed4b868 thru 0xed580fb (0xc894 bytes) 2024-09-11T07:07:40.745 INFO:teuthology.orchestra.run.smithi079.stdout:5453 read 0x63e478c thru 0x63f02b9 (0xbb2e bytes) 2024-09-11T07:07:40.745 INFO:teuthology.orchestra.run.smithi079.stdout:5454 read 0xe052ed6 thru 0xe05ac18 (0x7d43 bytes) 2024-09-11T07:07:40.745 INFO:teuthology.orchestra.run.smithi079.stdout:5456 write 0xd56d0bf thru 0xd56e1c9 (0x110b bytes) 2024-09-11T07:07:40.752 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.752 INFO:teuthology.orchestra.run.smithi079.stdout:5458 read 0x10fefc5 thru 0x110d5e3 (0xe61f bytes) 2024-09-11T07:07:40.752 INFO:teuthology.orchestra.run.smithi079.stdout:5459 read 0xc9ba00d thru 0xc9ba1fc (0x1f0 bytes) 2024-09-11T07:07:40.752 INFO:teuthology.orchestra.run.smithi079.stdout:5461 read 0x44cfc06 thru 0x44d85cb (0x89c6 bytes) 2024-09-11T07:07:40.752 INFO:teuthology.orchestra.run.smithi079.stdout:5462 read 0x495ebd3 thru 0x495f31a (0x748 bytes) 2024-09-11T07:07:40.752 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.752 INFO:teuthology.orchestra.run.smithi079.stdout:5464 writesame 0x14712f1 thru 0x147470a data_size 0x4e(0x341a bytes) 2024-09-11T07:07:40.758 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:40.758 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:40.758 INFO:teuthology.orchestra.run.smithi079.stdout:5465 write 0x47e2d55 thru 0x47f180a (0xeab6 bytes) 2024-09-11T07:07:40.766 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.766 INFO:teuthology.orchestra.run.smithi079.stdout:5468 write 0x16bed02 thru 0x16c1c25 (0x2f24 bytes) 2024-09-11T07:07:40.768 INFO:teuthology.orchestra.run.smithi079.stdout:5469 punch from 0xd85c316 to 0xd86b86d, (0xf557 bytes) 2024-09-11T07:07:40.768 INFO:teuthology.orchestra.run.smithi079.stdout:5471 write 0xb3ebf9d thru 0xb3ef992 (0x39f6 bytes) 2024-09-11T07:07:40.771 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:40.767+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:40.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:40.777 INFO:teuthology.orchestra.run.smithi079.stdout:5472 read 0x26553a2 thru 0x2662404 (0xd063 bytes) 2024-09-11T07:07:40.777 INFO:teuthology.orchestra.run.smithi079.stdout:5474 write 0x41753c7 thru 0x4183949 (0xe583 bytes) 2024-09-11T07:07:40.782 INFO:teuthology.orchestra.run.smithi079.stdout:5475 write 0x1b5a9ea thru 0x1b5d5fd (0x2c14 bytes) 2024-09-11T07:07:40.800 INFO:teuthology.orchestra.run.smithi079.stdout:5476 trunc from 0xed580fc to 0x7a8370a 2024-09-11T07:07:40.829 INFO:teuthology.orchestra.run.smithi079.stdout:5477 punch from 0x26706b5 to 0x267f168, (0xeab3 bytes) 2024-09-11T07:07:40.829 INFO:teuthology.orchestra.run.smithi079.stdout:5479 write 0x6cdf684 thru 0x6ce8cfb (0x9678 bytes) 2024-09-11T07:07:40.837 INFO:teuthology.orchestra.run.smithi079.stdout:5480 trunc from 0x7a8370a to 0x706293b 2024-09-11T07:07:40.852 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:40.853 INFO:teuthology.orchestra.run.smithi079.stdout:5483 read 0x1ec3932 thru 0x1ec6b27 (0x31f6 bytes) 2024-09-11T07:07:40.858 INFO:teuthology.orchestra.run.smithi079.stdout:5485 trunc from 0x706293b to 0xadf4996 2024-09-11T07:07:40.870 INFO:teuthology.orchestra.run.smithi079.stdout:5489 writesame 0x112fd36 thru 0x113cf46 data_size 0x1(0xd211 bytes) 2024-09-11T07:07:40.871 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:40.868+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:40.898 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:40.898 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:40.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:40.933 INFO:teuthology.orchestra.run.smithi079.stdout:5490 read 0x885f23a thru 0x88634f2 (0x42b9 bytes) 2024-09-11T07:07:40.934 INFO:teuthology.orchestra.run.smithi079.stdout:5491 read 0x8956c06 thru 0x8966205 (0xf600 bytes) 2024-09-11T07:07:40.948 INFO:teuthology.orchestra.run.smithi079.stdout:5492 trunc from 0xadf4996 to 0x487c9a0 2024-09-11T07:07:40.966 INFO:teuthology.orchestra.run.smithi079.stdout:5493 read 0x643de thru 0x65d23 (0x1946 bytes) 2024-09-11T07:07:40.970 INFO:teuthology.orchestra.run.smithi079.stdout:5494 trunc from 0x487c9a0 to 0x62e2d08 2024-09-11T07:07:40.972 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:40.968+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:41.014 INFO:teuthology.orchestra.run.smithi079.stdout:5496 writesame 0xd0809c8 thru 0xd08ebbf data_size 0x1c(0xe1f8 bytes) 2024-09-11T07:07:41.014 INFO:teuthology.orchestra.run.smithi079.stdout:5497 write 0x306a877 thru 0x3078e44 (0xe5ce bytes) 2024-09-11T07:07:41.021 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:41.021 INFO:teuthology.orchestra.run.smithi079.stdout:5499 write 0x9c3d4b5 thru 0x9c4a285 (0xcdd1 bytes) 2024-09-11T07:07:41.023 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-11T07:07:41.020+0000 7f4290681640 -1 mon.a@0(leader).osd e103 definitely_dead 0 2024-09-11T07:07:41.027 INFO:teuthology.orchestra.run.smithi079.stdout:5500 punch from 0xb34e987 to 0xb359461, (0xaada bytes) 2024-09-11T07:07:41.027 INFO:teuthology.orchestra.run.smithi079.stdout:5501 read 0xbba4ff2 thru 0xbbb0660 (0xb66f bytes) 2024-09-11T07:07:41.027 INFO:teuthology.orchestra.run.smithi079.stdout:5504 read 0x4e7229c thru 0x4e81796 (0xf4fb bytes) 2024-09-11T07:07:41.047 INFO:teuthology.orchestra.run.smithi079.stdout:5506 trunc from 0xd08ebc0 to 0x1207da0 2024-09-11T07:07:41.063 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:41.063 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:41.072 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:41.072+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:41.079 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:41.114 INFO:teuthology.orchestra.run.smithi079.stdout:5508 write 0xd444ab1 thru 0xd44f2a7 (0xa7f7 bytes) 2024-09-11T07:07:41.122 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:41.122 INFO:teuthology.orchestra.run.smithi079.stdout:5511 read 0x170c2da thru 0x1710c8c (0x49b3 bytes) 2024-09-11T07:07:41.122 INFO:teuthology.orchestra.run.smithi079.stdout:5512 read 0x656f909 thru 0x6578295 (0x898d bytes) 2024-09-11T07:07:41.129 INFO:teuthology.orchestra.run.smithi079.stdout:5513 trunc from 0xd44f2a8 to 0xa1633b8 2024-09-11T07:07:41.145 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:41.145 INFO:teuthology.orchestra.run.smithi079.stdout:5515 write 0x2bb5925 thru 0x2bc077e (0xae5a bytes) 2024-09-11T07:07:41.167 INFO:teuthology.orchestra.run.smithi079.stdout:5516 writesame 0xae254eb thru 0xae2889b data_size 0xb(0x33b1 bytes) 2024-09-11T07:07:41.167 INFO:teuthology.orchestra.run.smithi079.stdout:5517 write 0xdba2c1 thru 0xdbb5c7 (0x1307 bytes) 2024-09-11T07:07:41.173 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:41.172+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:41.187 INFO:teuthology.orchestra.run.smithi079.stdout:5518 write 0xd1f62bc thru 0xd20182c (0xb571 bytes) 2024-09-11T07:07:41.197 INFO:teuthology.orchestra.run.smithi079.stdout:5521 read 0x1fc1a16 thru 0x1fc9409 (0x79f4 bytes) 2024-09-11T07:07:41.197 INFO:teuthology.orchestra.run.smithi079.stdout:5522 read 0x7c6ab11 thru 0x7c77328 (0xc818 bytes) 2024-09-11T07:07:41.197 INFO:teuthology.orchestra.run.smithi079.stdout:5523 read 0x976fc19 thru 0x9773546 (0x392e bytes) 2024-09-11T07:07:41.197 INFO:teuthology.orchestra.run.smithi079.stdout:5524 write 0x5219dd8 thru 0x52234ac (0x96d5 bytes) 2024-09-11T07:07:41.203 INFO:teuthology.orchestra.run.smithi079.stdout:5526 writesame 0xcc1cfcc thru 0xcc23da9 data_size 0x52(0x6dde bytes) 2024-09-11T07:07:41.212 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:41.212 INFO:teuthology.orchestra.run.smithi079.stdout:5531 read 0x74c7d5a thru 0x74d00b1 (0x8358 bytes) 2024-09-11T07:07:41.212 INFO:teuthology.orchestra.run.smithi079.stdout:5532 write 0x8f51965 thru 0x8f531dd (0x1879 bytes) 2024-09-11T07:07:41.219 INFO:teuthology.orchestra.run.smithi079.stdout:5537 write 0x8d62759 thru 0x8d633fd (0xca5 bytes) 2024-09-11T07:07:41.226 INFO:teuthology.orchestra.run.smithi079.stdout:5539 punch from 0x3deff41 to 0x3df24d5, (0x2594 bytes) 2024-09-11T07:07:41.226 INFO:teuthology.orchestra.run.smithi079.stdout:5540 punch from 0x4efc512 to 0x4f0ac23, (0xe711 bytes) 2024-09-11T07:07:41.226 INFO:teuthology.orchestra.run.smithi079.stdout:5541 write 0x45e350b thru 0x45e39de (0x4d4 bytes) 2024-09-11T07:07:41.248 INFO:teuthology.orchestra.run.smithi079.stdout:5542 trunc from 0xd20182d to 0x1218fa0 2024-09-11T07:07:41.252 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:41.253 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:41.268 INFO:teuthology.orchestra.run.smithi079.stderr:marked out osd.4. 2024-09-11T07:07:41.274 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:41.272+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:41.275 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:41.286 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:07:41.385 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:41.384+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:41.457 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:41.457 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:41.473 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:41.477 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:41.475+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:41.577 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:41.575+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:41.636 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:41.636 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:41.650 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:41.678 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:41.675+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:41.772 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:41.772 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:41.779 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:41.775+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:41.786 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:41.879 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:41.875+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:41.910 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:41.910 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:41.925 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:41.981 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:41.980+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:42.047 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:42.047 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:42.061 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:42.105 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:42.104+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:42.182 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:42.179+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:42.227 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:42.227 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:42.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:42.274 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:07:42.284 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:42.280+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:42.365 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:42.366 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:42.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:42.380 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:42.421 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:42.420+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:42.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:42.480+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:42.510 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:42.510 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:42.516 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:42.516 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:42.524 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:42.533 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:42.533 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:42.549 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:42.549 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:42.565 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:42.565 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:42.583 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:42.583 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:42.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:42.580+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:42.600 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:42.600 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:42.620 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:42.621 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:42.641 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:42.641 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:42.644 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:42.644 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:42.644 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:42.645 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:42.645 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:42.659 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:42.709 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:42.707+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:42.784 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:42.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.494615925000005, 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.785 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.494543841999999, 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:42.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:07:42.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:42.793 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.494488348999994, 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:07:42.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:07:42.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.797 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.292616381000002, 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:07:42.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.801 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.292553791000003, 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.802 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:07:42.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:07:42.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:07:42.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:07:42.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.806 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.806 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.806 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:42.806 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.292496735, 2024-09-11T07:07:42.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:07:42.806 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:07:42.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:07:42.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.292440618000001, 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.811 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.292319355999993, 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.815 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:07:42.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:07:42.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.292215087000002, 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.819 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:07:42.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:07:42.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:07:42.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:07:42.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:07:42.823 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.292109547999999, 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.824 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.828 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.292042385000002, 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:07:42.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.291943179, 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.833 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.837 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.29185622, 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:42.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:07:42.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.291795942999997, 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.842 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:07:42.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:07:42.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.291642237999994, 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:07:42.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:42.850 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.291555062, 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:07:42.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.291491159000003, 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.855 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:07:42.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.291431316000001, 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:07:42.859 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:07:42.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:07:42.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.291353233999999, 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.864 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:07:42.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:07:42.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:07:42.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.291295464000001, 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:42.868 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:42.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:07:42.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:07:42.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:42.872 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:42.874 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:42.874 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:42.871+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:42.975 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:42.971+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:43.043 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:43.043 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:43.043 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:43.057 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:43.101 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:43.099+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:43.178 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:43.176+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:43.221 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:43.221 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:43.221 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:43.235 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:43.279 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:43.276+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:43.332 INFO:teuthology.orchestra.run.smithi079.stdout:5543 trunc from 0x1218fa0 to 0x1216fa8 2024-09-11T07:07:43.350 INFO:teuthology.orchestra.run.smithi079.stdout:5546 read 0xe0cf8a thru 0xe0eb66 (0x1bdd bytes) 2024-09-11T07:07:43.374 INFO:teuthology.orchestra.run.smithi079.stdout:5548 write 0x7dad1a4 thru 0x7daf484 (0x22e1 bytes) 2024-09-11T07:07:43.379 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:43.375+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:43.383 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:43.383 INFO:teuthology.orchestra.run.smithi079.stdout:5550 punch from 0x602c5e to 0x607581, (0x4923 bytes) 2024-09-11T07:07:43.383 INFO:teuthology.orchestra.run.smithi079.stdout:5551 read 0x4107323 thru 0x4108cfc (0x19da bytes) 2024-09-11T07:07:43.388 INFO:teuthology.orchestra.run.smithi079.stdout:5553 trunc from 0x7daf485 to 0xa965d6f 2024-09-11T07:07:43.397 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19018 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1527808~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.085320706000005, 2024-09-11T07:07:43.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061289669999999997, 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19018 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309476+0000", 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309477+0000", 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6199999999999997e-07 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309481+0000", 2024-09-11T07:07:43.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.42e-06 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309516+0000", 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4128000000000003e-05 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309526+0000", 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0942e-05 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370579+0000", 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061052459000000003 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370697+0000", 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118051 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370766+0000", 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8907999999999998e-05 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.085253152000007, 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.402 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:07:43.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:07:43.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.085172314999994, 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.406 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:07:43.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.085128968999996, 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.411 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:07:43.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:07:43.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.085058844000002, 2024-09-11T07:07:43.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:43.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:07:43.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:07:43.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.084990719999993, 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:07:43.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.424 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.084950254000006, 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.428 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.084912212999996, 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:07:43.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:07:43.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:07:43.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.084873243000004, 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.433 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:07:43.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.437 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.084832368999997, 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.438 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:43.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:07:43.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.084504596000002, 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.443 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:07:43.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.084438086000006, 2024-09-11T07:07:43.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:43.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:07:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:07:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:43.452 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.084370367000005, 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.453 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:07:43.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.084325429000003, 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:43.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:07:43.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:07:43.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.461 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.083525804000004, 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:07:43.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.083491461999998, 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.466 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:07:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:07:43.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.083128787000007, 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.471 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:07:43.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.145227836000004, 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:07:43.475 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:07:43.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109724 3.1d 3:bd9f0dd6:::rbd_data.1161dd0f3253.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.8753525980000001, 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.063964249000000001, 2024-09-11T07:07:43.481 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109724 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519447+0000", 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1799999999999999e-06 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523605+0000", 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041584270000000001 2024-09-11T07:07:43.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523644+0000", 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8908000000000001e-05 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523661+0000", 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7198999999999999e-05 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523781+0000", 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011950799999999999 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.524055+0000", 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027451199999999998 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.548286+0000", 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.024231249 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583267+0000", 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.034980245 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583326+0000", 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9815999999999998e-05 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583372+0000", 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6074e-05 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583409+0000", 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6130999999999997e-05 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109733 3.5 3:a2b45ebf:::rbd_data.1161dd0f3253.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.7937518929999996, 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067924668999999993, 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.487 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109733 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601047+0000", 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.029e-06 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601058+0000", 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0974e-05 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601083+0000", 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4757999999999999e-05 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601099+0000", 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5733e-05 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601212+0000", 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113857 2024-09-11T07:07:43.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601453+0000", 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240657 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.613355+0000", 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01190186 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668765+0000", 2024-09-11T07:07:43.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055410261000000002 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668796+0000", 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0833000000000001e-05 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668891+0000", 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4708000000000002e-05 2024-09-11T07:07:43.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668970+0000", 2024-09-11T07:07:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8998999999999994e-05 2024-09-11T07:07:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.493 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.493 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:43.496 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:43.496 INFO:teuthology.orchestra.run.smithi079.stdout:5554 trunc from 0xa965d6f to 0x274ac0e 2024-09-11T07:07:43.496 INFO:teuthology.orchestra.run.smithi079.stdout:5558 write 0x19d7d76 thru 0x19dba26 (0x3cb1 bytes) 2024-09-11T07:07:43.496 INFO:teuthology.orchestra.run.smithi079.stdout:5559 read 0x1dc2bb2 thru 0x1dc37a8 (0xbf7 bytes) 2024-09-11T07:07:43.497 INFO:teuthology.orchestra.run.smithi079.stdout:5561 write 0x3a1db5a thru 0x3a208ea (0x2d91 bytes) 2024-09-11T07:07:43.497 INFO:teuthology.orchestra.run.smithi079.stdout:5562 write 0x1310847 thru 0x131a5b3 (0x9d6d bytes) 2024-09-11T07:07:43.497 INFO:teuthology.orchestra.run.smithi079.stdout:5563 trunc from 0x3a208eb to 0x4d1212b 2024-09-11T07:07:43.497 INFO:teuthology.orchestra.run.smithi079.stdout:5564 punch from 0x4ceaac to 0x4d7ea5, (0x93f9 bytes) 2024-09-11T07:07:43.497 INFO:teuthology.orchestra.run.smithi079.stdout:5565 trunc from 0x4d1212b to 0x638fef7 2024-09-11T07:07:43.497 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:43.497 INFO:teuthology.orchestra.run.smithi079.stdout:5568 trunc from 0x638fef7 to 0xe136c8d 2024-09-11T07:07:43.497 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:43.492+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:43.498 INFO:teuthology.orchestra.run.smithi079.stdout:5571 clone 44 order 24 su 65536 sc 15 2024-09-11T07:07:43.596 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:43.592+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:43.678 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:43.678 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:43.678 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:43.678 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:43.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:43.697 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:43.696+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:43.799 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:43.796+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:43.835 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:43.835 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:43.835 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:43.835 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:43.835 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:43.849 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:43.900 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:43.895+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:43.968 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.644013721999997, 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:07:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.341074626999998, 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.341011511000005, 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:07:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340936518000007, 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340871961999994, 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:07:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340816732999997, 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340762835999996, 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:07:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:07:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340702336999996, 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:07:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:07:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340646324000005, 2024-09-11T07:07:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:07:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:07:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340566971000001, 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:07:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340510667999993, 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340438229, 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340382109000004, 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:07:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340308643, 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.032 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 89.340230250000005, 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:07:44.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:07:44.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.431054235999994, 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:07:44.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:44.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:07:44.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:07:44.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:07:44.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:07:44.041 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.041 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.174468651000002, 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.042 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.043 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:07:44.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:07:44.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.40447464, 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.048 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:44.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:44.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:07:44.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.053 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.396484745, 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.054 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:07:44.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109791 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 5824422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 5.2374544890000001, 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029141958999999999, 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.058 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109791 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728800+0000", 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.064e-06 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744261+0000", 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015461523 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744287+0000", 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5086999999999999e-05 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744298+0000", 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1899000000000001e-05 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744376+0000", 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7465000000000005e-05 2024-09-11T07:07:44.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744514+0000", 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013820400000000001 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.745045+0000", 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053122399999999995 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.751499+0000", 2024-09-11T07:07:44.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064538750000000004 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757772+0000", 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062726509999999997 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757865+0000", 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2802999999999999e-05 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757933+0000", 2024-09-11T07:07:44.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8164000000000007e-05 2024-09-11T07:07:44.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.064 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.064 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.064 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:44.065 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:44.066 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:44.063+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:44.166 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:44.163+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:44.233 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:44.233 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:44.233 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:44.233 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:44.247 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:44.266 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:44.264+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:44.301 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:07:44.367 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:44.363+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:44.414 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:44.415 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:44.415 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:44.429 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:44.468 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:44.464+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:44.569 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:44.567+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:44.599 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.526925659, 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:07:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:07:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:07:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:07:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.100755164000006, 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:07:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:07:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.100698946999998, 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097651786, 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:07:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:07:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097598685999998, 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097499780999996, 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097431912999994, 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:07:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097375378999999, 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:07:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:07:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:07:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097322919000007, 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:07:44.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:07:44.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097271290999998, 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097219869, 2024-09-11T07:07:44.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:07:44.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097168775, 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.652 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:07:44.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097116815000007, 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.656 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:44.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:07:44.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:07:44.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:07:44.660 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.097017301999998, 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.661 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:07:44.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:07:44.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.096958497000003, 2024-09-11T07:07:44.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:07:44.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.096907342999998, 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:07:44.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.096851036999993, 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.674 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:07:44.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.090051521999996, 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:44.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:07:44.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:07:44.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.357981497000001, 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.683 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:07:44.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:07:44.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:07:44.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 24.040572449999999, 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:44.689 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:44.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:44.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.694 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:44.695 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:44.695 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:44.695 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:44.697 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:44.695+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:44.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:44.797 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:44.795+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:44.828 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:07:44.853 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:44.853 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:44.872 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:44.872 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:44.873 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:44.873 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:44.889 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:44.889 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:44.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:44.898 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:44.895+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:44.908 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:44.909 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:44.929 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:44.929 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:44.950 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:44.950 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:44.971 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:44.972 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:44.992 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:44.992 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:44.998 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:44.996+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:45.033 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:45.034 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:45.048 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:45.100 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:45.095+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:45.200 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:45.195+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:45.215 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:45.215 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:45.231 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:45.301 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:45.300+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:45.354 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:45.355 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:45.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:45.413 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:45.412+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:45.503 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:45.500+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:45.544 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:45.545 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:45.560 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:45.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:45.644+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:45.706 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:45.704+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:45.728 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:45.728 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:45.742 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:45.835 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:45.832+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:45.909 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:45.907+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:45.914 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:45.914 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:45.928 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:46.010 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:46.007+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:46.097 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:46.097 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:46.111 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:46.107+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:46.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:46.211 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:46.208+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:46.235 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:46.235 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:46.250 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:46.295 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7] out_osds: [0, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:07:46.295 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:07:46.295 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-09-11T07:07:46.295 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T07:07:46.312 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:46.307+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:46.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:46.412+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:46.417 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:46.417 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:46.432 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:46.525 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:46.524+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:46.591 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:46.592 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:46.605 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:46.614 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:46.611+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:46.637 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:07:46.637 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 109, 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "e1313abd-54a9-4e53-ab67-469f744048b1", 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-11T07:05:29.098467+0000", 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-11T07:07:45.828579+0000", 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-11T07:05:41.051856+0000", 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-11T07:07:41.257150+0000", 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5801984, 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "noscrub", 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-11T07:07:46.638 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "luminous", 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "squid", 2024-09-11T07:07:46.639 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:41.897005+0000", 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:07:46.640 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:07:46.641 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-11T07:07:46.642 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:07:46.643 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:07:46.644 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:07:46.645 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 6.9000000953674316, 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 6.9000000953674316, 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.28999999165534973, 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:47.687214+0000", 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:07:46.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-11T07:07:46.647 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "20", 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:07:46.648 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 2, 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 20, 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:07:46.649 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:07:46.650 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:07:46.651 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.7400000095367432, 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.7400000095367432, 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.86000001430511475, 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.5, 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.5, 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-11T07:07:46.652 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:57.298060+0000", 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:07:46.653 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "107", 2024-09-11T07:07:46.654 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 46, 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 107, 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:07:46.655 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:07:46.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:07:46.657 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.9700000286102295, 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.9700000286102295, 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.86000001430511475, 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.690000057220459, 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.690000057220459, 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.658 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "24d57cdb-2f3a-4a96-903d-11be7dc26a20", 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 0, 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0, 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:46.659 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 72, 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:46.660 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:46.661 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:46.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-11T07:07:46.663 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/1708235775", 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/1708235775", 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/1708235775", 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/1708235775", 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.664 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:07:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "aa51dc1b-b783-4212-8736-1f666239613b", 2024-09-11T07:07:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:46.665 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 108, 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:46.666 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:46.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-11T07:07:46.668 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-11T07:07:46.669 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/2076268206", 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/2076268206", 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/2076268206", 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/2076268206", 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.670 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "141a913f-7353-44a9-9dbd-70219bcee638", 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 107, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:46.672 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.673 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.674 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/1904492349", 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/1904492349", 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/1904492349", 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/1904492349", 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "32550aeb-0c8d-4ca9-afd5-3e5258e7255b", 2024-09-11T07:07:46.676 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 108, 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.677 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.678 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.679 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.680 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/1327328912", 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/1327328912", 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/1327328912", 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/1327328912", 2024-09-11T07:07:46.681 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc", 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 0, 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0, 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 0, 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:46.682 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6808", 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6809", 2024-09-11T07:07:46.683 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6810", 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6811", 2024-09-11T07:07:46.684 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6814", 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6815", 2024-09-11T07:07:46.685 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6812", 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.686 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6813", 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6809/4087452871", 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6811/4087452871", 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6815/4087452871", 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6813/4087452871", 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "42c83053-328e-4c9b-bdaf-09e1a4cc8b7d", 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 108, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:46.688 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6824", 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6825", 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:46.689 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6826", 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6827", 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:46.690 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6830", 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6831", 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.691 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6828", 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6829", 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.692 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6825/2133006853", 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6827/2133006853", 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6831/2133006853", 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6829/2133006853", 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "0ab29b1f-3012-4528-8f47-2cac908122c9", 2024-09-11T07:07:46.693 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 0.3728179931640625, 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 107, 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.694 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6816", 2024-09-11T07:07:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6817", 2024-09-11T07:07:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6818", 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6819", 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6822", 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6823", 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:46.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6820", 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6821", 2024-09-11T07:07:46.698 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6817/2083734892", 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6819/2083734892", 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6823/2083734892", 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6821/2083734892", 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d9c7d12b-be93-41c9-a246-773faa65ecaf", 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 108, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:46.700 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6800", 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6801", 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.701 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6802", 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6803", 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.702 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6806", 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6807", 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6804", 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6805", 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.704 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6801/2322042784", 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6803/2322042784", 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2322042784", 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2322042784", 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.705 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 65536, 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.653648+0000", 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:46.706 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.846269+0000", 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.970884+0000", 2024-09-11T07:07:46.707 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.985630+0000", 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.708 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 65536, 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.236412+0000", 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:46.709 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.336953+0000", 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.306806+0000", 2024-09-11T07:07:46.710 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.104744+0000", 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [], 2024-09-11T07:07:46.711 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [ 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "pgid": "3.17", 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "mappings": [ 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "from": 5, 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "to": 2 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-11T07:07:46.712 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2024-09-11T07:07:46.713 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-11T07:07:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-11T07:07:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-11T07:07:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-11T07:07:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-11T07:07:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-11T07:07:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-11T07:07:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-11T07:07:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-11T07:07:46.714 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:46.714 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:46.717 INFO:tasks.thrashosds.thrasher:j is {'epoch': 109, 'fsid': 'e1313abd-54a9-4e53-ab67-469f744048b1', 'created': '2024-09-11T07:05:29.098467+0000', 'modified': '2024-09-11T07:07:45.828579+0000', 'last_up_change': '2024-09-11T07:05:41.051856+0000', 'last_in_change': '2024-09-11T07:07:41.257150+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T07:05:41.897005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T07:05:47.687214+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8600000143051147, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T07:05:57.298060+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '107', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 46, 'snap_epoch': 107, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9700000286102295, 'score_stable': 1.9700000286102295, 'optimal_score': 0.8600000143051147, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}], 'osds': [{'osd': 0, 'uuid': '24d57cdb-2f3a-4a96-903d-11be7dc26a20', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 72, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6825', 'nonce': 1708235775}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6826', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 1708235775}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6830', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 1708235775}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6829', 'nonce': 1708235775}]}, 'public_addr': '172.21.15.79:6825/1708235775', 'cluster_addr': '172.21.15.79:6827/1708235775', 'heartbeat_back_addr': '172.21.15.79:6831/1708235775', 'heartbeat_front_addr': '172.21.15.79:6829/1708235775', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa51dc1b-b783-4212-8736-1f666239613b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 108, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 2076268206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 2076268206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 2076268206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 2076268206}]}, 'public_addr': '172.21.15.79:6801/2076268206', 'cluster_addr': '172.21.15.79:6803/2076268206', 'heartbeat_back_addr': '172.21.15.79:6807/2076268206', 'heartbeat_front_addr': '172.21.15.79:6805/2076268206', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '141a913f-7353-44a9-9dbd-70219bcee638', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 107, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6817', 'nonce': 1904492349}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6818', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1904492349}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6822', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 1904492349}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6821', 'nonce': 1904492349}]}, 'public_addr': '172.21.15.79:6817/1904492349', 'cluster_addr': '172.21.15.79:6819/1904492349', 'heartbeat_back_addr': '172.21.15.79:6823/1904492349', 'heartbeat_front_addr': '172.21.15.79:6821/1904492349', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '32550aeb-0c8d-4ca9-afd5-3e5258e7255b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 108, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 1327328912}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 1327328912}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 1327328912}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 1327328912}]}, 'public_addr': '172.21.15.79:6809/1327328912', 'cluster_addr': '172.21.15.79:6811/1327328912', 'heartbeat_back_addr': '172.21.15.79:6815/1327328912', 'heartbeat_front_addr': '172.21.15.79:6813/1327328912', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 100, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 4087452871}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 4087452871}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 4087452871}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 4087452871}]}, 'public_addr': '172.21.15.110:6809/4087452871', 'cluster_addr': '172.21.15.110:6811/4087452871', 'heartbeat_back_addr': '172.21.15.110:6815/4087452871', 'heartbeat_front_addr': '172.21.15.110:6813/4087452871', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '42c83053-328e-4c9b-bdaf-09e1a4cc8b7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 108, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 2133006853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 2133006853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 2133006853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 2133006853}]}, 'public_addr': '172.21.15.110:6825/2133006853', 'cluster_addr': '172.21.15.110:6827/2133006853', 'heartbeat_back_addr': '172.21.15.110:6831/2133006853', 'heartbeat_front_addr': '172.21.15.110:6829/2133006853', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0ab29b1f-3012-4528-8f47-2cac908122c9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3728179931640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 107, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 2083734892}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 2083734892}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 2083734892}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 2083734892}]}, 'public_addr': '172.21.15.110:6817/2083734892', 'cluster_addr': '172.21.15.110:6819/2083734892', 'heartbeat_back_addr': '172.21.15.110:6823/2083734892', 'heartbeat_front_addr': '172.21.15.110:6821/2083734892', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'd9c7d12b-be93-41c9-a246-773faa65ecaf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 108, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2322042784}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2322042784}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2322042784}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2322042784}]}, 'public_addr': '172.21.15.110:6801/2322042784', 'cluster_addr': '172.21.15.110:6803/2322042784', 'heartbeat_back_addr': '172.21.15.110:6807/2322042784', 'heartbeat_front_addr': '172.21.15.110:6805/2322042784', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.653648+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.846269+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.970884+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.985630+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.236412+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.336953+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.306806+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.104744+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.17', 'mappings': [{'from': 5, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T07:07:46.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:07:46.718 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:46.711+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:46.817 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:46.816+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:46.844 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:46.844 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:46.860 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:46.860 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:07:46.949 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:46.948+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:46.990 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:46.991 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:47.004 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:47.012 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:47.057 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:47.056+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:47.079 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:07:47.080 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:07:47.101 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-09-11T07:07:46.833200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1206936958,"num_objects":2212,"num_object_clones":348,"num_object_copies":4424,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2212,"num_whiteouts":1182,"num_read":143032,"num_read_kb":595611,"num_write":16061,"num_write_kb":399248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":709,"num_bytes_recovered":65440922,"num_keys_recovered":178,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13848,"ondisk_log_size":13848,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":69,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":270960,"kb_used_data":44740,"kb_used_omap":9,"kb_used_meta":225846,"kb_avail":565960080,"statfs":{"total":579820584960,"available":579543121920,"internally_reserved":0,"allocated":45813760,"data_stored":516355066,"data_compressed":12802344,"data_compressed_allocated":31518720,"data_compressed_original":508927879,"omap_allocated":9568,"internal_metadata":231266976},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.553405"},"pg_stats":[{"pgid":"3.1f","version":"96'378","reported_seq":2545,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.273114+0000","last_change":"2024-09-11T07:07:00.913312+0000","last_active":"2024-09-11T07:07:41.273114+0000","last_peered":"2024-09-11T07:07:41.273114+0000","last_clean":"2024-09-11T07:07:41.273114+0000","last_became_active":"2024-09-11T07:07:00.912449+0000","last_became_peered":"2024-09-11T07:07:00.912449+0000","last_unstale":"2024-09-11T07:07:41.273114+0000","last_undegraded":"2024-09-11T07:07:41.273114+0000","last_fullsized":"2024-09-11T07:07:41.273114+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:07:56.618498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097647200000000004,"stat_sum":{"num_bytes":33615505,"num_objects":67,"num_object_clones":14,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":37,"num_read":2550,"num_read_kb":4904,"num_write":473,"num_write_kb":18890,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1716442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"103'328","reported_seq":1685,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.277241+0000","last_change":"2024-09-11T07:06:00.970173+0000","last_active":"2024-09-11T07:07:41.277241+0000","last_peered":"2024-09-11T07:07:41.277241+0000","last_clean":"2024-09-11T07:07:41.277241+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:07:41.277241+0000","last_undegraded":"2024-09-11T07:07:41.277241+0000","last_fullsized":"2024-09-11T07:07:41.277241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:14:42.958360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084787600000000001,"stat_sum":{"num_bytes":33826441,"num_objects":71,"num_object_clones":10,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":35,"num_read":1574,"num_read_kb":19230,"num_write":339,"num_write_kb":12612,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"103'487","reported_seq":11788,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:41.262031+0000","last_change":"2024-09-11T07:07:41.275319+0000","last_active":"2024-09-11T07:07:41.275319+0000","last_peered":"2024-09-11T07:07:41.262031+0000","last_clean":"2024-09-11T07:07:41.262031+0000","last_became_active":"2024-09-11T07:05:58.827234+0000","last_became_peered":"2024-09-11T07:05:58.827234+0000","last_unstale":"2024-09-11T07:07:41.262031+0000","last_undegraded":"2024-09-11T07:07:41.262031+0000","last_fullsized":"2024-09-11T07:07:41.262031+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":487,"log_dups_size":0,"ondisk_log_size":487,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550473,"stat_sum":{"num_bytes":83748102,"num_objects":78,"num_object_clones":12,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":45,"num_read":13199,"num_read_kb":66152,"num_write":599,"num_write_kb":14486,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"103'758","reported_seq":3130,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:41.268692+0000","last_change":"2024-09-11T07:07:41.274464+0000","last_active":"2024-09-11T07:07:41.274464+0000","last_peered":"2024-09-11T07:07:41.268692+0000","last_clean":"2024-09-11T07:07:41.268692+0000","last_became_active":"2024-09-11T07:05:58.826843+0000","last_became_peered":"2024-09-11T07:05:58.826843+0000","last_unstale":"2024-09-11T07:07:41.268692+0000","last_undegraded":"2024-09-11T07:07:41.268692+0000","last_fullsized":"2024-09-11T07:07:41.268692+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":758,"log_dups_size":0,"ondisk_log_size":758,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022332319999999999,"stat_sum":{"num_bytes":36595546,"num_objects":85,"num_object_clones":15,"num_object_copies":170,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":45,"num_read":4372,"num_read_kb":15587,"num_write":1020,"num_write_kb":13509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"102'436","reported_seq":5732,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:39.252079+0000","last_change":"2024-09-11T07:07:41.278993+0000","last_active":"2024-09-11T07:07:41.278993+0000","last_peered":"2024-09-11T07:07:39.252079+0000","last_clean":"2024-09-11T07:07:39.252079+0000","last_became_active":"2024-09-11T07:07:18.066166+0000","last_became_peered":"2024-09-11T07:07:18.066166+0000","last_unstale":"2024-09-11T07:07:39.252079+0000","last_undegraded":"2024-09-11T07:07:39.252079+0000","last_fullsized":"2024-09-11T07:07:39.252079+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001182787,"stat_sum":{"num_bytes":9793228,"num_objects":71,"num_object_clones":8,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":47,"num_read":7660,"num_read_kb":10767,"num_write":458,"num_write_kb":3392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":41,"num_bytes_recovered":1396946,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"103'412","reported_seq":3335,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:41.270868+0000","last_change":"2024-09-11T07:07:41.272949+0000","last_active":"2024-09-11T07:07:41.272949+0000","last_peered":"2024-09-11T07:07:41.270868+0000","last_clean":"2024-09-11T07:07:41.270868+0000","last_became_active":"2024-09-11T07:07:18.063727+0000","last_became_peered":"2024-09-11T07:07:18.063727+0000","last_unstale":"2024-09-11T07:07:41.270868+0000","last_undegraded":"2024-09-11T07:07:41.270868+0000","last_fullsized":"2024-09-11T07:07:41.270868+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059322499999999996,"stat_sum":{"num_bytes":15496082,"num_objects":78,"num_object_clones":11,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":51,"num_read":5041,"num_read_kb":10279,"num_write":453,"num_write_kb":9814,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"102'408","reported_seq":1655,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.272173+0000","last_change":"2024-09-11T07:06:00.820857+0000","last_active":"2024-09-11T07:07:41.272173+0000","last_peered":"2024-09-11T07:07:41.272173+0000","last_clean":"2024-09-11T07:07:41.272173+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:07:41.272173+0000","last_undegraded":"2024-09-11T07:07:41.272173+0000","last_fullsized":"2024-09-11T07:07:41.272173+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:14:05.520500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076385799999999996,"stat_sum":{"num_bytes":26302376,"num_objects":60,"num_object_clones":7,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":30,"num_read":2199,"num_read_kb":6180,"num_write":517,"num_write_kb":4047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"102'534","reported_seq":3609,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.277117+0000","last_change":"2024-09-11T07:07:00.913189+0000","last_active":"2024-09-11T07:07:41.277117+0000","last_peered":"2024-09-11T07:07:41.277117+0000","last_clean":"2024-09-11T07:07:41.277117+0000","last_became_active":"2024-09-11T07:07:00.911170+0000","last_became_peered":"2024-09-11T07:07:00.911170+0000","last_unstale":"2024-09-11T07:07:41.277117+0000","last_undegraded":"2024-09-11T07:07:41.277117+0000","last_fullsized":"2024-09-11T07:07:41.277117+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":534,"log_dups_size":0,"ondisk_log_size":534,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:44:37.623973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001212451,"stat_sum":{"num_bytes":53798315,"num_objects":79,"num_object_clones":11,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":47,"num_read":5653,"num_read_kb":12892,"num_write":565,"num_write_kb":21478,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":4844589,"num_keys_recovered":12,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"103'328","reported_seq":5726,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.274425+0000","last_change":"2024-09-11T07:07:00.915270+0000","last_active":"2024-09-11T07:07:41.274425+0000","last_peered":"2024-09-11T07:07:41.274425+0000","last_clean":"2024-09-11T07:07:41.274425+0000","last_became_active":"2024-09-11T07:07:00.912592+0000","last_became_peered":"2024-09-11T07:07:00.912592+0000","last_unstale":"2024-09-11T07:07:41.274425+0000","last_undegraded":"2024-09-11T07:07:41.274425+0000","last_fullsized":"2024-09-11T07:07:41.274425+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:19:24.242072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093584899999999999,"stat_sum":{"num_bytes":43544650,"num_objects":69,"num_object_clones":14,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":36,"num_read":6123,"num_read_kb":40744,"num_write":319,"num_write_kb":21008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":7459303,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"102'515","reported_seq":3089,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.273077+0000","last_change":"2024-09-11T07:06:00.825499+0000","last_active":"2024-09-11T07:07:41.273077+0000","last_peered":"2024-09-11T07:07:41.273077+0000","last_clean":"2024-09-11T07:07:41.273077+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:07:41.273077+0000","last_undegraded":"2024-09-11T07:07:41.273077+0000","last_fullsized":"2024-09-11T07:07:41.273077+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:37:44.425364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056977600000000003,"stat_sum":{"num_bytes":48327369,"num_objects":72,"num_object_clones":14,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":39,"num_read":3922,"num_read_kb":14956,"num_write":597,"num_write_kb":8597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"104'385","reported_seq":3142,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.288321+0000","last_change":"2024-09-11T07:06:00.837150+0000","last_active":"2024-09-11T07:07:41.288321+0000","last_peered":"2024-09-11T07:07:41.288321+0000","last_clean":"2024-09-11T07:07:41.288321+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:07:41.288321+0000","last_undegraded":"2024-09-11T07:07:41.288321+0000","last_fullsized":"2024-09-11T07:07:41.288321+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:14:16.485020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184086,"stat_sum":{"num_bytes":33004682,"num_objects":77,"num_object_clones":13,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":44,"num_read":3609,"num_read_kb":22472,"num_write":384,"num_write_kb":20235,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"103'433","reported_seq":3497,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:41.268303+0000","last_change":"2024-09-11T07:07:41.279922+0000","last_active":"2024-09-11T07:07:41.279922+0000","last_peered":"2024-09-11T07:07:41.268303+0000","last_clean":"2024-09-11T07:07:41.268303+0000","last_became_active":"2024-09-11T07:07:18.065210+0000","last_became_peered":"2024-09-11T07:07:18.065210+0000","last_unstale":"2024-09-11T07:07:41.268303+0000","last_undegraded":"2024-09-11T07:07:41.268303+0000","last_fullsized":"2024-09-11T07:07:41.268303+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":433,"log_dups_size":0,"ondisk_log_size":433,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046265999999999999,"stat_sum":{"num_bytes":34764249,"num_objects":68,"num_object_clones":11,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":34,"num_read":5563,"num_read_kb":16657,"num_write":451,"num_write_kb":7019,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":98,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.283605+0000","last_change":"2024-09-11T07:07:24.114928+0000","last_active":"2024-09-11T07:07:41.283605+0000","last_peered":"2024-09-11T07:07:41.283605+0000","last_clean":"2024-09-11T07:07:41.283605+0000","last_became_active":"2024-09-11T07:07:24.114181+0000","last_became_peered":"2024-09-11T07:07:24.114181+0000","last_unstale":"2024-09-11T07:07:41.283605+0000","last_undegraded":"2024-09-11T07:07:41.283605+0000","last_fullsized":"2024-09-11T07:07:41.283605+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:03.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"96'428","reported_seq":2889,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:39.288065+0000","last_change":"2024-09-11T07:07:41.273368+0000","last_active":"2024-09-11T07:07:41.273368+0000","last_peered":"2024-09-11T07:07:39.288065+0000","last_clean":"2024-09-11T07:07:39.288065+0000","last_became_active":"2024-09-11T07:07:00.912070+0000","last_became_peered":"2024-09-11T07:07:00.912070+0000","last_unstale":"2024-09-11T07:07:39.288065+0000","last_undegraded":"2024-09-11T07:07:39.288065+0000","last_fullsized":"2024-09-11T07:07:39.288065+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056190700000000005,"stat_sum":{"num_bytes":58522452,"num_objects":89,"num_object_clones":16,"num_object_copies":178,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":89,"num_whiteouts":50,"num_read":3417,"num_read_kb":13191,"num_write":440,"num_write_kb":8450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":5329407,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.273090+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:07:41.273090+0000","last_peered":"2024-09-11T07:07:41.273090+0000","last_clean":"2024-09-11T07:07:41.273090+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:07:41.273090+0000","last_undegraded":"2024-09-11T07:07:41.273090+0000","last_fullsized":"2024-09-11T07:07:41.273090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"102'574","reported_seq":1953,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.277241+0000","last_change":"2024-09-11T07:06:00.969789+0000","last_active":"2024-09-11T07:07:41.277241+0000","last_peered":"2024-09-11T07:07:41.277241+0000","last_clean":"2024-09-11T07:07:41.277241+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:07:41.277241+0000","last_undegraded":"2024-09-11T07:07:41.277241+0000","last_fullsized":"2024-09-11T07:07:41.277241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":574,"log_dups_size":0,"ondisk_log_size":574,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:45.269346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068823799999999998,"stat_sum":{"num_bytes":16457252,"num_objects":74,"num_object_clones":14,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":42,"num_read":3613,"num_read_kb":11252,"num_write":781,"num_write_kb":5500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":191,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:39.252337+0000","last_change":"2024-09-11T07:07:41.290322+0000","last_active":"2024-09-11T07:07:41.290322+0000","last_peered":"2024-09-11T07:07:39.252337+0000","last_clean":"2024-09-11T07:07:39.252337+0000","last_became_active":"2024-09-11T07:06:57.875190+0000","last_became_peered":"2024-09-11T07:06:57.875190+0000","last_unstale":"2024-09-11T07:07:39.252337+0000","last_undegraded":"2024-09-11T07:07:39.252337+0000","last_fullsized":"2024-09-11T07:07:39.252337+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"103'359","reported_seq":4186,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.273480+0000","last_change":"2024-09-11T07:06:00.821584+0000","last_active":"2024-09-11T07:07:41.273480+0000","last_peered":"2024-09-11T07:07:41.273480+0000","last_clean":"2024-09-11T07:07:41.273480+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:07:41.273480+0000","last_undegraded":"2024-09-11T07:07:41.273480+0000","last_fullsized":"2024-09-11T07:07:41.273480+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:43:11.142993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001413975,"stat_sum":{"num_bytes":30275127,"num_objects":63,"num_object_clones":8,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":31,"num_read":5060,"num_read_kb":27672,"num_write":350,"num_write_kb":12716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":191,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.273572+0000","last_change":"2024-09-11T07:06:57.872595+0000","last_active":"2024-09-11T07:07:41.273572+0000","last_peered":"2024-09-11T07:07:41.273572+0000","last_clean":"2024-09-11T07:07:41.273572+0000","last_became_active":"2024-09-11T07:06:57.872268+0000","last_became_peered":"2024-09-11T07:06:57.872268+0000","last_unstale":"2024-09-11T07:07:41.273572+0000","last_undegraded":"2024-09-11T07:07:41.273572+0000","last_fullsized":"2024-09-11T07:07:41.273572+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:51.009453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"103'457","reported_seq":2270,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.275832+0000","last_change":"2024-09-11T07:06:00.827482+0000","last_active":"2024-09-11T07:07:41.275832+0000","last_peered":"2024-09-11T07:07:41.275832+0000","last_clean":"2024-09-11T07:07:41.275832+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:07:41.275832+0000","last_undegraded":"2024-09-11T07:07:41.275832+0000","last_fullsized":"2024-09-11T07:07:41.275832+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:58:17.763175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002494839,"stat_sum":{"num_bytes":35233950,"num_objects":74,"num_object_clones":10,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":36,"num_read":2808,"num_read_kb":8158,"num_write":572,"num_write_kb":4952,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"102'464","reported_seq":3338,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:39.295330+0000","last_change":"2024-09-11T07:07:41.284939+0000","last_active":"2024-09-11T07:07:41.284939+0000","last_peered":"2024-09-11T07:07:39.295330+0000","last_clean":"2024-09-11T07:07:39.295330+0000","last_became_active":"2024-09-11T07:07:24.118916+0000","last_became_peered":"2024-09-11T07:07:24.118916+0000","last_unstale":"2024-09-11T07:07:39.295330+0000","last_undegraded":"2024-09-11T07:07:39.295330+0000","last_fullsized":"2024-09-11T07:07:39.295330+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040103300000000002,"stat_sum":{"num_bytes":26357269,"num_objects":58,"num_object_clones":9,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":30,"num_read":4425,"num_read_kb":11047,"num_write":535,"num_write_kb":11216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":57,"num_bytes_recovered":2632451,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":189,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.272806+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:07:41.272806+0000","last_peered":"2024-09-11T07:07:41.272806+0000","last_clean":"2024-09-11T07:07:41.272806+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:07:41.272806+0000","last_undegraded":"2024-09-11T07:07:41.272806+0000","last_fullsized":"2024-09-11T07:07:41.272806+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"103'507","reported_seq":4182,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.272186+0000","last_change":"2024-09-11T07:06:00.820656+0000","last_active":"2024-09-11T07:07:41.272186+0000","last_peered":"2024-09-11T07:07:41.272186+0000","last_clean":"2024-09-11T07:07:41.272186+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:07:41.272186+0000","last_undegraded":"2024-09-11T07:07:41.272186+0000","last_fullsized":"2024-09-11T07:07:41.272186+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:50:04.360287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058463999999999999,"stat_sum":{"num_bytes":100994554,"num_objects":87,"num_object_clones":15,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":87,"num_whiteouts":33,"num_read":4974,"num_read_kb":40637,"num_write":540,"num_write_kb":33723,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":187,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.274717+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:07:41.274717+0000","last_peered":"2024-09-11T07:07:41.274717+0000","last_clean":"2024-09-11T07:07:41.274717+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:07:41.274717+0000","last_undegraded":"2024-09-11T07:07:41.274717+0000","last_fullsized":"2024-09-11T07:07:41.274717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"103'393","reported_seq":7786,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:41.257748+0000","last_change":"2024-09-11T07:07:41.277767+0000","last_active":"2024-09-11T07:07:41.277767+0000","last_peered":"2024-09-11T07:07:41.257748+0000","last_clean":"2024-09-11T07:07:41.257748+0000","last_became_active":"2024-09-11T07:07:18.069009+0000","last_became_peered":"2024-09-11T07:07:18.069009+0000","last_unstale":"2024-09-11T07:07:41.257748+0000","last_undegraded":"2024-09-11T07:07:41.257748+0000","last_fullsized":"2024-09-11T07:07:41.257748+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070404599999999995,"stat_sum":{"num_bytes":49521789,"num_objects":68,"num_object_clones":11,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":33,"num_read":8553,"num_read_kb":32944,"num_write":432,"num_write_kb":25062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":47,"num_bytes_recovered":15817603,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":187,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.277123+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:07:41.277123+0000","last_peered":"2024-09-11T07:07:41.277123+0000","last_clean":"2024-09-11T07:07:41.277123+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:07:41.277123+0000","last_undegraded":"2024-09-11T07:07:41.277123+0000","last_fullsized":"2024-09-11T07:07:41.277123+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"103'373","reported_seq":4588,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.277177+0000","last_change":"2024-09-11T07:06:00.970754+0000","last_active":"2024-09-11T07:07:41.277177+0000","last_peered":"2024-09-11T07:07:41.277177+0000","last_clean":"2024-09-11T07:07:41.277177+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:07:41.277177+0000","last_undegraded":"2024-09-11T07:07:41.277177+0000","last_fullsized":"2024-09-11T07:07:41.277177+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:24:54.320068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013822890000000001,"stat_sum":{"num_bytes":22459387,"num_objects":56,"num_object_clones":6,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":32,"num_read":4945,"num_read_kb":20205,"num_write":421,"num_write_kb":10469,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":188,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.272848+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:07:41.272848+0000","last_peered":"2024-09-11T07:07:41.272848+0000","last_clean":"2024-09-11T07:07:41.272848+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:07:41.272848+0000","last_undegraded":"2024-09-11T07:07:41.272848+0000","last_fullsized":"2024-09-11T07:07:41.272848+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":351,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.277203+0000","last_change":"2024-09-11T07:07:00.907608+0000","last_active":"2024-09-11T07:07:41.277203+0000","last_peered":"2024-09-11T07:07:41.277203+0000","last_clean":"2024-09-11T07:07:41.277203+0000","last_became_active":"2024-09-11T07:07:00.907199+0000","last_became_peered":"2024-09-11T07:07:00.907199+0000","last_unstale":"2024-09-11T07:07:41.277203+0000","last_undegraded":"2024-09-11T07:07:41.277203+0000","last_fullsized":"2024-09-11T07:07:41.277203+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:37.571030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"102'280","reported_seq":2718,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.277066+0000","last_change":"2024-09-11T07:06:00.970646+0000","last_active":"2024-09-11T07:07:41.277066+0000","last_peered":"2024-09-11T07:07:41.277066+0000","last_clean":"2024-09-11T07:07:41.277066+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:07:41.277066+0000","last_undegraded":"2024-09-11T07:07:41.277066+0000","last_fullsized":"2024-09-11T07:07:41.277066+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:17.379345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012611810000000001,"stat_sum":{"num_bytes":32113636,"num_objects":74,"num_object_clones":12,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":42,"num_read":2365,"num_read_kb":11009,"num_write":262,"num_write_kb":6750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"103'217","reported_seq":1371,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:41.061472+0000","last_change":"2024-09-11T07:07:41.274503+0000","last_active":"2024-09-11T07:07:41.274503+0000","last_peered":"2024-09-11T07:07:41.061472+0000","last_clean":"2024-09-11T07:07:41.061472+0000","last_became_active":"2024-09-11T07:07:38.248045+0000","last_became_peered":"2024-09-11T07:07:38.248045+0000","last_unstale":"2024-09-11T07:07:41.061472+0000","last_undegraded":"2024-09-11T07:07:41.061472+0000","last_fullsized":"2024-09-11T07:07:41.061472+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062012700000000005,"stat_sum":{"num_bytes":32081944,"num_objects":63,"num_object_clones":8,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":32,"num_read":1244,"num_read_kb":7806,"num_write":180,"num_write_kb":7087,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":88,"num_bytes_recovered":2118298,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6,7],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":104,"state":"unknown","last_fresh":"2024-09-11T07:07:41.276347+0000","last_change":"2024-09-11T07:07:41.859277+0000","last_active":"0.000000","last_peered":"0.000000","last_clean":"0.000000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-11T07:07:41.276347+0000","last_undegraded":"2024-09-11T07:07:41.276347+0000","last_fullsized":"2024-09-11T07:07:41.276347+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"103'421","reported_seq":2410,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:41.268738+0000","last_change":"2024-09-11T07:07:41.278525+0000","last_active":"2024-09-11T07:07:41.278525+0000","last_peered":"2024-09-11T07:07:41.268738+0000","last_clean":"2024-09-11T07:07:41.268738+0000","last_became_active":"2024-09-11T07:07:38.250531+0000","last_became_peered":"2024-09-11T07:07:38.250531+0000","last_unstale":"2024-09-11T07:07:41.268738+0000","last_undegraded":"2024-09-11T07:07:41.268738+0000","last_fullsized":"2024-09-11T07:07:41.268738+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":421,"log_dups_size":0,"ondisk_log_size":421,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021149200000000002,"stat_sum":{"num_bytes":29742123,"num_objects":74,"num_object_clones":11,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":40,"num_read":4060,"num_read_kb":20216,"num_write":486,"num_write_kb":14686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":128,"num_bytes_recovered":14713879,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"103'296","reported_seq":2586,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.272953+0000","last_change":"2024-09-11T07:06:00.827407+0000","last_active":"2024-09-11T07:07:41.272953+0000","last_peered":"2024-09-11T07:07:41.272953+0000","last_clean":"2024-09-11T07:07:41.272953+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:07:41.272953+0000","last_undegraded":"2024-09-11T07:07:41.272953+0000","last_fullsized":"2024-09-11T07:07:41.272953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":296,"log_dups_size":0,"ondisk_log_size":296,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:08:10.441032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024738579999999998,"stat_sum":{"num_bytes":27062697,"num_objects":64,"num_object_clones":14,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":33,"num_read":2201,"num_read_kb":7244,"num_write":259,"num_write_kb":5860,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"102'341","reported_seq":3282,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.289018+0000","last_change":"2024-09-11T07:06:00.838531+0000","last_active":"2024-09-11T07:07:41.289018+0000","last_peered":"2024-09-11T07:07:41.289018+0000","last_clean":"2024-09-11T07:07:41.289018+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:07:41.289018+0000","last_undegraded":"2024-09-11T07:07:41.289018+0000","last_fullsized":"2024-09-11T07:07:41.289018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:07:36.857626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022638789999999999,"stat_sum":{"num_bytes":36000446,"num_objects":77,"num_object_clones":10,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":39,"num_read":4342,"num_read_kb":18989,"num_write":343,"num_write_kb":9149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"102'390","reported_seq":2449,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:39.252193+0000","last_change":"2024-09-11T07:07:41.285909+0000","last_active":"2024-09-11T07:07:41.285909+0000","last_peered":"2024-09-11T07:07:39.252193+0000","last_clean":"2024-09-11T07:07:39.252193+0000","last_became_active":"2024-09-11T07:05:58.825160+0000","last_became_peered":"2024-09-11T07:05:58.825160+0000","last_unstale":"2024-09-11T07:07:39.252193+0000","last_undegraded":"2024-09-11T07:07:39.252193+0000","last_fullsized":"2024-09-11T07:07:39.252193+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017910619999999999,"stat_sum":{"num_bytes":53218120,"num_objects":64,"num_object_clones":10,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":35,"num_read":4501,"num_read_kb":40072,"num_write":402,"num_write_kb":33705,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"103'622","reported_seq":4178,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:41.257490+0000","last_change":"2024-09-11T07:07:41.283750+0000","last_active":"2024-09-11T07:07:41.283750+0000","last_peered":"2024-09-11T07:07:41.257490+0000","last_clean":"2024-09-11T07:07:41.257490+0000","last_became_active":"2024-09-11T07:05:58.822422+0000","last_became_peered":"2024-09-11T07:05:58.822422+0000","last_unstale":"2024-09-11T07:07:41.257490+0000","last_undegraded":"2024-09-11T07:07:41.257490+0000","last_fullsized":"2024-09-11T07:07:41.257490+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":622,"log_dups_size":0,"ondisk_log_size":622,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020506280000000001,"stat_sum":{"num_bytes":81341317,"num_objects":75,"num_object_clones":13,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":41,"num_read":6030,"num_read_kb":22135,"num_write":785,"num_write_kb":16020,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1,4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"102'1188","reported_seq":2582,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.283495+0000","last_change":"2024-09-11T07:07:24.117156+0000","last_active":"2024-09-11T07:07:41.283495+0000","last_peered":"2024-09-11T07:07:41.283495+0000","last_clean":"2024-09-11T07:07:41.283495+0000","last_became_active":"2024-09-11T07:07:24.114910+0000","last_became_peered":"2024-09-11T07:07:24.114910+0000","last_unstale":"2024-09-11T07:07:41.283495+0000","last_undegraded":"2024-09-11T07:07:41.283495+0000","last_fullsized":"2024-09-11T07:07:41.283495+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":1188,"log_dups_size":0,"ondisk_log_size":1188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:52:16.750513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049279100000000002,"stat_sum":{"num_bytes":31792719,"num_objects":72,"num_object_clones":10,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":37,"num_read":6544,"num_read_kb":16448,"num_write":1838,"num_write_kb":15807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":2516909,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"102'229","reported_seq":3535,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:39.251919+0000","last_change":"2024-09-11T07:07:41.281507+0000","last_active":"2024-09-11T07:07:41.281507+0000","last_peered":"2024-09-11T07:07:39.251919+0000","last_clean":"2024-09-11T07:07:39.251919+0000","last_became_active":"2024-09-11T07:05:58.822373+0000","last_became_peered":"2024-09-11T07:05:58.822373+0000","last_unstale":"2024-09-11T07:07:39.251919+0000","last_undegraded":"2024-09-11T07:07:39.251919+0000","last_fullsized":"2024-09-11T07:07:39.251919+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":229,"log_dups_size":0,"ondisk_log_size":229,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089665299999999997,"stat_sum":{"num_bytes":33990538,"num_objects":67,"num_object_clones":14,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":30,"num_read":3169,"num_read_kb":9248,"num_write":211,"num_write_kb":6392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4,6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"102'302","reported_seq":6057,"reported_epoch":104,"state":"active+clean","last_fresh":"2024-09-11T07:07:41.277392+0000","last_change":"2024-09-11T07:07:00.911244+0000","last_active":"2024-09-11T07:07:41.277392+0000","last_peered":"2024-09-11T07:07:41.277392+0000","last_clean":"2024-09-11T07:07:41.277392+0000","last_became_active":"2024-09-11T07:07:00.910054+0000","last_became_peered":"2024-09-11T07:07:00.910054+0000","last_unstale":"2024-09-11T07:07:41.277392+0000","last_undegraded":"2024-09-11T07:07:41.277392+0000","last_fullsized":"2024-09-11T07:07:41.277392+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":302,"log_dups_size":0,"ondisk_log_size":302,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:02.727760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086507200000000004,"stat_sum":{"num_bytes":41158161,"num_objects":74,"num_object_clones":13,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":40,"num_read":6024,"num_read_kb":31274,"num_write":348,"num_write_kb":9951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":6304727,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"103'485","reported_seq":2244,"reported_epoch":103,"state":"peering","last_fresh":"2024-09-11T07:07:40.084027+0000","last_change":"2024-09-11T07:07:41.279382+0000","last_active":"2024-09-11T07:07:41.279382+0000","last_peered":"2024-09-11T07:07:40.084027+0000","last_clean":"2024-09-11T07:07:40.084027+0000","last_became_active":"2024-09-11T07:05:58.823540+0000","last_became_peered":"2024-09-11T07:05:58.823540+0000","last_unstale":"2024-09-11T07:07:40.084027+0000","last_undegraded":"2024-09-11T07:07:40.084027+0000","last_fullsized":"2024-09-11T07:07:40.084027+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012764899999999999,"stat_sum":{"num_bytes":15206545,"num_objects":60,"num_object_clones":4,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":36,"num_read":3176,"num_read_kb":5144,"num_write":540,"num_write_kb":4248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2,4],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1206346571,"num_objects":2208,"num_object_clones":348,"num_object_copies":4416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2208,"num_whiteouts":1182,"num_read":142916,"num_read_kb":595511,"num_write":15900,"num_write_kb":396830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":707,"num_bytes_recovered":64850554,"num_keys_recovered":178,"num_objects_omap":44,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":52887552,"data_stored":725026875,"data_compressed":17510226,"data_compressed_allocated":43720704,"data_compressed_original":719761991,"omap_allocated":0,"internal_metadata":0},"log_size":13728,"ondisk_log_size":13728,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":18293,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574874,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40932,"kb_used_data":9740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94330908,"statfs":{"total":96636764160,"available":96594849792,"internally_reserved":0,"allocated":9973760,"data_stored":120761158,"data_compressed":2587650,"data_compressed_allocated":7188480,"data_compressed_original":119245275,"omap_allocated":1591,"internal_metadata":31914441},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":43284,"kb_used_data":3780,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94328556,"statfs":{"total":96636764160,"available":96592441344,"internally_reserved":0,"allocated":3870720,"data_stored":28700600,"data_compressed":945066,"data_compressed_allocated":2101248,"data_compressed_original":27819414,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55512,"kb_used_data":6264,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94316328,"statfs":{"total":96636764160,"available":96579919872,"internally_reserved":0,"allocated":6414336,"data_stored":43286669,"data_compressed":2047546,"data_compressed_allocated":3948544,"data_compressed_original":42013005,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":0,"seq":55834574876,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42196,"kb_used_data":11004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329644,"statfs":{"total":96636764160,"available":96593555456,"internally_reserved":0,"allocated":11268096,"data_stored":146937043,"data_compressed":3236659,"data_compressed_allocated":8327168,"data_compressed_original":145398689,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42820,"kb_used_data":7476,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94329020,"statfs":{"total":96636764160,"available":96592916480,"internally_reserved":0,"allocated":7655424,"data_stored":107669051,"data_compressed":2028628,"data_compressed_allocated":5554176,"data_compressed_original":106542503,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46216,"kb_used_data":6476,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94325624,"statfs":{"total":96636764160,"available":96589438976,"internally_reserved":0,"allocated":6631424,"data_stored":69000545,"data_compressed":1956795,"data_compressed_allocated":4399104,"data_compressed_original":67908993,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":0,"seq":55834574875,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4644864,"data_stored":67162937,"data_compressed":1534910,"data_compressed_allocated":3944448,"data_compressed_original":66791423,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":5390336,"data_stored":68423711,"data_compressed":1956795,"data_compressed_allocated":4399104,"data_compressed_original":67908993,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6316032,"data_stored":106961665,"data_compressed":1964582,"data_compressed_allocated":5480448,"data_compressed_original":106431911,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10031104,"data_stored":146360228,"data_compressed":3236659,"data_compressed_allocated":8327168,"data_compressed_original":145398689,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10047488,"data_stored":146274828,"data_compressed":3249492,"data_compressed_allocated":8404992,"data_compressed_original":145316545,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5173248,"data_stored":42709835,"data_compressed":2047546,"data_compressed_allocated":3948544,"data_compressed_original":42013005,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2605056,"data_stored":27539696,"data_compressed":938411,"data_compressed_allocated":2064384,"data_compressed_original":27229590,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8679424,"data_stored":119593975,"data_compressed":2581831,"data_compressed_allocated":7151616,"data_compressed_original":118671835,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:07:47.104 INFO:tasks.thrashosds.thrasher:Setting 2.0 to [0, 6] 2024-09-11T07:07:47.104 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '2.0', '0', '6'] 2024-09-11T07:07:47.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 2.0 0 6 2024-09-11T07:07:47.104 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #42, image image_client.0-clone42 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent43 2024-09-11T07:07:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:47.126 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:47.139 INFO:teuthology.orchestra.run.smithi079.stdout:5573 write 0xc7cceb2 thru 0xc7dbc15 (0xed64 bytes) 2024-09-11T07:07:47.140 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:47.136+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:47.141 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:47.168 INFO:teuthology.orchestra.run.smithi079.stdout:5574 punch from 0x7ccc1b0 to 0x7cd721b, (0xb06b bytes) 2024-09-11T07:07:47.168 INFO:teuthology.orchestra.run.smithi079.stdout:5575 clone 45 order 22 su 2097152 sc 15 2024-09-11T07:07:47.175 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:47.176 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:47.192 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:47.192 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:47.209 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:47.210 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:47.219 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:47.216+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:47.226 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:47.226 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:47.253 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:47.253 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:47.269 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:47.270 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:47.274 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.984216200000006, 2024-09-11T07:07:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:07:47.274 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:07:47.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.984144117, 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.279 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:07:47.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.984088623999995, 2024-09-11T07:07:47.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.287 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.782216656000003, 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.288 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:07:47.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.291 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.292 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.782154066000004, 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:07:47.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.782097010000001, 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:07:47.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.301 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.782040893000001, 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:07:47.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781919630999994, 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.306 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.310 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781815362000003, 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:07:47.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781709823, 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.315 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:07:47.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:07:47.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781642660000003, 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:07:47.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:07:47.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781543454000001, 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:07:47.324 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:07:47.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.328 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781456495, 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.329 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:07:47.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781396217999998, 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:47.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:07:47.337 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781242512999995, 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.338 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:07:47.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.342 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781155337000001, 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:07:47.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:07:47.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781091434000004, 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.347 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:07:47.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:07:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:07:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:07:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:07:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.351 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.781031591000001, 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.352 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:07:47.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:07:47.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:47.356 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.780953509, 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:47.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:07:47.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 82.780895739000002, 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:07:47.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:07:47.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.365 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:47.366 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:47.367 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:47.367 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:47.368 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:47.368 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:47.363+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:47.369 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:47.469 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:47.463+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:47.534 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:47.534 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:47.535 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:47.535 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:47.548 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:47.569 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:47.568+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:47.670 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:47.668+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:47.713 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:47.713 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:47.713 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:47.728 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:47.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:47.768+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:47.842 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:07:47.843 INFO:teuthology.orchestra.run.smithi079.stderr:set 2.0 pg_upmap mapping to [0,6] 2024-09-11T07:07:47.858 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:47.858 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.545199738999997, 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.863 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.545118901999999, 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:07:47.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.545075556, 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.872 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.545005431000007, 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:07:47.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:07:47.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.544937306999998, 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:47.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.881 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.544896840999996, 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:07:47.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:07:47.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:47.886 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.5448588, 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.544819829999994, 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:47.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:47.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:07:47.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:07:47.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:07:47.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.896 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.896 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:47.896 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.544778956000002, 2024-09-11T07:07:47.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:07:47.896 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.896 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.896 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.897 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:07:47.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.897 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:47.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:47.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:07:47.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.544451183000007, 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:07:47.901 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.902 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.902 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.902 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:07:47.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.902 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:47.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:47.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:07:47.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:07:47.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:07:47.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:07:47.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:07:47.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.907 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.907 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.907 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:47.908 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.544384672999996, 2024-09-11T07:07:47.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:07:47.908 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.908 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.908 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.909 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:07:47.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.909 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:47.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:07:47.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:07:47.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:07:47.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:07:47.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:07:47.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:07:47.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.914 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.914 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.915 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.915 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:47.915 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.544316953999996, 2024-09-11T07:07:47.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:07:47.915 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.916 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.916 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.916 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.916 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.916 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:07:47.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.917 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:47.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:07:47.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:07:47.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:07:47.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:07:47.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.544272015999994, 2024-09-11T07:07:47.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:07:47.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.543472390999995, 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:07:47.926 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:07:47.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:07:47.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:07:47.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:07:47.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:07:47.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.543438049000002, 2024-09-11T07:07:47.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:07:47.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:07:47.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.935 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 87.543075373999997, 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:07:47.939 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.940 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.940 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.940 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:07:47.940 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:47.940 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.605174422999994, 2024-09-11T07:07:47.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:07:47.940 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:47.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:07:47.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109724 3.1d 3:bd9f0dd6:::rbd_data.1161dd0f3253.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.3352991850000002, 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.063964249000000001, 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.946 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109724 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519447+0000", 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1799999999999999e-06 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523605+0000", 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041584270000000001 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523644+0000", 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8908000000000001e-05 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523661+0000", 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7198999999999999e-05 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523781+0000", 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011950799999999999 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.524055+0000", 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027451199999999998 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.548286+0000", 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.024231249 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583267+0000", 2024-09-11T07:07:47.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.034980245 2024-09-11T07:07:47.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:47.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583326+0000", 2024-09-11T07:07:47.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9815999999999998e-05 2024-09-11T07:07:47.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:47.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583372+0000", 2024-09-11T07:07:47.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6074e-05 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583409+0000", 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6130999999999997e-05 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109733 3.5 3:a2b45ebf:::rbd_data.1161dd0f3253.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:47.952 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.2536984800000006, 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067924668999999993, 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109733 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:47.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601047+0000", 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.029e-06 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601058+0000", 2024-09-11T07:07:47.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0974e-05 2024-09-11T07:07:47.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601083+0000", 2024-09-11T07:07:47.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4757999999999999e-05 2024-09-11T07:07:47.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601099+0000", 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5733e-05 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601212+0000", 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113857 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601453+0000", 2024-09-11T07:07:47.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240657 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.613355+0000", 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01190186 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668765+0000", 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055410261000000002 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:47.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668796+0000", 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0833000000000001e-05 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668891+0000", 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4708000000000002e-05 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668970+0000", 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8998999999999994e-05 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.958 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:111102 3.1d 3:b9ff0ad7:::rbd_object_map.1161dd0f3253:head [read 0~42] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 4.0188679900000004, 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.014308821, 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:47.959 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 111102 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:47.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835877+0000", 2024-09-11T07:07:47.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.564e-06 2024-09-11T07:07:47.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:47.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835883+0000", 2024-09-11T07:07:47.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0909999999999998e-06 2024-09-11T07:07:47.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835900+0000", 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.668e-05 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835907+0000", 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2660000000000004e-06 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835963+0000", 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5933999999999997e-05 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835972+0000", 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1449999999999997e-06 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849359+0000", 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0133867839999999 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849663+0000", 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030396600000000002 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:47.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:47.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:47.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.850184+0000", 2024-09-11T07:07:47.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052139099999999996 2024-09-11T07:07:47.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.964 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.964 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:47.964 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:47.964 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:47.966 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:47.967 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:47.963+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:47.968 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone44 from 0xe136c8d (overlap 0xe136c8d) to 0x709b646 2024-09-11T07:07:48.066 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:48.063+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:48.136 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #43, image image_client.0-clone43 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent44 2024-09-11T07:07:48.138 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:48.138 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:48.138 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:48.152 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:48.197 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:48.195+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:48.269 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:48.263+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:48.321 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:48.321 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:48.321 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:48.335 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:48.370 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:48.367+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:48.460 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:48.460 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 94.134945113000001, 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.461 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:07:48.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:07:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:07:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:07:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:07:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:48.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:07:48.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.832006018000001, 2024-09-11T07:07:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:07:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.468 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:07:48.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831942901999994, 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.473 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:07:48.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.477 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831867908999996, 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.478 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:07:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:07:48.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.482 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831803352999998, 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.483 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:07:48.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:07:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:07:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:07:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:07:48.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:07:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:48.488 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831748124000001, 2024-09-11T07:07:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:07:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:07:48.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.493 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831694227, 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.494 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:07:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831633728, 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.499 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:07:48.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:07:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:07:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:07:48.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831577714999995, 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.504 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:07:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.508 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831498362000005, 2024-09-11T07:07:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:07:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.509 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:07:48.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831442058999997, 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.514 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:07:48.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.518 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831369620000004, 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:07:48.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:07:48.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831313499999993, 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:07:48.523 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:07:48.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:07:48.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831240034000004, 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:07:48.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 93.831161640999994, 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:07:48.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:48.537 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.921985626999998, 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:07:48.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.665400042000002, 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:48.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:07:48.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.895406031, 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:07:48.548 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:07:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:07:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:07:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:07:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:07:48.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 17.887416135999999, 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:07:48.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:07:48.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109791 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 5824422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 9.7283858799999994, 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029141958999999999, 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109791 2024-09-11T07:07:48.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728800+0000", 2024-09-11T07:07:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.064e-06 2024-09-11T07:07:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744261+0000", 2024-09-11T07:07:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015461523 2024-09-11T07:07:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744287+0000", 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5086999999999999e-05 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744298+0000", 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1899000000000001e-05 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744376+0000", 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7465000000000005e-05 2024-09-11T07:07:48.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744514+0000", 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013820400000000001 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.745045+0000", 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053122399999999995 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:48.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.751499+0000", 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064538750000000004 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757772+0000", 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062726509999999997 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757865+0000", 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2802999999999999e-05 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757933+0000", 2024-09-11T07:07:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8164000000000007e-05 2024-09-11T07:07:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.566 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.566 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:48.567 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:48.567 INFO:teuthology.orchestra.run.smithi079.stdout:5578 write 0x109d881 thru 0x10a77dc (0x9f5c bytes) 2024-09-11T07:07:48.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:48.569 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:48.563+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:48.577 INFO:teuthology.orchestra.run.smithi079.stdout:5579 read 0x21d3a11 thru 0x21d4ff1 (0x15e1 bytes) 2024-09-11T07:07:48.577 INFO:teuthology.orchestra.run.smithi079.stdout:5580 punch from 0x7205f2f to 0x7214571, (0xe642 bytes) 2024-09-11T07:07:48.577 INFO:teuthology.orchestra.run.smithi079.stdout:5581 write 0x8d9873c thru 0x8d998e5 (0x11aa bytes) 2024-09-11T07:07:48.586 INFO:teuthology.orchestra.run.smithi079.stdout:5582 write 0xbfa4256 thru 0xbfad98c (0x9737 bytes) 2024-09-11T07:07:48.597 INFO:teuthology.orchestra.run.smithi079.stdout:5583 writesame 0x9177c40 thru 0x917ae0a data_size 0x1(0x31cb bytes) 2024-09-11T07:07:48.622 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:48.622 INFO:teuthology.orchestra.run.smithi079.stdout:5585 write 0x5402349 thru 0x5410def (0xeaa7 bytes) 2024-09-11T07:07:48.652 INFO:teuthology.orchestra.run.smithi079.stdout:5586 trunc from 0xe136c8d to 0x266a987 2024-09-11T07:07:48.668 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:48.663+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:48.749 INFO:teuthology.orchestra.run.smithi079.stdout:5587 write 0x8c4c8ad thru 0x8c4eaee (0x2242 bytes) 2024-09-11T07:07:48.754 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:113509 3.13 3:cef626e0:::rbd_data.1161428332f9.0000000000000028:head [set-alloc-hint object_size 4194304 write_size 4194304,write 313517~8770 in=8770b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:48.752742+0000", 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 0.001408578, 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0014777919999999999, 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "waiting for sub ops", 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 113509 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:48.752742+0000", 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:48.752742+0000", 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:48.752745+0000", 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2869999999999999e-06 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:48.752767+0000", 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2099e-05 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:48.752794+0000", 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7012000000000002e-05 2024-09-11T07:07:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:48.752811+0000", 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7669999999999999e-05 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:48.752917+0000", 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105499 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:48.753065+0000", 2024-09-11T07:07:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014862100000000001 2024-09-11T07:07:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:48.753299+0000", 2024-09-11T07:07:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023355699999999999 2024-09-11T07:07:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: ], 2024-09-11T07:07:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 1 2024-09-11T07:07:48.760 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:48.760 INFO:teuthology.orchestra.run.smithi079.stdout:5588 trunc from 0x8c4eaef to 0x6ab1467 2024-09-11T07:07:48.768 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:48.763+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:48.769 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:48.779 INFO:teuthology.orchestra.run.smithi079.stdout:5589 read 0x435ebc9 thru 0x436874a (0x9b82 bytes) 2024-09-11T07:07:48.793 INFO:teuthology.orchestra.run.smithi079.stdout:5591 writesame 0x821f3f0 thru 0x82283d5 data_size 0x2(0x8fe6 bytes) 2024-09-11T07:07:48.793 INFO:teuthology.orchestra.run.smithi079.stdout:5592 read 0x35f1fec thru 0x35f59d0 (0x39e5 bytes) 2024-09-11T07:07:48.818 INFO:teuthology.orchestra.run.smithi079.stdout:5593 write 0xd8d1e11 thru 0xd8d9dbc (0x7fac bytes) 2024-09-11T07:07:48.825 INFO:teuthology.orchestra.run.smithi079.stdout:5594 punch from 0x8755969 to 0x8761ba6, (0xc23d bytes) 2024-09-11T07:07:48.825 INFO:teuthology.orchestra.run.smithi079.stdout:5595 punch from 0x3ba130 to 0x3c9385, (0xf255 bytes) 2024-09-11T07:07:48.825 INFO:teuthology.orchestra.run.smithi079.stdout:5597 writesame 0x962bc7 thru 0x96d74c data_size 0x5(0xab86 bytes) 2024-09-11T07:07:48.832 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:48.832 INFO:teuthology.orchestra.run.smithi079.stdout:5599 writesame 0x1c3152b thru 0x1c33fa3 data_size 0x1(0x2a79 bytes) 2024-09-11T07:07:48.847 INFO:teuthology.orchestra.run.smithi079.stdout:5600 writesame 0x7dbcfa2 thru 0x7dccf46 data_size 0x5(0xffa5 bytes) 2024-09-11T07:07:48.870 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:48.867+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:48.870 INFO:teuthology.orchestra.run.smithi079.stdout:5601 writesame 0x7ade38 thru 0x7bc79f data_size 0x9a(0xe968 bytes) 2024-09-11T07:07:48.887 INFO:teuthology.orchestra.run.smithi079.stdout:5602 read 0x3988b0f thru 0x398ccae (0x41a0 bytes) 2024-09-11T07:07:48.888 INFO:teuthology.orchestra.run.smithi079.stdout:5603 writesame 0x3da8ab4 thru 0x3dacdc8 data_size 0x1(0x4315 bytes) 2024-09-11T07:07:48.901 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:48.901 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:48.901 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:48.901 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:48.901 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:48.905 INFO:teuthology.orchestra.run.smithi079.stdout:5606 punch from 0xbf8a11 to 0xbfd785, (0x4d74 bytes) 2024-09-11T07:07:48.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:48.918 INFO:teuthology.orchestra.run.smithi079.stdout:5608 trunc from 0xd8d9dbd to 0x95d6506 2024-09-11T07:07:48.957 INFO:teuthology.orchestra.run.smithi079.stdout:5609 writesame 0xae20fe1 thru 0xae2d1a4 data_size 0x2(0xc1c4 bytes) 2024-09-11T07:07:48.957 INFO:teuthology.orchestra.run.smithi079.stdout:5610 write 0x4e95a9e thru 0x4e98005 (0x2568 bytes) 2024-09-11T07:07:48.982 INFO:teuthology.orchestra.run.smithi079.stdout:5611 write 0xe5fe0ef thru 0xe5ffc28 (0x1b3a bytes) 2024-09-11T07:07:49.005 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:49.003+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:49.013 INFO:teuthology.orchestra.run.smithi079.stdout:5612 trunc from 0xe5ffc29 to 0x5ed34a0 2024-09-11T07:07:49.035 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.036 INFO:teuthology.orchestra.run.smithi079.stdout:5614 read 0x304eb01 thru 0x305b939 (0xce39 bytes) 2024-09-11T07:07:49.058 INFO:teuthology.orchestra.run.smithi079.stdout:5615 write 0x9821102 thru 0x9828c25 (0x7b24 bytes) 2024-09-11T07:07:49.071 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:49.067+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:49.088 INFO:teuthology.orchestra.run.smithi079.stdout:5616 write 0xd5035e4 thru 0xd504408 (0xe25 bytes) 2024-09-11T07:07:49.090 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:49.090 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.01883252499999, 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:07:49.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.092 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:07:49.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:07:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:07:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:07:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:07:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:07:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:07:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:07:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:07:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:07:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:07:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.097 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.098 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.59266203, 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.099 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:07:49.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:07:49.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.592605813000006, 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:07:49.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:49.107 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.589558651999994, 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:07:49.111 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.589505552000006, 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.112 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:07:49.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.589406647000004, 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.117 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:07:49.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.589338779000002, 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.121 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.589282245000007, 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:07:49.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:07:49.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:07:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:07:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:07:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:07:49.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:49.130 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.589229785000001, 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:07:49.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:07:49.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.589178157000006, 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.139 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.589126734999994, 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:07:49.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:07:49.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.589075640999994, 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.144 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.148 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.589023681, 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:07:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:07:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:07:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:07:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:07:49.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.153 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.588924168000005, 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.154 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:07:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:07:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:07:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:07:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.588865362999996, 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:07:49.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:49.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:07:49.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:07:49.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.588814209000006, 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.164 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:49.168 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.588757903000001, 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:49.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:07:49.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:07:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.581958388000004, 2024-09-11T07:07:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:07:49.173 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.174 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:07:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:07:49.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.849888363000002, 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:07:49.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 28.532479316, 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:49.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:07:49.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:07:49.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:07:49.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:49.191 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:49.191 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:49.193 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:49.194 INFO:teuthology.orchestra.run.smithi079.stdout:5617 write 0x92898be thru 0x9292867 (0x8faa bytes) 2024-09-11T07:07:49.194 INFO:teuthology.orchestra.run.smithi079.stdout:5619 write 0x2887e6 thru 0x293011 (0xa82c bytes) 2024-09-11T07:07:49.194 INFO:teuthology.orchestra.run.smithi079.stdout:5620 writesame 0x3466228 thru 0x346e1f8 data_size 0xd(0x7fd1 bytes) 2024-09-11T07:07:49.194 INFO:teuthology.orchestra.run.smithi079.stdout:5621 read 0x2ab2f02 thru 0x2ab67c6 (0x38c5 bytes) 2024-09-11T07:07:49.194 INFO:teuthology.orchestra.run.smithi079.stdout:5622 write 0xa22449 thru 0xa2f2cb (0xce83 bytes) 2024-09-11T07:07:49.194 INFO:teuthology.orchestra.run.smithi079.stdout:5623 read 0x18fcfe7 thru 0x190a20a (0xd224 bytes) 2024-09-11T07:07:49.194 INFO:teuthology.orchestra.run.smithi079.stdout:5624 write 0x2c7f580 thru 0x2c8c7b4 (0xd235 bytes) 2024-09-11T07:07:49.194 INFO:teuthology.orchestra.run.smithi079.stdout:5626 punch from 0xc4debcf to 0xc4ec18a, (0xd5bb bytes) 2024-09-11T07:07:49.194 INFO:teuthology.orchestra.run.smithi079.stdout:5627 read 0xb44e001 thru 0xb452f90 (0x4f90 bytes) 2024-09-11T07:07:49.195 INFO:teuthology.orchestra.run.smithi079.stdout:5628 trunc from 0xd504409 to 0x6b37f6d 2024-09-11T07:07:49.195 INFO:teuthology.orchestra.run.smithi079.stdout:5629 punch from 0x3d937 to 0x4d112, (0xf7db bytes) 2024-09-11T07:07:49.195 INFO:teuthology.orchestra.run.smithi079.stdout:5631 trunc from 0x6b37f6d to 0x5e189c7 2024-09-11T07:07:49.195 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:49.187+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:49.213 INFO:teuthology.orchestra.run.smithi079.stdout:5635 trunc from 0x5e189c7 to 0xe9dd94c 2024-09-11T07:07:49.236 INFO:teuthology.orchestra.run.smithi079.stdout:5637 trunc from 0xe9dd94c to 0x846fd64 2024-09-11T07:07:49.249 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.270 INFO:teuthology.orchestra.run.smithi079.stdout:5639 write 0xc61bc23 thru 0xc62720b (0xb5e9 bytes) 2024-09-11T07:07:49.275 INFO:teuthology.orchestra.run.smithi079.stdout:5641 read 0x722d76b thru 0x72362ed (0x8b83 bytes) 2024-09-11T07:07:49.276 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.290 INFO:teuthology.orchestra.run.smithi079.stdout:5645 trunc from 0xc62720c to 0x34a0ff3 2024-09-11T07:07:49.294 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:49.291+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:49.314 INFO:teuthology.orchestra.run.smithi079.stdout:5646 read 0x57c6cd thru 0x5876b7 (0xafeb bytes) 2024-09-11T07:07:49.318 INFO:teuthology.orchestra.run.smithi079.stdout:5647 trunc from 0x34a0ff3 to 0x511c4a0 2024-09-11T07:07:49.330 INFO:teuthology.orchestra.run.smithi079.stdout:5648 punch from 0x1b033cd to 0x1b0e7b9, (0xb3ec bytes) 2024-09-11T07:07:49.330 INFO:teuthology.orchestra.run.smithi079.stdout:5649 punch from 0x27f1e36 to 0x27f5c81, (0x3e4b bytes) 2024-09-11T07:07:49.330 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.330 INFO:teuthology.orchestra.run.smithi079.stdout:5651 write 0x1b3c220 thru 0x1b4252b (0x630c bytes) 2024-09-11T07:07:49.343 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:49.343 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:49.343 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:49.358 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:49.358 INFO:teuthology.orchestra.run.smithi079.stdout:5652 write 0xb3ef575 thru 0xb3f8ad5 (0x9561 bytes) 2024-09-11T07:07:49.365 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.365 INFO:teuthology.orchestra.run.smithi079.stdout:5656 writesame 0x7e3bdbf thru 0x7e3e2a2 data_size 0x6(0x24e4 bytes) 2024-09-11T07:07:49.370 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:49.374 INFO:teuthology.orchestra.run.smithi079.stdout:5657 trunc from 0xb3f8ad6 to 0xbd44b36 2024-09-11T07:07:49.387 INFO:teuthology.orchestra.run.smithi079.stdout:5659 write 0x240e942 thru 0x2417b89 (0x9248 bytes) 2024-09-11T07:07:49.390 INFO:teuthology.orchestra.run.smithi079.stdout:5660 read 0x32edd73 thru 0x32f6024 (0x82b2 bytes) 2024-09-11T07:07:49.391 INFO:teuthology.orchestra.run.smithi079.stdout:5662 read 0x513474 thru 0x52340d (0xff9a bytes) 2024-09-11T07:07:49.392 INFO:teuthology.orchestra.run.smithi079.stdout:5663 write 0x7ba0e02 thru 0x7bad9a6 (0xcba5 bytes) 2024-09-11T07:07:49.394 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:49.391+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:49.399 INFO:teuthology.orchestra.run.smithi079.stdout:5664 punch from 0x809f20c to 0x80ab01e, (0xbe12 bytes) 2024-09-11T07:07:49.399 INFO:teuthology.orchestra.run.smithi079.stdout:5665 writesame 0x4c402d thru 0x4c6e89 data_size 0xd(0x2e5d bytes) 2024-09-11T07:07:49.426 INFO:teuthology.orchestra.run.smithi079.stdout:5667 writesame 0xdfd6e08 thru 0xdfd8e7a data_size 0xd(0x2073 bytes) 2024-09-11T07:07:49.427 INFO:teuthology.orchestra.run.smithi079.stdout:5669 writesame 0x7bcfef3 thru 0x7bd9bce data_size 0x2(0x9cdc bytes) 2024-09-11T07:07:49.442 INFO:teuthology.orchestra.run.smithi079.stdout:5670 writesame 0xa9db7b7 thru 0xa9e55a5 data_size 0x1(0x9def bytes) 2024-09-11T07:07:49.495 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:49.491+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:49.496 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:49.497 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:49.497 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:49.497 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:49.497 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:49.498 INFO:teuthology.orchestra.run.smithi079.stdout:5671 writesame 0x569933 thru 0x5762b4 data_size 0x1(0xc982 bytes) 2024-09-11T07:07:49.516 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:49.522 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:49.522 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:49.527 INFO:teuthology.orchestra.run.smithi079.stdout:5672 punch from 0x45e0ecf to 0x45e2560, (0x1691 bytes) 2024-09-11T07:07:49.527 INFO:teuthology.orchestra.run.smithi079.stdout:5674 read 0x3c2e015 thru 0x3c3171b (0x3707 bytes) 2024-09-11T07:07:49.527 INFO:teuthology.orchestra.run.smithi079.stdout:5677 write 0x9329faa thru 0x9335964 (0xb9bb bytes) 2024-09-11T07:07:49.532 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.533 INFO:teuthology.orchestra.run.smithi079.stdout:5680 write 0x73d7c0e thru 0x73dbc2e (0x4021 bytes) 2024-09-11T07:07:49.538 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.538 INFO:teuthology.orchestra.run.smithi079.stdout:5682 read 0xdeb91a2 thru 0xdebc034 (0x2e93 bytes) 2024-09-11T07:07:49.538 INFO:teuthology.orchestra.run.smithi079.stdout:5683 read 0x9558b9b thru 0x955d59a (0x4a00 bytes) 2024-09-11T07:07:49.544 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:49.544 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:49.551 INFO:teuthology.orchestra.run.smithi079.stdout:5684 trunc from 0xdfd8e7b to 0x67b97cb 2024-09-11T07:07:49.566 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:49.566 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:49.576 INFO:teuthology.orchestra.run.smithi079.stdout:5685 write 0x59c5219 thru 0x59d09ab (0xb793 bytes) 2024-09-11T07:07:49.584 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:49.584 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:49.596 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:49.591+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:49.603 INFO:teuthology.orchestra.run.smithi079.stdout:5686 write 0xc54f016 thru 0xc54f3cd (0x3b8 bytes) 2024-09-11T07:07:49.606 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:49.606 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:49.609 INFO:teuthology.orchestra.run.smithi079.stdout:5688 punch from 0x680d33c to 0x6817355, (0xa019 bytes) 2024-09-11T07:07:49.610 INFO:teuthology.orchestra.run.smithi079.stdout:5689 write 0x4a58160 thru 0x4a5d294 (0x5135 bytes) 2024-09-11T07:07:49.618 INFO:teuthology.orchestra.run.smithi079.stdout:5690 trunc from 0xc54f3ce to 0xcc4b547 2024-09-11T07:07:49.628 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:49.629 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:49.633 INFO:teuthology.orchestra.run.smithi079.stdout:5691 punch from 0x1877ee9 to 0x1880715, (0x882c bytes) 2024-09-11T07:07:49.633 INFO:teuthology.orchestra.run.smithi079.stdout:5693 write 0x872d39f thru 0x87327f0 (0x5452 bytes) 2024-09-11T07:07:49.639 INFO:teuthology.orchestra.run.smithi079.stdout:5695 write 0x511fe32 thru 0x512aaca (0xac99 bytes) 2024-09-11T07:07:49.645 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.645 INFO:teuthology.orchestra.run.smithi079.stdout:5697 write 0xc96d98a thru 0xc9723bb (0x4a32 bytes) 2024-09-11T07:07:49.646 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:49.646 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:49.651 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.651 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:49.652 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:49.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:49.664 INFO:teuthology.orchestra.run.smithi079.stdout:5700 write 0xd9a552e thru 0xd9a7edc (0x29af bytes) 2024-09-11T07:07:49.671 INFO:teuthology.orchestra.run.smithi079.stdout:5704 write 0x2975bce thru 0x297ddc1 (0x81f4 bytes) 2024-09-11T07:07:49.673 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:49.674 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:49.675 INFO:teuthology.orchestra.run.smithi079.stdout:5705 write 0xab361d5 thru 0xab39eea (0x3d16 bytes) 2024-09-11T07:07:49.681 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.693 INFO:teuthology.orchestra.run.smithi079.stdout:5707 write 0xe1a9f60 thru 0xe1b6ac4 (0xcb65 bytes) 2024-09-11T07:07:49.698 INFO:teuthology.orchestra.run.smithi079.stdout:5708 write 0xdc30e1b thru 0xdc3f72c (0xe912 bytes) 2024-09-11T07:07:49.698 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:49.695+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:49.705 INFO:teuthology.orchestra.run.smithi079.stdout:5709 write 0xd032c61 thru 0xd039095 (0x6435 bytes) 2024-09-11T07:07:49.711 INFO:teuthology.orchestra.run.smithi079.stdout:5712 write 0x94c3cb0 thru 0x94c44a9 (0x7fa bytes) 2024-09-11T07:07:49.716 INFO:teuthology.orchestra.run.smithi079.stdout:5713 write 0xb092c8c thru 0xb093596 (0x90b bytes) 2024-09-11T07:07:49.721 INFO:teuthology.orchestra.run.smithi079.stdout:5714 write 0x9b2a2b9 thru 0x9b2f42e (0x5176 bytes) 2024-09-11T07:07:49.727 INFO:teuthology.orchestra.run.smithi079.stdout:5715 write 0x69f0ca5 thru 0x69f1a7c (0xdd8 bytes) 2024-09-11T07:07:49.731 INFO:teuthology.orchestra.run.smithi079.stdout:5719 trunc from 0xe1b6ac5 to 0xdc52431 2024-09-11T07:07:49.747 INFO:teuthology.orchestra.run.smithi079.stdout:5720 write 0xd6c463d thru 0xd6cfe8d (0xb851 bytes) 2024-09-11T07:07:49.751 INFO:teuthology.orchestra.run.smithi079.stdout:5722 read 0xbd005c2 thru 0xbd019ca (0x1409 bytes) 2024-09-11T07:07:49.752 INFO:teuthology.orchestra.run.smithi079.stdout:5723 write 0x486336d thru 0x486908c (0x5d20 bytes) 2024-09-11T07:07:49.756 INFO:teuthology.orchestra.run.smithi079.stdout:5725 punch from 0x9e0b34b to 0x9e1aa1e, (0xf6d3 bytes) 2024-09-11T07:07:49.757 INFO:teuthology.orchestra.run.smithi079.stdout:5726 write 0xc179929 thru 0xc183fce (0xa6a6 bytes) 2024-09-11T07:07:49.763 INFO:teuthology.orchestra.run.smithi079.stdout:5727 punch from 0x2412649 to 0x2421fc7, (0xf97e bytes) 2024-09-11T07:07:49.763 INFO:teuthology.orchestra.run.smithi079.stdout:5730 read 0xd534686 thru 0xd537488 (0x2e03 bytes) 2024-09-11T07:07:49.763 INFO:teuthology.orchestra.run.smithi079.stdout:5731 write 0x97a3485 thru 0x97a965f (0x61db bytes) 2024-09-11T07:07:49.769 INFO:teuthology.orchestra.run.smithi079.stdout:5732 read 0x9c3ed1a thru 0x9c4d85c (0xeb43 bytes) 2024-09-11T07:07:49.769 INFO:teuthology.orchestra.run.smithi079.stdout:5733 write 0x1dd422b thru 0x1dd915e (0x4f34 bytes) 2024-09-11T07:07:49.783 INFO:teuthology.orchestra.run.smithi079.stdout:5734 write 0xe289c6e thru 0xe29851a (0xe8ad bytes) 2024-09-11T07:07:49.785 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:49.785 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:49.787 INFO:teuthology.orchestra.run.smithi079.stdout:5735 read 0xa5f91e thru 0xa649ed (0x50d0 bytes) 2024-09-11T07:07:49.788 INFO:teuthology.orchestra.run.smithi079.stdout:5736 read 0x2b6b609 thru 0x2b7748f (0xbe87 bytes) 2024-09-11T07:07:49.789 INFO:teuthology.orchestra.run.smithi079.stdout:5737 punch from 0xbba849d to 0xbbaee93, (0x69f6 bytes) 2024-09-11T07:07:49.789 INFO:teuthology.orchestra.run.smithi079.stdout:5738 writesame 0xcca7ff0 thru 0xccaf6e5 data_size 0x1(0x76f6 bytes) 2024-09-11T07:07:49.798 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:49.795+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:49.801 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:49.811 INFO:teuthology.orchestra.run.smithi079.stdout:5739 read 0x4e2558b thru 0x4e32e14 (0xd88a bytes) 2024-09-11T07:07:49.811 INFO:teuthology.orchestra.run.smithi079.stdout:5740 read 0x3efb584 thru 0x3f05edc (0xa959 bytes) 2024-09-11T07:07:49.811 INFO:teuthology.orchestra.run.smithi079.stdout:5741 punch from 0x53fde71 to 0x54074c6, (0x9655 bytes) 2024-09-11T07:07:49.811 INFO:teuthology.orchestra.run.smithi079.stdout:5743 writesame 0x409cd26 thru 0x40a2bf0 data_size 0x1(0x5ecb bytes) 2024-09-11T07:07:49.826 INFO:teuthology.orchestra.run.smithi079.stdout:5744 write 0x91b2482 thru 0x91b70a8 (0x4c27 bytes) 2024-09-11T07:07:49.833 INFO:teuthology.orchestra.run.smithi079.stdout:5746 punch from 0x3fde3eb to 0x3fecf88, (0xeb9d bytes) 2024-09-11T07:07:49.833 INFO:teuthology.orchestra.run.smithi079.stdout:5750 read 0x1eb542f thru 0x1eb59ad (0x57f bytes) 2024-09-11T07:07:49.833 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:49.845 INFO:teuthology.orchestra.run.smithi079.stdout:5753 writesame 0xe9cad1b thru 0xe9cfd29 data_size 0x1(0x500f bytes) 2024-09-11T07:07:49.845 INFO:teuthology.orchestra.run.smithi079.stdout:5754 write 0x1cd3ab9 thru 0x1ce1cf6 (0xe23e bytes) 2024-09-11T07:07:49.847 INFO:teuthology.orchestra.run.smithi079.stdout:5756 write 0x176c17e thru 0x177bb78 (0xf9fb bytes) 2024-09-11T07:07:49.851 INFO:teuthology.orchestra.run.smithi079.stdout:5757 write 0x1e600a2 thru 0x1e6dc2b (0xdb8a bytes) 2024-09-11T07:07:49.875 INFO:teuthology.orchestra.run.smithi079.stdout:5758 trunc from 0xe9cfd2a to 0x5c4abd1 2024-09-11T07:07:49.899 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:49.895+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:49.907 INFO:teuthology.orchestra.run.smithi079.stdout:5760 write 0x48c6ea1 thru 0x48c729e (0x3fe bytes) 2024-09-11T07:07:49.909 INFO:teuthology.orchestra.run.smithi079.stdout:5762 writesame 0x1e11444 thru 0x1e1e0d2 data_size 0x1(0xcc8f bytes) 2024-09-11T07:07:49.946 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:49.946 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:49.960 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:49.967 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:07:49.975 INFO:teuthology.orchestra.run.smithi079.stdout:5763 writesame 0x655fbf2 thru 0x6562d69 data_size 0x4(0x3178 bytes) 2024-09-11T07:07:49.976 INFO:teuthology.orchestra.run.smithi079.stdout:5765 clone 46 order 18 su 16384 sc 5 2024-09-11T07:07:50.021 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:50.019+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:50.098 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:50.098 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:50.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:50.095+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:50.114 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:50.202 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:50.199+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:50.281 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:50.281 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:50.293 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:50.341 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:50.339+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:50.403 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:50.399+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:50.408 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:50.408 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:50.422 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:50.504 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:50.499+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:50.586 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:50.599 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:50.649 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:50.647+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:50.706 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:50.703+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:50.723 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:50.723 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:50.737 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:50.829 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:50.827+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:50.864 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:07:50.915 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:50.915 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:50.915 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:50.911+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:50.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:51.002 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone45 from 0x6562d6a (overlap 0x266a987) to 0x7aeeb4 2024-09-11T07:07:51.009 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:51.003+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:51.104 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:51.104 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:51.110 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:51.107+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:51.120 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:51.211 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:51.207+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:51.212 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #44, image image_client.0-clone44 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent45 2024-09-11T07:07:51.252 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:51.252 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:51.266 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:51.311 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:51.307+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:51.412 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:51.407+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:51.431 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:51.432 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:51.445 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:51.457 INFO:teuthology.orchestra.run.smithi079.stdout:5767 writesame 0x8f94aab thru 0x8f982e2 data_size 0x1c(0x3838 bytes) 2024-09-11T07:07:51.458 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:51.458 INFO:teuthology.orchestra.run.smithi079.stdout:5770 read 0x3fca30d thru 0x3fd5f84 (0xbc78 bytes) 2024-09-11T07:07:51.458 INFO:teuthology.orchestra.run.smithi079.stdout:5772 read 0x1a2372f thru 0x1a278b7 (0x4189 bytes) 2024-09-11T07:07:51.458 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:51.473 INFO:teuthology.orchestra.run.smithi079.stdout:5774 write 0xc959bc3 thru 0xc968b39 (0xef77 bytes) 2024-09-11T07:07:51.507 INFO:teuthology.orchestra.run.smithi079.stdout:5775 trunc from 0xc968b3a to 0x5189f 2024-09-11T07:07:51.513 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:51.511+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:51.548 INFO:teuthology.orchestra.run.smithi079.stdout:5776 read 0x257df thru 0x2e3a8 (0x8bca bytes) 2024-09-11T07:07:51.564 INFO:teuthology.orchestra.run.smithi079.stdout:5779 write 0x21d314c thru 0x21df378 (0xc22d bytes) 2024-09-11T07:07:51.588 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:51.588 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:51.595 INFO:teuthology.orchestra.run.smithi079.stdout:5780 writesame 0x4c16bb5 thru 0x4c181c6 data_size 0xa(0x1612 bytes) 2024-09-11T07:07:51.595 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:51.595 INFO:teuthology.orchestra.run.smithi079.stdout:5782 read 0x486bd2a thru 0x48705a8 (0x487f bytes) 2024-09-11T07:07:51.595 INFO:teuthology.orchestra.run.smithi079.stdout:5784 read 0x3136cd4 thru 0x3139085 (0x23b2 bytes) 2024-09-11T07:07:51.595 INFO:teuthology.orchestra.run.smithi079.stdout:5788 read 0x6b5ca1 thru 0x6ba872 (0x4bd2 bytes) 2024-09-11T07:07:51.602 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:51.615 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:51.611+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:51.618 INFO:teuthology.orchestra.run.smithi079.stdout:5789 writesame 0x83b4583 thru 0x83b5ce2 data_size 0x2c(0x1760 bytes) 2024-09-11T07:07:51.618 INFO:teuthology.orchestra.run.smithi079.stdout:5791 writesame 0x8320a73 thru 0x83256c5 data_size 0x27(0x4c53 bytes) 2024-09-11T07:07:51.634 INFO:teuthology.orchestra.run.smithi079.stdout:5793 trunc from 0x83b5ce3 to 0x54f1629 2024-09-11T07:07:51.671 INFO:teuthology.orchestra.run.smithi079.stdout:5794 trunc from 0x54f1629 to 0x8d1b19 2024-09-11T07:07:51.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:51.717 INFO:teuthology.orchestra.run.smithi079.stdout:5795 write 0x79ac042 thru 0x79add48 (0x1d07 bytes) 2024-09-11T07:07:51.718 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:51.715+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:51.722 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:51.740 INFO:teuthology.orchestra.run.smithi079.stdout:5798 writesame 0xbfb1533 thru 0xbfb86f5 data_size 0x1(0x71c3 bytes) 2024-09-11T07:07:51.748 INFO:teuthology.orchestra.run.smithi079.stdout:5801 trunc from 0xbfb86f6 to 0x8f20da1 2024-09-11T07:07:51.758 INFO:teuthology.orchestra.run.smithi079.stdout:5802 read 0x28f29b6 thru 0x28feab5 (0xc100 bytes) 2024-09-11T07:07:51.758 INFO:teuthology.orchestra.run.smithi079.stdout:5803 punch from 0x24df212 to 0x24dfd4e, (0xb3c bytes) 2024-09-11T07:07:51.758 INFO:teuthology.orchestra.run.smithi079.stdout:5808 read 0x613e349 thru 0x614a931 (0xc5e9 bytes) 2024-09-11T07:07:51.758 INFO:teuthology.orchestra.run.smithi079.stdout:5809 read 0x28a54c3 thru 0x28a9dfd (0x493b bytes) 2024-09-11T07:07:51.758 INFO:teuthology.orchestra.run.smithi079.stdout:5810 clone 47 order 22 su 131072 sc 12 2024-09-11T07:07:51.769 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:51.769 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:51.783 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:51.829 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:51.827+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:51.844 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:51.844 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:51.861 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:51.861 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:51.877 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:51.878 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:51.896 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:51.896 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:51.911 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:51.911 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:51.918 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:51.919 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:51.919 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:51.915+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:51.928 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:51.939 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:51.939 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:51.958 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:51.959 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:51.974 INFO:teuthology.orchestra.run.smithi079.stdout:truncating image image_client.0-clone46 from 0x8f20da1 (overlap 0x5189f) to 0x18762 2024-09-11T07:07:51.980 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:51.981 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:52.045 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:52.043+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:52.097 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #45, image image_client.0-clone45 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent46 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.787245443000003, 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.099 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.100 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.787164606000005, 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.104 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:07:52.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:07:52.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.787121260000006, 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:52.112 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.787051134999999, 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.786983011000004, 2024-09-11T07:07:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:07:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.117 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:07:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:07:52.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.124 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.786942545000002, 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.125 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.129 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.786904504000006, 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:07:52.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.786865534, 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:07:52.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.138 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.786824659999994, 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:52.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.786496886999998, 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:07:52.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.786430377000002, 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.147 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:07:52.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.151 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.786362658000002, 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.78631772, 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:07:52.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:07:52.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.785518095, 2024-09-11T07:07:52.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:07:52.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.785483752999994, 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.165 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:07:52.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 91.785121078000003, 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:07:52.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:07:52.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.847220127, 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.179 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109724 3.1d 3:bd9f0dd6:::rbd_data.1161dd0f3253.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.577344889000001, 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.063964249000000001, 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109724 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519447+0000", 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1799999999999999e-06 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523605+0000", 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041584270000000001 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523644+0000", 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8908000000000001e-05 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523661+0000", 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7198999999999999e-05 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523781+0000", 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011950799999999999 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.524055+0000", 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027451199999999998 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.548286+0000", 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.024231249 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583267+0000", 2024-09-11T07:07:52.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.034980245 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583326+0000", 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9815999999999998e-05 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583372+0000", 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6074e-05 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583409+0000", 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6130999999999997e-05 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109733 3.5 3:a2b45ebf:::rbd_data.1161dd0f3253.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.495744183999999, 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067924668999999993, 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109733 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601047+0000", 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.029e-06 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601058+0000", 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0974e-05 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601083+0000", 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4757999999999999e-05 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601099+0000", 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5733e-05 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601212+0000", 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113857 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601453+0000", 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240657 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.613355+0000", 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01190186 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668765+0000", 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055410261000000002 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668796+0000", 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0833000000000001e-05 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668891+0000", 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4708000000000002e-05 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668970+0000", 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8998999999999994e-05 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:111102 3.1d 3:b9ff0ad7:::rbd_object_map.1161dd0f3253:head [read 0~42] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T07:07:52.190 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 8.2609136939999992, 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.014308821, 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 111102 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835877+0000", 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.564e-06 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835883+0000", 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0909999999999998e-06 2024-09-11T07:07:52.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835900+0000", 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.668e-05 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835907+0000", 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2660000000000004e-06 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835963+0000", 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5933999999999997e-05 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835972+0000", 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1449999999999997e-06 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849359+0000", 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0133867839999999 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849663+0000", 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030396600000000002 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.850184+0000", 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052139099999999996 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.196 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.196 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:52.197 INFO:teuthology.orchestra.run.smithi079.stdout:5811 write 0xb2e8d13 thru 0xb2f3b33 (0xae21 bytes) 2024-09-11T07:07:52.198 INFO:teuthology.orchestra.run.smithi079.stdout:5813 write 0x7282f59 thru 0x72924af (0xf557 bytes) 2024-09-11T07:07:52.198 INFO:teuthology.orchestra.run.smithi079.stdout:5814 read 0x977c6ae thru 0x977d331 (0xc84 bytes) 2024-09-11T07:07:52.198 INFO:teuthology.orchestra.run.smithi079.stdout:5815 write 0x61d2e81 thru 0x61d31a1 (0x321 bytes) 2024-09-11T07:07:52.198 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:52.198 INFO:teuthology.orchestra.run.smithi079.stdout:5817 trunc from 0xb2f3b34 to 0x92ba804 2024-09-11T07:07:52.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:52.199 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:52.195+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:52.229 INFO:teuthology.orchestra.run.smithi079.stdout:5818 write 0xd446b92 thru 0xd450fd7 (0xa446 bytes) 2024-09-11T07:07:52.255 INFO:teuthology.orchestra.run.smithi079.stdout:5819 trunc from 0xd450fd8 to 0x6b34ed0 2024-09-11T07:07:52.298 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:52.295+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:52.332 INFO:teuthology.orchestra.run.smithi079.stdout:5821 write 0xe7864ee thru 0xe790ff0 (0xab03 bytes) 2024-09-11T07:07:52.340 INFO:teuthology.orchestra.run.smithi079.stdout:5823 writesame 0x7d22a33 thru 0x7d28f41 data_size 0x1(0x650f bytes) 2024-09-11T07:07:52.379 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:52.379 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:52.380 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:52.386 INFO:teuthology.orchestra.run.smithi079.stdout:5824 write 0xe88b9f6 thru 0xe895706 (0x9d11 bytes) 2024-09-11T07:07:52.394 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:52.396 INFO:teuthology.orchestra.run.smithi079.stdout:5825 read 0x3b1f997 thru 0x3b1ffaf (0x619 bytes) 2024-09-11T07:07:52.396 INFO:teuthology.orchestra.run.smithi079.stdout:5826 writesame 0x41384d thru 0x41e27f data_size 0x11(0xaa33 bytes) 2024-09-11T07:07:52.399 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:52.395+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:52.408 INFO:teuthology.orchestra.run.smithi079.stdout:5830 writesame 0x1b698b thru 0x1c5db7 data_size 0x1(0xf42d bytes) 2024-09-11T07:07:52.461 INFO:teuthology.orchestra.run.smithi079.stdout:5831 write 0xd633422 thru 0xd63bb82 (0x8761 bytes) 2024-09-11T07:07:52.469 INFO:teuthology.orchestra.run.smithi079.stdout:5832 write 0x1b93bae thru 0x1b97397 (0x37ea bytes) 2024-09-11T07:07:52.478 INFO:teuthology.orchestra.run.smithi079.stdout:5834 read 0x73712d2 thru 0x737237d (0x10ac bytes) 2024-09-11T07:07:52.479 INFO:teuthology.orchestra.run.smithi079.stdout:5836 write 0xb916fa7 thru 0xb9198c0 (0x291a bytes) 2024-09-11T07:07:52.486 INFO:teuthology.orchestra.run.smithi079.stdout:5837 read 0x22477cb thru 0x22487cc (0x1002 bytes) 2024-09-11T07:07:52.500 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:52.495+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:52.504 INFO:teuthology.orchestra.run.smithi079.stdout:5838 trunc from 0xe895707 to 0x7e2a0d1 2024-09-11T07:07:52.537 INFO:teuthology.orchestra.run.smithi079.stdout:5839 writesame 0x308bc3a thru 0x3099916 data_size 0x2f(0xdcdd bytes) 2024-09-11T07:07:52.545 INFO:teuthology.orchestra.run.smithi079.stdout:5840 write 0x1db4ec0 thru 0x1db947a (0x45bb bytes) 2024-09-11T07:07:52.553 INFO:teuthology.orchestra.run.smithi079.stdout:5842 read 0xa1fb67 thru 0xa2d8f8 (0xdd92 bytes) 2024-09-11T07:07:52.555 INFO:teuthology.orchestra.run.smithi079.stdout:5844 trunc from 0x7e2a0d1 to 0x7838e06 2024-09-11T07:07:52.567 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:52.568 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:52.568 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:52.568 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:52.568 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:52.578 INFO:teuthology.orchestra.run.smithi079.stdout:5846 read 0x2ac12ab thru 0x2ac3676 (0x23cc bytes) 2024-09-11T07:07:52.583 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:52.586 INFO:teuthology.orchestra.run.smithi079.stdout:5848 trunc from 0x7838e06 to 0xa751460 2024-09-11T07:07:52.623 INFO:teuthology.orchestra.run.smithi079.stdout:5849 write 0xd670774 thru 0xd67d8bb (0xd148 bytes) 2024-09-11T07:07:52.629 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:52.627+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:52.630 INFO:teuthology.orchestra.run.smithi079.stdout:5850 writesame 0xccfeb97 thru 0xcd0a0d1 data_size 0x9(0xb53b bytes) 2024-09-11T07:07:52.642 INFO:teuthology.orchestra.run.smithi079.stdout:5853 write 0x176a86e thru 0x1772374 (0x7b07 bytes) 2024-09-11T07:07:52.651 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:52.651 INFO:teuthology.orchestra.run.smithi079.stdout:5855 write 0x9cb8267 thru 0x9cbbf0b (0x3ca5 bytes) 2024-09-11T07:07:52.675 INFO:teuthology.orchestra.run.smithi079.stdout:5856 write 0xe41339b thru 0xe41b280 (0x7ee6 bytes) 2024-09-11T07:07:52.682 INFO:teuthology.orchestra.run.smithi079.stdout:5858 write 0xcb894c1 thru 0xcb97028 (0xdb68 bytes) 2024-09-11T07:07:52.699 INFO:teuthology.orchestra.run.smithi079.stdout:5862 trunc from 0xe41b281 to 0xa06c487 2024-09-11T07:07:52.702 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:52.699+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:52.714 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:52.714 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:52.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:52.714 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:52.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.714 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.388182233999999, 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:07:52.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:07:52.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:07:52.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.085243138999999, 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:07:52.720 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.085180023000007, 2024-09-11T07:07:52.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:52.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:07:52.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:07:52.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.728 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.729 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:52.729 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.085105029999994, 2024-09-11T07:07:52.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:07:52.729 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.733 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.733 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.733 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.733 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:07:52.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.733 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:07:52.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.085040473999996, 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:07:52.737 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:07:52.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.084985244999999, 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:07:52.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.084931347999998, 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.746 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:52.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:07:52.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:07:52.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.084870848999998, 2024-09-11T07:07:52.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:07:52.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:07:52.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.084814836000007, 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.758 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.084735483000003, 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.759 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:07:52.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:07:52.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:07:52.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.084679179999995, 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.767 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.084606741000002, 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.084550621000005, 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.772 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.776 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.084477155000002, 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:07:52.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:52.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 98.084398762000006, 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:07:52.785 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 74.175222747999996, 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:07:52.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:07:52.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.789 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.790 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.918637163, 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:07:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:07:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:07:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:07:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:07:52.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:52.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.796 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.148643151999998, 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.797 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:07:52.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:07:52.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.801 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.802 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 22.140653257, 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.803 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:07:52.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.806 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109791 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 5824422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:52.807 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 13.981623000999999, 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029141958999999999, 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109791 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:52.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728800+0000", 2024-09-11T07:07:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.064e-06 2024-09-11T07:07:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744261+0000", 2024-09-11T07:07:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015461523 2024-09-11T07:07:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744287+0000", 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5086999999999999e-05 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744298+0000", 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1899000000000001e-05 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744376+0000", 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7465000000000005e-05 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744514+0000", 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013820400000000001 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.745045+0000", 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053122399999999995 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.751499+0000", 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064538750000000004 2024-09-11T07:07:52.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757772+0000", 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062726509999999997 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757865+0000", 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2802999999999999e-05 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757933+0000", 2024-09-11T07:07:52.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8164000000000007e-05 2024-09-11T07:07:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:52.814 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:52.814 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:52.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:52.816 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:52.811+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:52.817 INFO:teuthology.orchestra.run.smithi079.stdout:5865 read 0x8e446cb thru 0x8e4931f (0x4c55 bytes) 2024-09-11T07:07:52.817 INFO:teuthology.orchestra.run.smithi079.stdout:5866 read 0x2694170 thru 0x26a2a9e (0xe92f bytes) 2024-09-11T07:07:52.817 INFO:teuthology.orchestra.run.smithi079.stdout:5867 punch from 0x76ca9ea to 0x76d491d, (0x9f33 bytes) 2024-09-11T07:07:52.817 INFO:teuthology.orchestra.run.smithi079.stdout:5868 read 0x66035b5 thru 0x6607503 (0x3f4f bytes) 2024-09-11T07:07:52.817 INFO:teuthology.orchestra.run.smithi079.stdout:5869 write 0x2234422 thru 0x223bf41 (0x7b20 bytes) 2024-09-11T07:07:52.817 INFO:teuthology.orchestra.run.smithi079.stdout:5870 write 0x3e562a5 thru 0x3e585c5 (0x2321 bytes) 2024-09-11T07:07:52.818 INFO:teuthology.orchestra.run.smithi079.stdout:5872 write 0xbd73159 thru 0xbd74beb (0x1a93 bytes) 2024-09-11T07:07:52.818 INFO:teuthology.orchestra.run.smithi079.stdout:5875 read 0x8c179f1 thru 0x8c1f0b2 (0x76c2 bytes) 2024-09-11T07:07:52.818 INFO:teuthology.orchestra.run.smithi079.stdout:5876 punch from 0xf3f08 to 0xf7d97, (0x3e8f bytes) 2024-09-11T07:07:52.818 INFO:teuthology.orchestra.run.smithi079.stdout:5877 write 0x85ad64e thru 0x85b3cce (0x6681 bytes) 2024-09-11T07:07:52.818 INFO:teuthology.orchestra.run.smithi079.stdout:5878 write 0x4ab0977 thru 0x4ab5926 (0x4fb0 bytes) 2024-09-11T07:07:52.818 INFO:teuthology.orchestra.run.smithi079.stdout:5879 writesame 0x64ed7f4 thru 0x64fcd54 data_size 0x1(0xf561 bytes) 2024-09-11T07:07:52.835 INFO:teuthology.orchestra.run.smithi079.stdout:5881 write 0xa08964 thru 0xa0fd64 (0x7401 bytes) 2024-09-11T07:07:52.839 INFO:teuthology.orchestra.run.smithi079.stdout:5882 write 0xa83a763 thru 0xa849989 (0xf227 bytes) 2024-09-11T07:07:52.848 INFO:teuthology.orchestra.run.smithi079.stdout:5885 writesame 0xb7a0119 thru 0xb7a4c3a data_size 0x3b(0x4b22 bytes) 2024-09-11T07:07:52.852 INFO:teuthology.orchestra.run.smithi079.stdout:5887 punch from 0x2f24cd3 to 0x2f2cf65, (0x8292 bytes) 2024-09-11T07:07:52.852 INFO:teuthology.orchestra.run.smithi079.stdout:5888 punch from 0x618db26 to 0x6190d1b, (0x31f5 bytes) 2024-09-11T07:07:52.853 INFO:teuthology.orchestra.run.smithi079.stdout:5889 writesame 0xa24670e thru 0xa2532ce data_size 0x1(0xcbc1 bytes) 2024-09-11T07:07:52.895 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:07:52.907 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:52.907 INFO:teuthology.orchestra.run.smithi079.stdout:5893 write 0x9f7b7db thru 0x9f7fd57 (0x457d bytes) 2024-09-11T07:07:52.915 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:52.911+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:52.921 INFO:teuthology.orchestra.run.smithi079.stdout:5894 trunc from 0xbd74bec to 0x7e5e648 2024-09-11T07:07:52.943 INFO:teuthology.orchestra.run.smithi079.stdout:5895 write 0x8707e0 thru 0x87a023 (0x9844 bytes) 2024-09-11T07:07:52.947 INFO:teuthology.orchestra.run.smithi079.stdout:5897 read 0x68ec3b4 thru 0x68ef870 (0x34bd bytes) 2024-09-11T07:07:52.949 INFO:teuthology.orchestra.run.smithi079.stdout:5898 trunc from 0x7e5e648 to 0x8d9255b 2024-09-11T07:07:52.958 INFO:teuthology.orchestra.run.smithi079.stdout:5900 writesame 0x837d2e9 thru 0x837ed8b data_size 0x1(0x1aa3 bytes) 2024-09-11T07:07:52.963 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:52.963 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:52.963 INFO:teuthology.orchestra.run.smithi079.stdout:5906 read 0x1f34d28 thru 0x1f3df99 (0x9272 bytes) 2024-09-11T07:07:52.963 INFO:teuthology.orchestra.run.smithi079.stdout:5910 trunc from 0x8d9255b to 0x8a9721c 2024-09-11T07:07:52.968 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7] out_osds: [0, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:07:52.968 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:07:52.968 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T07:07:52.968 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T07:07:52.979 INFO:teuthology.orchestra.run.smithi079.stdout:5911 write 0x57bfb85 thru 0x57c52a0 (0x571c bytes) 2024-09-11T07:07:52.985 INFO:teuthology.orchestra.run.smithi079.stdout:5912 read 0x5b4034e thru 0x5b46322 (0x5fd5 bytes) 2024-09-11T07:07:52.985 INFO:teuthology.orchestra.run.smithi079.stdout:5914 read 0x136b628 thru 0x136bf48 (0x921 bytes) 2024-09-11T07:07:52.985 INFO:teuthology.orchestra.run.smithi079.stdout:5915 punch from 0x84c00c7 to 0x84cd6a4, (0xd5dd bytes) 2024-09-11T07:07:52.985 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:52.992 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:52.992 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:52.992 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:52.992 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:52.994 INFO:teuthology.orchestra.run.smithi079.stdout:5917 writesame 0x91dfbef thru 0x91e1692 data_size 0x2c(0x1aa4 bytes) 2024-09-11T07:07:52.994 INFO:teuthology.orchestra.run.smithi079.stdout:5918 punch from 0x7375a26 to 0x737ee89, (0x9463 bytes) 2024-09-11T07:07:52.994 INFO:teuthology.orchestra.run.smithi079.stdout:5919 write 0x21839c6 thru 0x218b72b (0x7d66 bytes) 2024-09-11T07:07:52.997 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:52.997 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:52.997 INFO:teuthology.orchestra.run.smithi079.stdout:5922 write 0x6b20d9a thru 0x6b26028 (0x528f bytes) 2024-09-11T07:07:53.007 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:53.013 INFO:teuthology.orchestra.run.smithi079.stdout:5923 write 0xc57c090 thru 0xc588e4e (0xcdbf bytes) 2024-09-11T07:07:53.021 INFO:teuthology.orchestra.run.smithi079.stdout:5924 read 0x8f1f130 thru 0x8f2240e (0x32df bytes) 2024-09-11T07:07:53.021 INFO:teuthology.orchestra.run.smithi079.stdout:5926 write 0x8826154 thru 0x882c3bf (0x626c bytes) 2024-09-11T07:07:53.023 INFO:teuthology.orchestra.run.smithi079.stdout:5927 read 0x4c99895 thru 0x4ca6c98 (0xd404 bytes) 2024-09-11T07:07:53.024 INFO:teuthology.orchestra.run.smithi079.stdout:5928 writesame 0xa9f006b thru 0xa9f7564 data_size 0x2e(0x74fa bytes) 2024-09-11T07:07:53.028 INFO:teuthology.orchestra.run.smithi079.stdout:5929 writesame 0x2a13410 thru 0x2a1ce02 data_size 0x57(0x99f3 bytes) 2024-09-11T07:07:53.035 INFO:teuthology.orchestra.run.smithi079.stdout:5930 write 0xc15c6e7 thru 0xc16842c (0xbd46 bytes) 2024-09-11T07:07:53.039 INFO:teuthology.orchestra.run.smithi079.stdout:5931 write 0x8d79f7c thru 0x8d80673 (0x66f8 bytes) 2024-09-11T07:07:53.049 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:53.047+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:53.060 INFO:teuthology.orchestra.run.smithi079.stdout:5932 trunc from 0xc588e4f to 0x32eba4 2024-09-11T07:07:53.114 INFO:teuthology.orchestra.run.smithi079.stdout:5933 writesame 0x8d334f5 thru 0x8d3bdb2 data_size 0x2(0x88be bytes) 2024-09-11T07:07:53.114 INFO:teuthology.orchestra.run.smithi079.stdout:5934 punch from 0x36ec25f to 0x36ec268, (0x9 bytes) 2024-09-11T07:07:53.114 INFO:teuthology.orchestra.run.smithi079.stdout:5936 writesame 0x687ab35 thru 0x6885bf8 data_size 0x36(0xb0c4 bytes) 2024-09-11T07:07:53.117 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:53.115+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:53.119 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:53.129 INFO:teuthology.orchestra.run.smithi079.stdout:5938 trunc from 0x8d3bdb3 to 0x1d58669 2024-09-11T07:07:53.171 INFO:teuthology.orchestra.run.smithi079.stdout:5939 write 0x9e76921 thru 0x9e84c74 (0xe354 bytes) 2024-09-11T07:07:53.178 INFO:teuthology.orchestra.run.smithi079.stdout:5940 punch from 0x93dc376 to 0x93dd16b, (0xdf5 bytes) 2024-09-11T07:07:53.178 INFO:teuthology.orchestra.run.smithi079.stdout:5941 read 0x7f48d62 thru 0x7f5135e (0x85fd bytes) 2024-09-11T07:07:53.179 INFO:teuthology.orchestra.run.smithi079.stdout:5942 write 0x288be34 thru 0x2895d25 (0x9ef2 bytes) 2024-09-11T07:07:53.186 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:53.186 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:53.186 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:53.190 INFO:teuthology.orchestra.run.smithi079.stdout:5943 write 0xc8d2989 thru 0xc8d9e9b (0x7513 bytes) 2024-09-11T07:07:53.195 INFO:teuthology.orchestra.run.smithi079.stdout:5945 punch from 0x47f8665 to 0x4800e24, (0x87bf bytes) 2024-09-11T07:07:53.195 INFO:teuthology.orchestra.run.smithi079.stdout:5947 write 0xaff2149 thru 0xaffa3ba (0x8272 bytes) 2024-09-11T07:07:53.199 INFO:teuthology.orchestra.run.smithi079.stdout:5948 write 0x902ba72 thru 0x90363ba (0xa949 bytes) 2024-09-11T07:07:53.203 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:53.203 INFO:teuthology.orchestra.run.smithi079.stdout:5949 read 0x6e9d370 thru 0x6ea1c5a (0x48eb bytes) 2024-09-11T07:07:53.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:53.215+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:53.222 INFO:teuthology.orchestra.run.smithi079.stdout:5951 trunc from 0xc8d9e9c to 0x9108da 2024-09-11T07:07:53.252 INFO:teuthology.orchestra.run.smithi079.stdout:5953 trunc from 0x9108da to 0x8bdd413 2024-09-11T07:07:53.259 INFO:teuthology.orchestra.run.smithi079.stdout:5954 punch from 0x32f0b07 to 0x32fe721, (0xdc1a bytes) 2024-09-11T07:07:53.260 INFO:teuthology.orchestra.run.smithi079.stdout:5956 read 0x23bfd90 thru 0x23cb7d0 (0xba41 bytes) 2024-09-11T07:07:53.260 INFO:teuthology.orchestra.run.smithi079.stdout:5957 read 0x71c14b8 thru 0x71ce016 (0xcb5f bytes) 2024-09-11T07:07:53.260 INFO:teuthology.orchestra.run.smithi079.stdout:5958 write 0x5474695 thru 0x5482a31 (0xe39d bytes) 2024-09-11T07:07:53.269 INFO:teuthology.orchestra.run.smithi079.stdout:5960 trunc from 0x8bdd413 to 0x6488c60 2024-09-11T07:07:53.285 INFO:teuthology.orchestra.run.smithi079.stdout:5961 write 0x82d3259 thru 0x82d9822 (0x65ca bytes) 2024-09-11T07:07:53.290 INFO:teuthology.orchestra.run.smithi079.stdout:5962 read 0x2bf62e0 thru 0x2c046d1 (0xe3f2 bytes) 2024-09-11T07:07:53.305 INFO:teuthology.orchestra.run.smithi079.stdout:5964 writesame 0xcac0ec8 thru 0xcac9553 data_size 0x4(0x868c bytes) 2024-09-11T07:07:53.305 INFO:teuthology.orchestra.run.smithi079.stdout:5965 punch from 0x772999 to 0x7766c0, (0x3d27 bytes) 2024-09-11T07:07:53.305 INFO:teuthology.orchestra.run.smithi079.stdout:5967 punch from 0x165de01 to 0x1667369, (0x9568 bytes) 2024-09-11T07:07:53.305 INFO:teuthology.orchestra.run.smithi079.stdout:5968 read 0x7fbccb4 thru 0x7fc7387 (0xa6d4 bytes) 2024-09-11T07:07:53.306 INFO:teuthology.orchestra.run.smithi079.stdout:5969 write 0x691f042 thru 0x692d7ce (0xe78d bytes) 2024-09-11T07:07:53.312 INFO:teuthology.orchestra.run.smithi079.stdout:5970 write 0x3d989b2 thru 0x3da25ff (0x9c4e bytes) 2024-09-11T07:07:53.318 INFO:teuthology.orchestra.run.smithi079.stdout:5974 write 0x7d6cb00 thru 0x7d75703 (0x8c04 bytes) 2024-09-11T07:07:53.318 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:53.315+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:53.325 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:07:53.325 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:53.325 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 113, 2024-09-11T07:07:53.325 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "e1313abd-54a9-4e53-ab67-469f744048b1", 2024-09-11T07:07:53.325 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-11T07:05:29.098467+0000", 2024-09-11T07:07:53.325 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-11T07:07:51.873481+0000", 2024-09-11T07:07:53.325 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-11T07:05:41.051856+0000", 2024-09-11T07:07:53.325 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-11T07:07:41.257150+0000", 2024-09-11T07:07:53.325 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5804032, 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "nodeep-scrub", 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-11T07:07:53.326 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "luminous", 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "squid", 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:41.897005+0000", 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:07:53.327 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:07:53.328 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-11T07:07:53.329 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:07:53.330 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:07:53.331 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 6.9000000953674316, 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 6.9000000953674316, 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.28999999165534973, 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:07:53.332 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:47.687214+0000", 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:07:53.333 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:07:53.334 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:07:53.334 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:07:53.334 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:07:53.334 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:07:53.334 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:07:53.334 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-11T07:07:53.334 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-11T07:07:53.334 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-11T07:07:53.334 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-11T07:07:53.334 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "20", 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:07:53.335 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 2, 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 20, 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:07:53.336 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:07:53.337 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.7400000095367432, 2024-09-11T07:07:53.338 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.7400000095367432, 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.86000001430511475, 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.5, 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.5, 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:57.298060+0000", 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:07:53.339 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-11T07:07:53.340 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "113", 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:07:53.341 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 49, 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 113, 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:07:53.342 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:07:53.343 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.9700000286102295, 2024-09-11T07:07:53.344 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.9700000286102295, 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.86000001430511475, 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.690000057220459, 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.690000057220459, 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:07:53.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "24d57cdb-2f3a-4a96-903d-11be7dc26a20", 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 0, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 72, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:53.346 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:53.347 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:53.348 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.349 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/1708235775", 2024-09-11T07:07:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/1708235775", 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/1708235775", 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/1708235775", 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "aa51dc1b-b783-4212-8736-1f666239613b", 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:53.351 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 108, 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:53.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-11T07:07:53.353 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.354 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.355 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/2076268206", 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/2076268206", 2024-09-11T07:07:53.356 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/2076268206", 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/2076268206", 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "141a913f-7353-44a9-9dbd-70219bcee638", 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:53.357 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 107, 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.361 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/1904492349", 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/1904492349", 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/1904492349", 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/1904492349", 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.362 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "32550aeb-0c8d-4ca9-afd5-3e5258e7255b", 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 108, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.363 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.364 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.366 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/1327328912", 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/1327328912", 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/1327328912", 2024-09-11T07:07:53.367 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/1327328912", 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc", 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 0, 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0, 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 0, 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:53.368 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6808", 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6809", 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:53.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6810", 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6811", 2024-09-11T07:07:53.370 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6814", 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6815", 2024-09-11T07:07:53.371 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6812", 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6813", 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:07:53.372 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6809/4087452871", 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6811/4087452871", 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6815/4087452871", 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6813/4087452871", 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.373 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "42c83053-328e-4c9b-bdaf-09e1a4cc8b7d", 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 108, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6824", 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6825", 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6826", 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6827", 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.376 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6830", 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6831", 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.377 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6828", 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6829", 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6825/2133006853", 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6827/2133006853", 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6831/2133006853", 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6829/2133006853", 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:53.378 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "0ab29b1f-3012-4528-8f47-2cac908122c9", 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 0.3728179931640625, 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 107, 2024-09-11T07:07:53.379 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6816", 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6817", 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.380 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6818", 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6819", 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.381 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6822", 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6823", 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.382 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6820", 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6821", 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6817/2083734892", 2024-09-11T07:07:53.383 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6819/2083734892", 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6823/2083734892", 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6821/2083734892", 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d9c7d12b-be93-41c9-a246-773faa65ecaf", 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:07:53.384 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 109, 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6800", 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6801", 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6802", 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:53.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6803", 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6806", 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6807", 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6804", 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.388 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6805", 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6801/2322042784", 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6803/2322042784", 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2322042784", 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2322042784", 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:07:53.389 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 65536, 2024-09-11T07:07:53.390 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.653648+0000", 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.846269+0000", 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:53.391 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.970884+0000", 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:53.392 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.985630+0000", 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 65536, 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.236412+0000", 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.393 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.336953+0000", 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:53.394 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.306806+0000", 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.104744+0000", 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:53.395 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [ 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: "pgid": "2.0", 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: 0, 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: 6 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [ 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: "pgid": "3.17", 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: "mappings": [ 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: "from": 5, 2024-09-11T07:07:53.396 INFO:teuthology.orchestra.run.smithi079.stdout: "to": 2 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-11T07:07:53.397 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [], 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [], 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-11T07:07:53.398 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.399 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:53.400 INFO:teuthology.orchestra.run.smithi079.stdout:5975 trunc from 0xcac9554 to 0x95f74f 2024-09-11T07:07:53.401 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:07:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:53.401 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.308131793, 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:53.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.881961297999993, 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.408 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:53.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:07:53.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:07:53.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.881905080999999, 2024-09-11T07:07:53.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:07:53.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878857920000002, 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.417 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:07:53.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.421 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878804819999999, 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.422 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:07:53.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:07:53.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:07:53.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878705914999998, 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.426 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:07:53.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.430 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878638046999995, 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:53.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:07:53.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:07:53.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878581513, 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:53.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.439 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878529052999994, 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:53.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:07:53.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:07:53.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.443 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878477425, 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.444 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:07:53.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:07:53.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878426003000001, 2024-09-11T07:07:53.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:07:53.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:07:53.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878374909000001, 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:53.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:07:53.456 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878322948999994, 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:07:53.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.461 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878223435999999, 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:07:53.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878164631000004, 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.466 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:07:53.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878113476999999, 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.471 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.878057170999995, 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.475 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:07:53.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:07:53.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.871257655999997, 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.480 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:07:53.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.139187630999999, 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.484 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:07:53.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:07:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:07:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 32.821778584, 2024-09-11T07:07:53.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:07:53.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:53.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:53.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:53.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:53.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:07:53.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:07:53.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.496 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:53.496 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:53.496 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:53.497 INFO:tasks.thrashosds.thrasher:j is {'epoch': 113, 'fsid': 'e1313abd-54a9-4e53-ab67-469f744048b1', 'created': '2024-09-11T07:05:29.098467+0000', 'modified': '2024-09-11T07:07:51.873481+0000', 'last_up_change': '2024-09-11T07:05:41.051856+0000', 'last_in_change': '2024-09-11T07:07:41.257150+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T07:05:41.897005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T07:05:47.687214+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8600000143051147, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T07:05:57.298060+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 49, 'snap_epoch': 113, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9700000286102295, 'score_stable': 1.9700000286102295, 'optimal_score': 0.8600000143051147, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}], 'osds': [{'osd': 0, 'uuid': '24d57cdb-2f3a-4a96-903d-11be7dc26a20', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 72, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6825', 'nonce': 1708235775}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6826', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 1708235775}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6830', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 1708235775}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6829', 'nonce': 1708235775}]}, 'public_addr': '172.21.15.79:6825/1708235775', 'cluster_addr': '172.21.15.79:6827/1708235775', 'heartbeat_back_addr': '172.21.15.79:6831/1708235775', 'heartbeat_front_addr': '172.21.15.79:6829/1708235775', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa51dc1b-b783-4212-8736-1f666239613b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 108, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 2076268206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 2076268206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 2076268206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 2076268206}]}, 'public_addr': '172.21.15.79:6801/2076268206', 'cluster_addr': '172.21.15.79:6803/2076268206', 'heartbeat_back_addr': '172.21.15.79:6807/2076268206', 'heartbeat_front_addr': '172.21.15.79:6805/2076268206', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '141a913f-7353-44a9-9dbd-70219bcee638', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 107, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6817', 'nonce': 1904492349}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6818', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1904492349}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6822', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 1904492349}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6821', 'nonce': 1904492349}]}, 'public_addr': '172.21.15.79:6817/1904492349', 'cluster_addr': '172.21.15.79:6819/1904492349', 'heartbeat_back_addr': '172.21.15.79:6823/1904492349', 'heartbeat_front_addr': '172.21.15.79:6821/1904492349', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '32550aeb-0c8d-4ca9-afd5-3e5258e7255b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 108, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 1327328912}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 1327328912}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 1327328912}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 1327328912}]}, 'public_addr': '172.21.15.79:6809/1327328912', 'cluster_addr': '172.21.15.79:6811/1327328912', 'heartbeat_back_addr': '172.21.15.79:6815/1327328912', 'heartbeat_front_addr': '172.21.15.79:6813/1327328912', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 100, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 4087452871}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 4087452871}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 4087452871}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 4087452871}]}, 'public_addr': '172.21.15.110:6809/4087452871', 'cluster_addr': '172.21.15.110:6811/4087452871', 'heartbeat_back_addr': '172.21.15.110:6815/4087452871', 'heartbeat_front_addr': '172.21.15.110:6813/4087452871', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '42c83053-328e-4c9b-bdaf-09e1a4cc8b7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 108, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 2133006853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 2133006853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 2133006853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 2133006853}]}, 'public_addr': '172.21.15.110:6825/2133006853', 'cluster_addr': '172.21.15.110:6827/2133006853', 'heartbeat_back_addr': '172.21.15.110:6831/2133006853', 'heartbeat_front_addr': '172.21.15.110:6829/2133006853', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0ab29b1f-3012-4528-8f47-2cac908122c9', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 0.3728179931640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 107, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 2083734892}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 2083734892}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 2083734892}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 2083734892}]}, 'public_addr': '172.21.15.110:6817/2083734892', 'cluster_addr': '172.21.15.110:6819/2083734892', 'heartbeat_back_addr': '172.21.15.110:6823/2083734892', 'heartbeat_front_addr': '172.21.15.110:6821/2083734892', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'd9c7d12b-be93-41c9-a246-773faa65ecaf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 109, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2322042784}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2322042784}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2322042784}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2322042784}]}, 'public_addr': '172.21.15.110:6801/2322042784', 'cluster_addr': '172.21.15.110:6803/2322042784', 'heartbeat_back_addr': '172.21.15.110:6807/2322042784', 'heartbeat_front_addr': '172.21.15.110:6805/2322042784', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.653648+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.846269+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.970884+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.985630+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.236412+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.336953+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.306806+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.104744+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.0', 'osds': [0, 6]}], 'pg_upmap_items': [{'pgid': '3.17', 'mappings': [{'from': 5, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T07:07:53.497 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:07:53.498 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:53.500 INFO:teuthology.orchestra.run.smithi079.stdout:5977 trunc from 0x95f74f to 0x7d2bf3d 2024-09-11T07:07:53.500 INFO:teuthology.orchestra.run.smithi079.stdout:5978 punch from 0x46c7886 to 0x46c927a, (0x19f4 bytes) 2024-09-11T07:07:53.500 INFO:teuthology.orchestra.run.smithi079.stdout:5980 read 0x55bc0a0 thru 0x55bd0e6 (0x1047 bytes) 2024-09-11T07:07:53.500 INFO:teuthology.orchestra.run.smithi079.stdout:5981 write 0x2a30efd thru 0x2a37c71 (0x6d75 bytes) 2024-09-11T07:07:53.500 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:53.500 INFO:teuthology.orchestra.run.smithi079.stdout:5983 read 0x4f62b0c thru 0x4f64dbd (0x22b2 bytes) 2024-09-11T07:07:53.500 INFO:teuthology.orchestra.run.smithi079.stdout:5984 trunc from 0x7d2bf3d to 0x3bd72eb 2024-09-11T07:07:53.500 INFO:teuthology.orchestra.run.smithi079.stdout:5985 read 0x230e249 thru 0x2319b64 (0xb91c bytes) 2024-09-11T07:07:53.501 INFO:teuthology.orchestra.run.smithi079.stdout:5986 read 0x22a0ca6 thru 0x22a40a8 (0x3403 bytes) 2024-09-11T07:07:53.501 INFO:teuthology.orchestra.run.smithi079.stdout:5987 writesame 0x2196a7e thru 0x219f537 data_size 0x9(0x8aba bytes) 2024-09-11T07:07:53.501 INFO:teuthology.orchestra.run.smithi079.stdout:5988 write 0xad28129 thru 0xad3722a (0xf102 bytes) 2024-09-11T07:07:53.501 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:53.501 INFO:teuthology.orchestra.run.smithi079.stdout:5992 write 0x42e7ba1 thru 0x42e8754 (0xbb4 bytes) 2024-09-11T07:07:53.501 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:53.501 INFO:teuthology.orchestra.run.smithi079.stdout:5997 read 0x3fa7eaf thru 0x3faa144 (0x2296 bytes) 2024-09-11T07:07:53.501 INFO:teuthology.orchestra.run.smithi079.stdout:compare and write disabled 2024-09-11T07:07:53.501 INFO:teuthology.orchestra.run.smithi079.stdout:5999 write 0xde81d83 thru 0xde8d0d4 (0xb352 bytes) 2024-09-11T07:07:53.501 INFO:teuthology.orchestra.run.smithi079.stdout:6000 punch from 0x71d2759 to 0x71e107f, (0xe926 bytes) 2024-09-11T07:07:53.502 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:53.495+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:53.542 INFO:teuthology.orchestra.run.smithi079.stdout:checking clone #46, image image_client.0-clone46 against file /home/ubuntu/cephtest/archive/fsx-image_client.0-parent47 2024-09-11T07:07:53.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:53.595+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:53.633 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:53.634 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:53.634 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:53.653 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:53.702 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:53.699+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:53.802 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:53.799+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:53.817 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:53.817 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:53.817 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:53.817 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:53.818 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:53.824 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:07:53.824 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:07:53.833 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:53.843 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2024-09-11T07:07:51.879869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1330057623,"num_objects":2362,"num_object_clones":380,"num_object_copies":4724,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2362,"num_whiteouts":1243,"num_read":154291,"num_read_kb":612850,"num_write":17249,"num_write_kb":414842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2293,"num_bytes_recovered":192039007,"num_keys_recovered":622,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14829,"ondisk_log_size":14829,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":285724,"kb_used_data":58280,"kb_used_omap":9,"kb_used_meta":227254,"kb_avail":565945316,"statfs":{"total":579820584960,"available":579528003584,"internally_reserved":0,"allocated":59678720,"data_stored":675434570,"data_compressed":16987538,"data_compressed_allocated":42434560,"data_compressed_original":666312546,"omap_allocated":9568,"internal_metadata":232708768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":123120665,"num_objects":150,"num_object_clones":32,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":150,"num_whiteouts":61,"num_read":11259,"num_read_kb":17239,"num_write":1188,"num_write_kb":15594,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1584,"num_bytes_recovered":126598085,"num_keys_recovered":444,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.046668"},"pg_stats":[{"pgid":"3.1f","version":"112'390","reported_seq":2584,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.523511+0000","last_change":"2024-09-11T07:07:00.913312+0000","last_active":"2024-09-11T07:07:51.523511+0000","last_peered":"2024-09-11T07:07:51.523511+0000","last_clean":"2024-09-11T07:07:51.523511+0000","last_became_active":"2024-09-11T07:07:00.912449+0000","last_became_peered":"2024-09-11T07:07:00.912449+0000","last_unstale":"2024-09-11T07:07:51.523511+0000","last_undegraded":"2024-09-11T07:07:51.523511+0000","last_fullsized":"2024-09-11T07:07:51.523511+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:38:22.036317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00097647200000000004,"stat_sum":{"num_bytes":37881690,"num_objects":73,"num_object_clones":16,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":39,"num_read":2575,"num_read_kb":4981,"num_write":505,"num_write_kb":22499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":61,"num_bytes_recovered":1716442,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"112'333","reported_seq":1711,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.537995+0000","last_change":"2024-09-11T07:06:00.970173+0000","last_active":"2024-09-11T07:07:51.537995+0000","last_peered":"2024-09-11T07:07:51.537995+0000","last_clean":"2024-09-11T07:07:51.537995+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:07:51.537995+0000","last_undegraded":"2024-09-11T07:07:51.537995+0000","last_fullsized":"2024-09-11T07:07:51.537995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":333,"log_dups_size":0,"ondisk_log_size":333,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:38:52.494511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00084787600000000001,"stat_sum":{"num_bytes":33957513,"num_objects":74,"num_object_clones":10,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":35,"num_read":1579,"num_read_kb":19241,"num_write":343,"num_write_kb":12622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"112'542","reported_seq":12093,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.735445+0000","last_change":"2024-09-11T07:07:44.850947+0000","last_active":"2024-09-11T07:07:51.735445+0000","last_peered":"2024-09-11T07:07:51.735445+0000","last_clean":"2024-09-11T07:07:51.735445+0000","last_became_active":"2024-09-11T07:07:44.847414+0000","last_became_peered":"2024-09-11T07:07:44.847414+0000","last_unstale":"2024-09-11T07:07:51.735445+0000","last_undegraded":"2024-09-11T07:07:51.735445+0000","last_fullsized":"2024-09-11T07:07:51.735445+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:10:00.835461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000550473,"stat_sum":{"num_bytes":83748280,"num_objects":79,"num_object_clones":12,"num_object_copies":158,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":45,"num_read":13425,"num_read_kb":66327,"num_write":680,"num_write_kb":14657,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":110,"num_bytes_recovered":5987441,"num_keys_recovered":12,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"112'768","reported_seq":3621,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.487100+0000","last_change":"2024-09-11T07:07:45.845105+0000","last_active":"2024-09-11T07:07:51.487100+0000","last_peered":"2024-09-11T07:07:51.487100+0000","last_clean":"2024-09-11T07:07:51.487100+0000","last_became_active":"2024-09-11T07:07:45.842299+0000","last_became_peered":"2024-09-11T07:07:45.842299+0000","last_unstale":"2024-09-11T07:07:51.487100+0000","last_undegraded":"2024-09-11T07:07:51.487100+0000","last_fullsized":"2024-09-11T07:07:51.487100+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:36:47.649864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022332319999999999,"stat_sum":{"num_bytes":39985537,"num_objects":86,"num_object_clones":15,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":45,"num_read":4609,"num_read_kb":15645,"num_write":1029,"num_write_kb":13569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":6996622,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"112'439","reported_seq":5962,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.870555+0000","last_change":"2024-09-11T07:07:46.843278+0000","last_active":"2024-09-11T07:07:50.870555+0000","last_peered":"2024-09-11T07:07:50.870555+0000","last_clean":"2024-09-11T07:07:50.870555+0000","last_became_active":"2024-09-11T07:07:46.840896+0000","last_became_peered":"2024-09-11T07:07:46.840896+0000","last_unstale":"2024-09-11T07:07:50.870555+0000","last_undegraded":"2024-09-11T07:07:50.870555+0000","last_fullsized":"2024-09-11T07:07:50.870555+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:24:43.469605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001182787,"stat_sum":{"num_bytes":11890380,"num_objects":73,"num_object_clones":9,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":48,"num_read":7663,"num_read_kb":10767,"num_write":468,"num_write_kb":4648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":140,"num_bytes_recovered":2958391,"num_keys_recovered":35,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"112'424","reported_seq":3855,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.740222+0000","last_change":"2024-09-11T07:07:44.841567+0000","last_active":"2024-09-11T07:07:51.740222+0000","last_peered":"2024-09-11T07:07:51.740222+0000","last_clean":"2024-09-11T07:07:51.740222+0000","last_became_active":"2024-09-11T07:07:44.840674+0000","last_became_peered":"2024-09-11T07:07:44.840674+0000","last_unstale":"2024-09-11T07:07:51.740222+0000","last_undegraded":"2024-09-11T07:07:51.740222+0000","last_fullsized":"2024-09-11T07:07:51.740222+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":424,"log_dups_size":0,"ondisk_log_size":424,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:27:49.231030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00059322499999999996,"stat_sum":{"num_bytes":19166098,"num_objects":80,"num_object_clones":12,"num_object_copies":160,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":80,"num_whiteouts":52,"num_read":5312,"num_read_kb":10383,"num_write":464,"num_write_kb":9939,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":3177242,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"112'417","reported_seq":1683,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.881870+0000","last_change":"2024-09-11T07:06:00.820857+0000","last_active":"2024-09-11T07:07:50.881870+0000","last_peered":"2024-09-11T07:07:50.881870+0000","last_clean":"2024-09-11T07:07:50.881870+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:07:50.881870+0000","last_undegraded":"2024-09-11T07:07:50.881870+0000","last_fullsized":"2024-09-11T07:07:50.881870+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:03.435149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00076385799999999996,"stat_sum":{"num_bytes":28399528,"num_objects":62,"num_object_clones":8,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":31,"num_read":2200,"num_read_kb":6180,"num_write":525,"num_write_kb":4172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"111'542","reported_seq":3762,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.285482+0000","last_change":"2024-09-11T07:07:00.913189+0000","last_active":"2024-09-11T07:07:51.285482+0000","last_peered":"2024-09-11T07:07:51.285482+0000","last_clean":"2024-09-11T07:07:51.285482+0000","last_became_active":"2024-09-11T07:07:00.911170+0000","last_became_peered":"2024-09-11T07:07:00.911170+0000","last_unstale":"2024-09-11T07:07:51.285482+0000","last_undegraded":"2024-09-11T07:07:51.285482+0000","last_fullsized":"2024-09-11T07:07:51.285482+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":542,"log_dups_size":0,"ondisk_log_size":542,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:32:40.178898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001212451,"stat_sum":{"num_bytes":82794377,"num_objects":84,"num_object_clones":13,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":47,"num_read":5811,"num_read_kb":12938,"num_write":570,"num_write_kb":21544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":4844589,"num_keys_recovered":12,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"112'345","reported_seq":5769,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.458890+0000","last_change":"2024-09-11T07:07:00.915270+0000","last_active":"2024-09-11T07:07:51.458890+0000","last_peered":"2024-09-11T07:07:51.458890+0000","last_clean":"2024-09-11T07:07:51.458890+0000","last_became_active":"2024-09-11T07:07:00.912592+0000","last_became_peered":"2024-09-11T07:07:00.912592+0000","last_unstale":"2024-09-11T07:07:51.458890+0000","last_undegraded":"2024-09-11T07:07:51.458890+0000","last_fullsized":"2024-09-11T07:07:51.458890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:41:57.864223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093584899999999999,"stat_sum":{"num_bytes":47828387,"num_objects":77,"num_object_clones":16,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":38,"num_read":6142,"num_read_kb":40764,"num_write":332,"num_write_kb":21076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":74,"num_bytes_recovered":7459303,"num_keys_recovered":46,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"112'563","reported_seq":3426,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.146655+0000","last_change":"2024-09-11T07:06:00.825499+0000","last_active":"2024-09-11T07:07:51.146655+0000","last_peered":"2024-09-11T07:07:51.146655+0000","last_clean":"2024-09-11T07:07:51.146655+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:07:51.146655+0000","last_undegraded":"2024-09-11T07:07:51.146655+0000","last_fullsized":"2024-09-11T07:07:51.146655+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":563,"log_dups_size":0,"ondisk_log_size":563,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:38:14.496830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056977600000000003,"stat_sum":{"num_bytes":48327369,"num_objects":73,"num_object_clones":14,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":39,"num_read":4698,"num_read_kb":15626,"num_write":642,"num_write_kb":8664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"112'409","reported_seq":3585,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.533553+0000","last_change":"2024-09-11T07:06:00.837150+0000","last_active":"2024-09-11T07:07:51.533553+0000","last_peered":"2024-09-11T07:07:51.533553+0000","last_clean":"2024-09-11T07:07:51.533553+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:07:51.533553+0000","last_undegraded":"2024-09-11T07:07:51.533553+0000","last_fullsized":"2024-09-11T07:07:51.533553+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:47:02.970409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001184086,"stat_sum":{"num_bytes":38697142,"num_objects":81,"num_object_clones":15,"num_object_copies":162,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":81,"num_whiteouts":45,"num_read":4370,"num_read_kb":24302,"num_write":404,"num_write_kb":20375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"112'440","reported_seq":3903,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.871028+0000","last_change":"2024-09-11T07:07:44.847529+0000","last_active":"2024-09-11T07:07:50.871028+0000","last_peered":"2024-09-11T07:07:50.871028+0000","last_clean":"2024-09-11T07:07:50.871028+0000","last_became_active":"2024-09-11T07:07:44.842982+0000","last_became_peered":"2024-09-11T07:07:44.842982+0000","last_unstale":"2024-09-11T07:07:50.871028+0000","last_undegraded":"2024-09-11T07:07:50.871028+0000","last_fullsized":"2024-09-11T07:07:50.871028+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:42:50.919675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046265999999999999,"stat_sum":{"num_bytes":39998363,"num_objects":70,"num_object_clones":12,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":35,"num_read":5763,"num_read_kb":16787,"num_write":457,"num_write_kb":7144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":3955769,"num_keys_recovered":48,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":114,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.965093+0000","last_change":"2024-09-11T07:07:24.114928+0000","last_active":"2024-09-11T07:07:50.965093+0000","last_peered":"2024-09-11T07:07:50.965093+0000","last_clean":"2024-09-11T07:07:50.965093+0000","last_became_active":"2024-09-11T07:07:24.114181+0000","last_became_peered":"2024-09-11T07:07:24.114181+0000","last_unstale":"2024-09-11T07:07:50.965093+0000","last_undegraded":"2024-09-11T07:07:50.965093+0000","last_fullsized":"2024-09-11T07:07:50.965093+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:03.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"112'448","reported_seq":3252,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.758925+0000","last_change":"2024-09-11T07:07:44.851277+0000","last_active":"2024-09-11T07:07:51.758925+0000","last_peered":"2024-09-11T07:07:51.758925+0000","last_clean":"2024-09-11T07:07:51.758925+0000","last_became_active":"2024-09-11T07:07:44.850506+0000","last_became_peered":"2024-09-11T07:07:44.850506+0000","last_unstale":"2024-09-11T07:07:51.758925+0000","last_undegraded":"2024-09-11T07:07:51.758925+0000","last_fullsized":"2024-09-11T07:07:51.758925+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":448,"log_dups_size":0,"ondisk_log_size":448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:45:00.523713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00056190700000000005,"stat_sum":{"num_bytes":58587988,"num_objects":91,"num_object_clones":16,"num_object_copies":182,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":91,"num_whiteouts":50,"num_read":3663,"num_read_kb":13402,"num_write":458,"num_write_kb":8466,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":10726881,"num_keys_recovered":12,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":202,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.882245+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:07:50.882245+0000","last_peered":"2024-09-11T07:07:50.882245+0000","last_clean":"2024-09-11T07:07:50.882245+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:07:50.882245+0000","last_undegraded":"2024-09-11T07:07:50.882245+0000","last_fullsized":"2024-09-11T07:07:50.882245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"112'578","reported_seq":1977,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.957916+0000","last_change":"2024-09-11T07:06:00.969789+0000","last_active":"2024-09-11T07:07:50.957916+0000","last_peered":"2024-09-11T07:07:50.957916+0000","last_clean":"2024-09-11T07:07:50.957916+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:07:50.957916+0000","last_undegraded":"2024-09-11T07:07:50.957916+0000","last_fullsized":"2024-09-11T07:07:50.957916+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:04:36.528032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00068823799999999998,"stat_sum":{"num_bytes":19129817,"num_objects":76,"num_object_clones":15,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":43,"num_read":3619,"num_read_kb":11253,"num_write":784,"num_write_kb":5553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":213,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.871572+0000","last_change":"2024-09-11T07:07:42.295824+0000","last_active":"2024-09-11T07:07:50.871572+0000","last_peered":"2024-09-11T07:07:50.871572+0000","last_clean":"2024-09-11T07:07:50.871572+0000","last_became_active":"2024-09-11T07:07:42.294937+0000","last_became_peered":"2024-09-11T07:07:42.294937+0000","last_unstale":"2024-09-11T07:07:50.871572+0000","last_undegraded":"2024-09-11T07:07:50.871572+0000","last_fullsized":"2024-09-11T07:07:50.871572+0000","mapping_epoch":104,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:16:51.735724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"111'388","reported_seq":4434,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.882152+0000","last_change":"2024-09-11T07:06:00.821584+0000","last_active":"2024-09-11T07:07:50.882152+0000","last_peered":"2024-09-11T07:07:50.882152+0000","last_clean":"2024-09-11T07:07:50.882152+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:07:50.882152+0000","last_undegraded":"2024-09-11T07:07:50.882152+0000","last_fullsized":"2024-09-11T07:07:50.882152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":388,"log_dups_size":0,"ondisk_log_size":388,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:52:08.770323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001413975,"stat_sum":{"num_bytes":31848029,"num_objects":64,"num_object_clones":8,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":31,"num_read":5399,"num_read_kb":27895,"num_write":396,"num_write_kb":12839,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":207,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.882189+0000","last_change":"2024-09-11T07:06:57.872595+0000","last_active":"2024-09-11T07:07:50.882189+0000","last_peered":"2024-09-11T07:07:50.882189+0000","last_clean":"2024-09-11T07:07:50.882189+0000","last_became_active":"2024-09-11T07:06:57.872268+0000","last_became_peered":"2024-09-11T07:06:57.872268+0000","last_unstale":"2024-09-11T07:07:50.882189+0000","last_undegraded":"2024-09-11T07:07:50.882189+0000","last_fullsized":"2024-09-11T07:07:50.882189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:45:51.009453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"112'464","reported_seq":2468,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.641034+0000","last_change":"2024-09-11T07:06:00.827482+0000","last_active":"2024-09-11T07:07:51.641034+0000","last_peered":"2024-09-11T07:07:51.641034+0000","last_clean":"2024-09-11T07:07:51.641034+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:07:51.641034+0000","last_undegraded":"2024-09-11T07:07:51.641034+0000","last_fullsized":"2024-09-11T07:07:51.641034+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":464,"log_dups_size":0,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:39:00.910564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002494839,"stat_sum":{"num_bytes":36704510,"num_objects":74,"num_object_clones":10,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":36,"num_read":2980,"num_read_kb":8668,"num_write":579,"num_write_kb":4998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"112'471","reported_seq":3553,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.626282+0000","last_change":"2024-09-11T07:07:44.845728+0000","last_active":"2024-09-11T07:07:51.626282+0000","last_peered":"2024-09-11T07:07:51.626282+0000","last_clean":"2024-09-11T07:07:51.626282+0000","last_became_active":"2024-09-11T07:07:44.844028+0000","last_became_peered":"2024-09-11T07:07:44.844028+0000","last_unstale":"2024-09-11T07:07:51.626282+0000","last_undegraded":"2024-09-11T07:07:51.626282+0000","last_fullsized":"2024-09-11T07:07:51.626282+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:55:46.220203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040103300000000002,"stat_sum":{"num_bytes":26357269,"num_objects":59,"num_object_clones":9,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":30,"num_read":4428,"num_read_kb":11047,"num_write":541,"num_write_kb":11241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":146,"num_bytes_recovered":5319558,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":205,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.873596+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:07:50.873596+0000","last_peered":"2024-09-11T07:07:50.873596+0000","last_clean":"2024-09-11T07:07:50.873596+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:07:50.873596+0000","last_undegraded":"2024-09-11T07:07:50.873596+0000","last_fullsized":"2024-09-11T07:07:50.873596+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"112'524","reported_seq":4439,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.285983+0000","last_change":"2024-09-11T07:06:00.820656+0000","last_active":"2024-09-11T07:07:51.285983+0000","last_peered":"2024-09-11T07:07:51.285983+0000","last_clean":"2024-09-11T07:07:51.285983+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:07:51.285983+0000","last_undegraded":"2024-09-11T07:07:51.285983+0000","last_fullsized":"2024-09-11T07:07:51.285983+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":524,"log_dups_size":0,"ondisk_log_size":524,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:58:20.361918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058463999999999999,"stat_sum":{"num_bytes":107199679,"num_objects":92,"num_object_clones":16,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":34,"num_read":5253,"num_read_kb":40942,"num_write":559,"num_write_kb":33924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":203,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.953791+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:07:50.953791+0000","last_peered":"2024-09-11T07:07:50.953791+0000","last_clean":"2024-09-11T07:07:50.953791+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:07:50.953791+0000","last_undegraded":"2024-09-11T07:07:50.953791+0000","last_fullsized":"2024-09-11T07:07:50.953791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"106'395","reported_seq":8002,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.957093+0000","last_change":"2024-09-11T07:07:44.844391+0000","last_active":"2024-09-11T07:07:50.957093+0000","last_peered":"2024-09-11T07:07:50.957093+0000","last_clean":"2024-09-11T07:07:50.957093+0000","last_became_active":"2024-09-11T07:07:44.843421+0000","last_became_peered":"2024-09-11T07:07:44.843421+0000","last_unstale":"2024-09-11T07:07:50.957093+0000","last_undegraded":"2024-09-11T07:07:50.957093+0000","last_fullsized":"2024-09-11T07:07:50.957093+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:36:39.970401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00070404599999999995,"stat_sum":{"num_bytes":49521789,"num_objects":68,"num_object_clones":11,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":33,"num_read":8555,"num_read_kb":32944,"num_write":434,"num_write_kb":25071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":139,"num_bytes_recovered":45581098,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.869948+0000","last_change":"2024-09-11T07:05:51.786715+0000","last_active":"2024-09-11T07:07:50.869948+0000","last_peered":"2024-09-11T07:07:50.869948+0000","last_clean":"2024-09-11T07:07:50.869948+0000","last_became_active":"2024-09-11T07:05:49.150640+0000","last_became_peered":"2024-09-11T07:05:49.150640+0000","last_unstale":"2024-09-11T07:07:50.869948+0000","last_undegraded":"2024-09-11T07:07:50.869948+0000","last_fullsized":"2024-09-11T07:07:50.869948+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:36:22.238242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001011446,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"112'385","reported_seq":4808,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.957292+0000","last_change":"2024-09-11T07:06:00.970754+0000","last_active":"2024-09-11T07:07:50.957292+0000","last_peered":"2024-09-11T07:07:50.957292+0000","last_clean":"2024-09-11T07:07:50.957292+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:07:50.957292+0000","last_undegraded":"2024-09-11T07:07:50.957292+0000","last_fullsized":"2024-09-11T07:07:50.957292+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:05:55.197722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013822890000000001,"stat_sum":{"num_bytes":25605115,"num_objects":58,"num_object_clones":7,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":33,"num_read":5135,"num_read_kb":20315,"num_write":432,"num_write_kb":10679,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":204,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.873633+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:07:50.873633+0000","last_peered":"2024-09-11T07:07:50.873633+0000","last_clean":"2024-09-11T07:07:50.873633+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:07:50.873633+0000","last_undegraded":"2024-09-11T07:07:50.873633+0000","last_fullsized":"2024-09-11T07:07:50.873633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":368,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.869847+0000","last_change":"2024-09-11T07:07:00.907608+0000","last_active":"2024-09-11T07:07:50.869847+0000","last_peered":"2024-09-11T07:07:50.869847+0000","last_clean":"2024-09-11T07:07:50.869847+0000","last_became_active":"2024-09-11T07:07:00.907199+0000","last_became_peered":"2024-09-11T07:07:00.907199+0000","last_unstale":"2024-09-11T07:07:50.869847+0000","last_undegraded":"2024-09-11T07:07:50.869847+0000","last_fullsized":"2024-09-11T07:07:50.869847+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:37.571030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"111'284","reported_seq":2742,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.957016+0000","last_change":"2024-09-11T07:06:00.970646+0000","last_active":"2024-09-11T07:07:50.957016+0000","last_peered":"2024-09-11T07:07:50.957016+0000","last_clean":"2024-09-11T07:07:50.957016+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:07:50.957016+0000","last_undegraded":"2024-09-11T07:07:50.957016+0000","last_fullsized":"2024-09-11T07:07:50.957016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:08:38.628459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012611810000000001,"stat_sum":{"num_bytes":32113636,"num_objects":74,"num_object_clones":12,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":42,"num_read":2366,"num_read_kb":11521,"num_write":266,"num_write_kb":6793,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"112'234","reported_seq":1774,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.041158+0000","last_change":"2024-09-11T07:07:44.847128+0000","last_active":"2024-09-11T07:07:51.041158+0000","last_peered":"2024-09-11T07:07:51.041158+0000","last_clean":"2024-09-11T07:07:51.041158+0000","last_became_active":"2024-09-11T07:07:44.846435+0000","last_became_peered":"2024-09-11T07:07:44.846435+0000","last_unstale":"2024-09-11T07:07:51.041158+0000","last_undegraded":"2024-09-11T07:07:51.041158+0000","last_fullsized":"2024-09-11T07:07:51.041158+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":234,"log_dups_size":0,"ondisk_log_size":234,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:41:32.254419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00062012700000000005,"stat_sum":{"num_bytes":37849112,"num_objects":68,"num_object_clones":10,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":34,"num_read":1426,"num_read_kb":7886,"num_write":202,"num_write_kb":8533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":4236596,"num_keys_recovered":24,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"112'453","reported_seq":4567,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.285877+0000","last_change":"2024-09-11T07:07:45.837954+0000","last_active":"2024-09-11T07:07:51.285877+0000","last_peered":"2024-09-11T07:07:51.285877+0000","last_clean":"2024-09-11T07:07:51.285877+0000","last_became_active":"2024-09-11T07:07:45.837012+0000","last_became_peered":"2024-09-11T07:07:45.837012+0000","last_unstale":"2024-09-11T07:07:51.285877+0000","last_undegraded":"2024-09-11T07:07:51.285877+0000","last_fullsized":"2024-09-11T07:07:51.285877+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":453,"log_dups_size":0,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:14:53.365575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046764000000000002,"stat_sum":{"num_bytes":29045473,"num_objects":77,"num_object_clones":10,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":44,"num_read":6220,"num_read_kb":11557,"num_write":515,"num_write_kb":6776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":187,"num_bytes_recovered":4540944,"num_keys_recovered":88,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"111'423","reported_seq":2807,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.957312+0000","last_change":"2024-09-11T07:07:45.842682+0000","last_active":"2024-09-11T07:07:50.957312+0000","last_peered":"2024-09-11T07:07:50.957312+0000","last_clean":"2024-09-11T07:07:50.957312+0000","last_became_active":"2024-09-11T07:07:45.841348+0000","last_became_peered":"2024-09-11T07:07:45.841348+0000","last_unstale":"2024-09-11T07:07:50.957312+0000","last_undegraded":"2024-09-11T07:07:50.957312+0000","last_fullsized":"2024-09-11T07:07:50.957312+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":423,"log_dups_size":0,"ondisk_log_size":423,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:55:09.204526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021149200000000002,"stat_sum":{"num_bytes":31314987,"num_objects":75,"num_object_clones":11,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":40,"num_read":4241,"num_read_kb":20219,"num_write":487,"num_write_kb":14686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":28540932,"num_keys_recovered":96,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"112'306","reported_seq":2619,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.575883+0000","last_change":"2024-09-11T07:06:00.827407+0000","last_active":"2024-09-11T07:07:51.575883+0000","last_peered":"2024-09-11T07:07:51.575883+0000","last_clean":"2024-09-11T07:07:51.575883+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:07:51.575883+0000","last_undegraded":"2024-09-11T07:07:51.575883+0000","last_fullsized":"2024-09-11T07:07:51.575883+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:55:09.924175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024738579999999998,"stat_sum":{"num_bytes":27128233,"num_objects":66,"num_object_clones":14,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":33,"num_read":2208,"num_read_kb":7273,"num_write":268,"num_write_kb":5914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"112'350","reported_seq":3310,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.482604+0000","last_change":"2024-09-11T07:06:00.838531+0000","last_active":"2024-09-11T07:07:51.482604+0000","last_peered":"2024-09-11T07:07:51.482604+0000","last_clean":"2024-09-11T07:07:51.482604+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:07:51.482604+0000","last_undegraded":"2024-09-11T07:07:51.482604+0000","last_fullsized":"2024-09-11T07:07:51.482604+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:40:36.817537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022638789999999999,"stat_sum":{"num_bytes":36000446,"num_objects":77,"num_object_clones":10,"num_object_copies":154,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":77,"num_whiteouts":39,"num_read":4343,"num_read_kb":18989,"num_write":352,"num_write_kb":9258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"112'402","reported_seq":2695,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.574506+0000","last_change":"2024-09-11T07:07:46.842628+0000","last_active":"2024-09-11T07:07:51.574506+0000","last_peered":"2024-09-11T07:07:51.574506+0000","last_clean":"2024-09-11T07:07:51.574506+0000","last_became_active":"2024-09-11T07:07:46.840869+0000","last_became_peered":"2024-09-11T07:07:46.840869+0000","last_unstale":"2024-09-11T07:07:51.574506+0000","last_undegraded":"2024-09-11T07:07:51.574506+0000","last_fullsized":"2024-09-11T07:07:51.574506+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:19:39.370850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0017910619999999999,"stat_sum":{"num_bytes":55315330,"num_objects":69,"num_object_clones":11,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":35,"num_read":4522,"num_read_kb":40078,"num_write":412,"num_write_kb":33807,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":29182336,"num_keys_recovered":33,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"112'762","reported_seq":4546,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.090116+0000","last_change":"2024-09-11T07:07:46.841979+0000","last_active":"2024-09-11T07:07:51.090116+0000","last_peered":"2024-09-11T07:07:51.090116+0000","last_clean":"2024-09-11T07:07:51.090116+0000","last_became_active":"2024-09-11T07:07:46.840585+0000","last_became_peered":"2024-09-11T07:07:46.840585+0000","last_unstale":"2024-09-11T07:07:51.090116+0000","last_undegraded":"2024-09-11T07:07:51.090116+0000","last_fullsized":"2024-09-11T07:07:51.090116+0000","mapping_epoch":109,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":762,"log_dups_size":0,"ondisk_log_size":762,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:51:11.693708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020506280000000001,"stat_sum":{"num_bytes":83875119,"num_objects":78,"num_object_clones":14,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":42,"num_read":6738,"num_read_kb":22704,"num_write":1024,"num_write_kb":16297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":14436253,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"112'1194","reported_seq":2610,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.964945+0000","last_change":"2024-09-11T07:07:24.117156+0000","last_active":"2024-09-11T07:07:50.964945+0000","last_peered":"2024-09-11T07:07:50.964945+0000","last_clean":"2024-09-11T07:07:50.964945+0000","last_became_active":"2024-09-11T07:07:24.114910+0000","last_became_peered":"2024-09-11T07:07:24.114910+0000","last_unstale":"2024-09-11T07:07:50.964945+0000","last_undegraded":"2024-09-11T07:07:50.964945+0000","last_fullsized":"2024-09-11T07:07:50.964945+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":1194,"log_dups_size":0,"ondisk_log_size":1194,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:43:45.588463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049279100000000002,"stat_sum":{"num_bytes":33889887,"num_objects":75,"num_object_clones":11,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":38,"num_read":6552,"num_read_kb":16450,"num_write":1843,"num_write_kb":15833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":51,"num_bytes_recovered":2516909,"num_keys_recovered":24,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"111'231","reported_seq":3762,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.870135+0000","last_change":"2024-09-11T07:07:44.844735+0000","last_active":"2024-09-11T07:07:50.870135+0000","last_peered":"2024-09-11T07:07:50.870135+0000","last_clean":"2024-09-11T07:07:50.870135+0000","last_became_active":"2024-09-11T07:07:44.842696+0000","last_became_peered":"2024-09-11T07:07:44.842696+0000","last_unstale":"2024-09-11T07:07:50.870135+0000","last_undegraded":"2024-09-11T07:07:50.870135+0000","last_fullsized":"2024-09-11T07:07:50.870135+0000","mapping_epoch":107,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":108,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":231,"log_dups_size":0,"ondisk_log_size":231,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:00:45.735406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00089665299999999997,"stat_sum":{"num_bytes":33990538,"num_objects":67,"num_object_clones":14,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":30,"num_read":3170,"num_read_kb":9248,"num_write":213,"num_write_kb":6411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":98,"num_bytes_recovered":2139720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"112'310","reported_seq":6084,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:51.574217+0000","last_change":"2024-09-11T07:07:00.911244+0000","last_active":"2024-09-11T07:07:51.574217+0000","last_peered":"2024-09-11T07:07:51.574217+0000","last_clean":"2024-09-11T07:07:51.574217+0000","last_became_active":"2024-09-11T07:07:00.910054+0000","last_became_peered":"2024-09-11T07:07:00.910054+0000","last_unstale":"2024-09-11T07:07:51.574217+0000","last_undegraded":"2024-09-11T07:07:51.574217+0000","last_fullsized":"2024-09-11T07:07:51.574217+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":310,"log_dups_size":0,"ondisk_log_size":310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:08:07.019799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00086507200000000004,"stat_sum":{"num_bytes":43914756,"num_objects":76,"num_object_clones":14,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":41,"num_read":6030,"num_read_kb":31274,"num_write":355,"num_write_kb":10062,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":58,"num_bytes_recovered":6304727,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.13","version":"112'495","reported_seq":2480,"reported_epoch":112,"state":"active+clean","last_fresh":"2024-09-11T07:07:50.870890+0000","last_change":"2024-09-11T07:07:45.856577+0000","last_active":"2024-09-11T07:07:50.870890+0000","last_peered":"2024-09-11T07:07:50.870890+0000","last_clean":"2024-09-11T07:07:50.870890+0000","last_became_active":"2024-09-11T07:07:45.854679+0000","last_became_peered":"2024-09-11T07:07:45.854679+0000","last_unstale":"2024-09-11T07:07:50.870890+0000","last_undegraded":"2024-09-11T07:07:50.870890+0000","last_fullsized":"2024-09-11T07:07:50.870890+0000","mapping_epoch":108,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":109,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":495,"log_dups_size":0,"ondisk_log_size":495,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:26:34.308828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012764899999999999,"stat_sum":{"num_bytes":17400859,"num_objects":62,"num_object_clones":5,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":36,"num_read":3180,"num_read_kb":5144,"num_write":549,"num_write_kb":4374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":99,"num_bytes_recovered":826886,"num_keys_recovered":23,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1329467236,"num_objects":2358,"num_object_clones":380,"num_object_copies":4716,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2358,"num_whiteouts":1243,"num_read":154175,"num_read_kb":612750,"num_write":17088,"num_write_kb":412424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2291,"num_bytes_recovered":191448639,"num_keys_recovered":622,"num_objects_omap":49,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":60162048,"data_stored":815542889,"data_compressed":19394034,"data_compressed_allocated":49803264,"data_compressed_original":809518049,"omap_allocated":0,"internal_metadata":0},"log_size":14709,"ondisk_log_size":14709,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":155648,"data_stored":1771104,"data_compressed":18293,"data_compressed_allocated":110592,"data_compressed_original":1736704,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":64604,"kb_used_data":11212,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94307236,"statfs":{"total":96636764160,"available":96570609664,"internally_reserved":0,"allocated":11481088,"data_stored":133854922,"data_compressed":3123039,"data_compressed_allocated":8286208,"data_compressed_original":132147343,"omap_allocated":1591,"internal_metadata":54655433},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32664,"kb_used_data":5636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94339176,"statfs":{"total":96636764160,"available":96603316224,"internally_reserved":0,"allocated":5771264,"data_stored":38924485,"data_compressed":1681670,"data_compressed_allocated":3428352,"data_compressed_original":37706449,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":62364,"kb_used_data":8968,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94309476,"statfs":{"total":96636764160,"available":96572903424,"internally_reserved":0,"allocated":9183232,"data_stored":76216928,"data_compressed":2563535,"data_compressed_allocated":6418432,"data_compressed_original":74788763,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":0,"seq":55834574878,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42612,"kb_used_data":11428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329228,"statfs":{"total":96636764160,"available":96593129472,"internally_reserved":0,"allocated":11702272,"data_stored":147467851,"data_compressed":3441359,"data_compressed_allocated":8560640,"data_compressed_original":145824673,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42920,"kb_used_data":7500,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94328920,"statfs":{"total":96636764160,"available":96592814080,"internally_reserved":0,"allocated":7680000,"data_stored":88484768,"data_compressed":2240381,"data_compressed_allocated":5320704,"data_compressed_original":87288530,"omap_allocated":1596,"internal_metadata":36174276},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40560,"kb_used_data":13536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94331280,"statfs":{"total":96636764160,"available":96595230720,"internally_reserved":0,"allocated":13860864,"data_stored":190485616,"data_compressed":3937554,"data_compressed_allocated":10420224,"data_compressed_original":188556788,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":0,"seq":55834574877,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4644864,"data_stored":67162937,"data_compressed":1534910,"data_compressed_allocated":3944448,"data_compressed_original":66791423,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12521472,"data_stored":189859071,"data_compressed":3937554,"data_compressed_allocated":10420224,"data_compressed_original":188556788,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":6352896,"data_stored":87869893,"data_compressed":2240543,"data_compressed_allocated":5320704,"data_compressed_original":87292294,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":10375168,"data_stored":146848756,"data_compressed":3441359,"data_compressed_allocated":8560640,"data_compressed_original":145824673,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":3940352,"data_stored":77866148,"data_compressed":883898,"data_compressed_allocated":3497984,"data_compressed_original":77573580,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":7843840,"data_stored":75590424,"data_compressed":2563535,"data_compressed_allocated":6418432,"data_compressed_original":74788763,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4395008,"data_stored":37707632,"data_compressed":1675015,"data_compressed_allocated":3391488,"data_compressed_original":37116625,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10088448,"data_stored":132638028,"data_compressed":3117220,"data_compressed_allocated":8249344,"data_compressed_original":131573903,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:07:53.845 INFO:tasks.thrashosds.thrasher:Setting 3.c to [3, 4, 1, 5] 2024-09-11T07:07:53.846 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap-items', '3.c', '3', '4', '1', '5'] 2024-09-11T07:07:53.846 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap-items 3.c 3 4 1 5 2024-09-11T07:07:53.892 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:07:53.902 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:53.899+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.30299261499999, 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:53.976 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.302980475, 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:53.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:53.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:07:53.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:07:53.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.302329524, 2024-09-11T07:07:53.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:07:53.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.302272628, 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:53.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:53.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:07:53.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:07:53.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:53.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:07:53.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:07:53.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.302245594, 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:53.993 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:53.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:07:53.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:07:53.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.299701732, 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:53.997 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:53.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:07:53.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:07:54.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.29967962400001, 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:54.005 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.29966000899999, 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.299637104, 2024-09-11T07:07:54.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:54.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:07:54.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:07:54.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.013 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.29925834300001, 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:07:54.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:07:54.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.29922684100001, 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.018 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:07:54.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.022 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.298709566, 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.023 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:07:54.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:07:54.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.026 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.298685437, 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.027 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.298672111, 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.031 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:07:54.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:07:54.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:07:54.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.298252183, 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.035 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:54.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.039 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.298224774, 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.29744577, 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:07:54.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:07:54.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.292345642, 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:07:54.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:07:54.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 67.534468309000005, 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.053 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:07:54.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:54.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 67.534294496000001, 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:54.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:54.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:54.066 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:54.067 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:54.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:54.069 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:54.069 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:54.063+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:54.169 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:54.167+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:54.227 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:54.227 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:54.227 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:54.241 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:54.244 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:54.244 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:54.261 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:54.261 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:54.270 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:54.267+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:54.277 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:54.278 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:54.294 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:54.295 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:54.315 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:54.315 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:54.335 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:54.336 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:54.357 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:54.357 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:54.358 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:54.359 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:54.371 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:54.367+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:54.373 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:54.377 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:54.377 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:54.473 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:54.471+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:54.494 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:54.494 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:54.509 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:54.574 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:54.571+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:54.629 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:54.629 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:54.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:54.675 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:54.671+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:54.776 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:54.771+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:54.805 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:54.805 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:54.820 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:54.876 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:54.871+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:54.890 INFO:teuthology.orchestra.run.smithi079.stderr:set 3.c pg_upmap_items mapping to [3->4,1->5] 2024-09-11T07:07:54.981 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:54.975+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:54.989 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:54.989 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:55.003 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:55.079 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:55.075+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:55.127 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:55.127 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:55.142 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:55.180 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:55.175+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:55.264 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:55.264 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:55.278 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:55.281 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:55.275+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:55.381 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:55.379+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:55.402 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:55.402 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:55.416 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:55.482 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:55.479+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:55.551 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:55.551 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:55.565 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:55.609 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:55.607+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:55.683 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:55.683 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:55.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:55.679+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:55.696 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:55.784 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:55.779+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:55.855 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:55.855 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:55.870 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:07:55.885 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:55.883+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:55.919 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:07:55.986 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:55.983+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:56.043 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:56.044 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:56.059 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:07:56.086 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:56.083+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:56.177 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:56.177 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:56.188 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:56.183+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:56.191 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:07:56.289 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:56.283+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:56.313 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:56.313 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:56.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:07:56.389 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:56.387+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:56.395 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:07:56.450 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:56.450 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:56.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:07:56.505 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:56.503+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:56.547 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:56.547 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:56.563 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:56.563 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:56.582 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:56.582 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:56.591 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:56.587+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:56.599 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:56.599 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:56.617 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:56.617 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:56.630 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:56.630 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:56.637 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:56.637 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:56.645 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:07:56.658 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:56.658 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:56.676 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:56.676 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:56.691 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:56.687+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:56.792 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:56.787+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:56.813 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:56.813 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.48737894200001, 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:07:56.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:56.819 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.18443984699999, 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:07:56.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:07:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:07:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.184376731, 2024-09-11T07:07:56.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:07:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:07:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:07:56.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:07:56.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.184301738, 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.829 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:07:56.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.833 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.184237182, 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.834 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:07:56.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.838 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.18418195300001, 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:07:56.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.18412805600001, 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.843 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:07:56.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:07:56.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.18406755700001, 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:07:56.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.184011544, 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:07:56.852 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:07:56.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:07:56.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.183932191, 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.857 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:07:56.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.861 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.183875888, 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:07:56.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.183803449, 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.866 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:07:56.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.183747329, 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.871 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:07:56.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:56.875 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.183673863, 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:56.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:07:56.879 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 102.18359547, 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.880 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:07:56.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:07:56.884 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.274419456000004, 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 31.017833871000001, 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.889 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:07:56.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:07:56.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.247839859999999, 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:07:56.895 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:07:56.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:07:56.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:56.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 26.239849965000001, 2024-09-11T07:07:56.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:56.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109791 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 5824422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 18.080819709, 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029141958999999999, 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:56.906 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109791 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728800+0000", 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.064e-06 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744261+0000", 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015461523 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744287+0000", 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5086999999999999e-05 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744298+0000", 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1899000000000001e-05 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744376+0000", 2024-09-11T07:07:56.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7465000000000005e-05 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744514+0000", 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013820400000000001 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.745045+0000", 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053122399999999995 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.751499+0000", 2024-09-11T07:07:56.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064538750000000004 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757772+0000", 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062726509999999997 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757865+0000", 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2802999999999999e-05 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757933+0000", 2024-09-11T07:07:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8164000000000007e-05 2024-09-11T07:07:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:56.912 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:56.913 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:07:56.914 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:07:56.914 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:56.911+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:57.014 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:57.011+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:57.058 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:57.058 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:57.058 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:07:57.058 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:57.073 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:07:57.117 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:57.115+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:57.215 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:57.211+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:57.246 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:57.247 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:07:57.247 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:07:57.247 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:07:57.247 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:57.260 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:07:57.316 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:57.311+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:57.381 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:07:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:07:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:07:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:07:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.381 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.309221189, 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:07:57.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:07:57.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:07:57.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:07:57.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.883050694000005, 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:07:57.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:07:57.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:57.393 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.882994476999997, 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:57.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:07:57.397 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879947315999999, 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.402 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879894215999997, 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.406 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879795310999995, 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.407 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:07:57.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:57.411 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879727442999993, 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.415 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879670908999998, 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:07:57.416 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.417 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.418 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.419 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879618449000006, 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.420 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:07:57.421 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.422 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.423 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.424 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879566820999997, 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.425 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.426 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.427 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.428 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879515398999999, 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:07:57.429 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.430 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:07:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:07:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:07:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.431 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.432 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.433 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879464304999999, 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.434 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.435 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.436 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:07:57.437 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.438 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879412345000006, 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.439 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.440 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:07:57.441 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.442 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879312831999997, 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.443 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.444 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.445 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.446 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.447 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879254027000002, 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.448 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:07:57.449 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.450 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.451 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.452 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879202872999997, 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.453 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.454 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.455 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.879146567000006, 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.457 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:07:57.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:57.461 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 92.872347051999995, 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:07:57.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 37.140277027000003, 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.466 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:07:57.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:07:57.472 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 36.822867979999998, 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:07:57.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:07:57.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:07:57.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:07:57.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:07:57.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:07:57.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.478 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:07:57.478 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:07:57.478 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:07:57.479 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:07:57.480 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:57.475+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:57.581 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:57.575+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:57.612 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:57.612 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:57.612 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:57.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:07:57.713 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:57.711+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:57.783 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:57.779+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:57.785 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:57.785 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:57.785 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:57.785 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:57.785 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:57.799 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:07:57.884 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:57.879+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:57.977 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.304003592, 2024-09-11T07:07:57.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:57.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:57.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:07:57.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.30399145200001, 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:57.982 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:57.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:57.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.986 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.30334050099999, 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:57.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:07:57.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:07:57.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:07:57.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.303283605, 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:57.991 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:07:57.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:57.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.30325657100001, 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:07:57.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:07:57.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:07:57.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:58.000 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.300712709, 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:07:58.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:07:58.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.300690601, 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.005 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:07:58.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:58.009 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.300670986, 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:07:58.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.30064808100001, 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:07:58.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:07:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.30026932, 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.019 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:07:58.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.300237818, 2024-09-11T07:07:58.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:58.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.29972054300001, 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.028 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:07:58.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.032 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.299696414, 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.033 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:07:58.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.29968308799999, 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.038 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.29926316, 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:07:58.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:07:58.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.299235751, 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:07:58.047 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:07:58.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:07:58.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:07:58.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:07:58.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.298456747, 2024-09-11T07:07:58.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.29335661899999, 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:07:58.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.535479285999998, 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:07:58.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:07:58.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:58.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.535305472999994, 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:07:58.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:07:58.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:07:58.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:07:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:07:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.079 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.079 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:58.080 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:07:58.081 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:58.075+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:58.182 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:58.179+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:58.217 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:58.218 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:58.218 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:58.218 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:58.232 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:07:58.282 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:58.279+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:58.352 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:58.352 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:58.352 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:07:58.352 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:07:58.352 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:58.366 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:07:58.409 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:58.407+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:58.484 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:58.479+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:58.534 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:58.535 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:07:58.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:07:58.535 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:07:58.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.535 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46274 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5447680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.535 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:58.535 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199600262999994, 2024-09-11T07:07:58.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042635002999999998, 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46274 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9800000000000004e-07 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331645+0000", 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331652+0000", 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4159999999999998e-06 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331659+0000", 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2710000000000003e-06 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374165+0000", 2024-09-11T07:07:58.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042505493999999998 2024-09-11T07:07:58.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374214+0000", 2024-09-11T07:07:58.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8826999999999999e-05 2024-09-11T07:07:58.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374277+0000", 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3145000000000006e-05 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46275 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5496832~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199575300999996, 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042748189999999998, 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46275 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331669+0000", 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2900000000000001e-06 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331686+0000", 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6767999999999999e-05 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331693+0000", 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6599999999999998e-06 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374308+0000", 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042614919000000001 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374355+0000", 2024-09-11T07:07:58.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7166000000000002e-05 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374415+0000", 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9893999999999999e-05 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46276 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5545984~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199540874999997, 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042856001999999997, 2024-09-11T07:07:58.544 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46276 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331702+0000", 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331704+0000", 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5629999999999999e-06 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331712+0000", 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9340000000000006e-06 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331720+0000", 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1049999999999995e-06 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374445+0000", 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042724597000000003 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374494+0000", 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9234999999999999e-05 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374557+0000", 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3058000000000005e-05 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.548 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46277 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5595136~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199490530000006, 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042946033000000002, 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.549 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46277 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331752+0000", 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2500000000000005e-07 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331755+0000", 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7e-06 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331763+0000", 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331777+0000", 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3749e-05 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374591+0000", 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042813898000000003 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374637+0000", 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6492000000000001e-05 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374697+0000", 2024-09-11T07:07:58.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0222e-05 2024-09-11T07:07:58.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.553 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.553 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46278 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5644288~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.553 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:58.554 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199455850999996, 2024-09-11T07:07:58.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043078449999999997, 2024-09-11T07:07:58.554 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.554 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.554 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.554 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.554 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.554 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46278 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331787+0000", 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9299999999999997e-07 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331789+0000", 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331797+0000", 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331804+0000", 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3010000000000001e-06 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374743+0000", 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042938538999999998 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374800+0000", 2024-09-11T07:07:58.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6637e-05 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374865+0000", 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4906999999999994e-05 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46279 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5693440~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199429964999993, 2024-09-11T07:07:58.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043192304000000001, 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46279 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1500000000000005e-07 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331815+0000", 2024-09-11T07:07:58.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4080000000000001e-06 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331822+0000", 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3359999999999997e-06 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331831+0000", 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4530000000000002e-06 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374897+0000", 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043066213999999998 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374944+0000", 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7292000000000001e-05 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375004+0000", 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0086e-05 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46280 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5742592~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199399837000001, 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043330417000000003, 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46280 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.563 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331843+0000", 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331848+0000", 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5570000000000003e-06 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331857+0000", 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6689999999999995e-06 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331863+0000", 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0610000000000001e-06 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375049+0000", 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043186443999999997 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375104+0000", 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4821999999999998e-05 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375172+0000", 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8371e-05 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46281 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5791744~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199371575000001, 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043441781999999998, 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.567 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46281 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331871+0000", 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9900000000000001e-07 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331873+0000", 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.458e-06 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331885+0000", 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1919999999999999e-05 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331891+0000", 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0950000000000001e-06 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375205+0000", 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043314084000000003 2024-09-11T07:07:58.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375253+0000", 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8047000000000003e-05 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375312+0000", 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8678999999999998e-05 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46282 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5840896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199294460999994, 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043532266999999999, 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46282 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331948+0000", 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7199999999999997e-07 2024-09-11T07:07:58.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331952+0000", 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4479999999999999e-06 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331962+0000", 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7389999999999994e-06 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331968+0000", 2024-09-11T07:07:58.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6789999999999999e-06 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375357+0000", 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043388559 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375413+0000", 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5971999999999999e-05 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375480+0000", 2024-09-11T07:07:58.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6997999999999998e-05 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46283 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5890048~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199259521000002, 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043635858999999999, 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.576 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46283 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:07:58.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331983+0000", 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3799999999999997e-07 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331985+0000", 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4990000000000001e-06 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331993+0000", 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9629999999999998e-06 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332003+0000", 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8199999999999992e-06 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375512+0000", 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043508865000000001 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375560+0000", 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8004999999999999e-05 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375618+0000", 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8168999999999998e-05 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46284 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5939200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.580 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199231134000001, 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043772483000000001, 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46284 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:58.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0699999999999997e-07 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332014+0000", 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4619999999999999e-06 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332021+0000", 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650000000000004e-06 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332029+0000", 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-06 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375663+0000", 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043634233000000001 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375717+0000", 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4209000000000002e-05 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375783+0000", 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6297000000000006e-05 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46285 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5988352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199204692999999, 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043885753, 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46285 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.585 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332038+0000", 2024-09-11T07:07:58.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332040+0000", 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332048+0000", 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5830000000000001e-06 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332054+0000", 2024-09-11T07:07:58.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0340000000000002e-06 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375817+0000", 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043762574999999998 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375865+0000", 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8637000000000002e-05 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375923+0000", 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7757000000000003e-05 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46286 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6037504~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199180506000005, 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044027821000000002, 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.589 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46286 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:07:58.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332062+0000", 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332064+0000", 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2740000000000002e-06 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332073+0000", 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6719999999999993e-06 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332079+0000", 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8579999999999996e-06 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375967+0000", 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043888476000000003 2024-09-11T07:07:58.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376022+0000", 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4208e-05 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376089+0000", 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7688000000000007e-05 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46287 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6086656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199130503999996, 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044117732999999999, 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46287 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332112+0000", 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332115+0000", 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6680000000000001e-06 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332123+0000", 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3110000000000006e-06 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332129+0000", 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4230000000000002e-06 2024-09-11T07:07:58.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376121+0000", 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043991816000000003 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376171+0000", 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9540999999999999e-05 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376229+0000", 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8328999999999997e-05 2024-09-11T07:07:58.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46288 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6135808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199104149999997, 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044260648, 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46288 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7000000000000004e-07 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332141+0000", 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4449999999999999e-06 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332153+0000", 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1772e-05 2024-09-11T07:07:58.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332159+0000", 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376274+0000", 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044115170000000002 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376333+0000", 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9017000000000001e-05 2024-09-11T07:07:58.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376398+0000", 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5506999999999995e-05 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46289 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6184960~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199060777, 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044357445000000002, 2024-09-11T07:07:58.602 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46289 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332182+0000", 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3200000000000005e-07 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332184+0000", 2024-09-11T07:07:58.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332192+0000", 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332200+0000", 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3170000000000004e-06 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376431+0000", 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044230923999999998 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376479+0000", 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8072999999999999e-05 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376539+0000", 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9789e-05 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46290 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6234112~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199034169000001, 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044494765999999998, 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46290 2024-09-11T07:07:58.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0100000000000005e-07 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332211+0000", 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099999999999998e-06 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332222+0000", 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1443999999999999e-05 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332228+0000", 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376583+0000", 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044355252999999997 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376639+0000", 2024-09-11T07:07:58.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5278000000000002e-05 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376703+0000", 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3885000000000002e-05 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46291 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6283264~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.199005866999997, 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044598027999999998, 2024-09-11T07:07:58.611 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46291 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332237+0000", 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332239+0000", 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4399999999999999e-06 2024-09-11T07:07:58.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332246+0000", 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332253+0000", 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0379999999999996e-06 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376728+0000", 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044475317 2024-09-11T07:07:58.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376777+0000", 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9475999999999999e-05 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376834+0000", 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6749999999999997e-05 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46955 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9379840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.983080673000003, 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042646256, 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46955 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.616 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:07:58.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3099999999999999e-07 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548163+0000", 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.127e-06 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548166+0000", 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.179e-06 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548169+0000", 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8609999999999998e-06 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590717+0000", 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042547883000000002 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590754+0000", 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.765e-05 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590808+0000", 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3325000000000002e-05 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46956 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9428992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.983069408999995, 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042772421999999997, 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:07:58.620 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46956 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:58.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548174+0000", 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1790000000000001e-06 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:07:58.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548177+0000", 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2119999999999999e-06 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548180+0000", 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7369999999999998e-06 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590827+0000", 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042647353999999998 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:07:58.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590886+0000", 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8968999999999997e-05 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590945+0000", 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8754e-05 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:07:58.624 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:58.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:07:58.626 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:58.623+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:58.693 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:07:58.757 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:58.755+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:58.798 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:07:58.798 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:07:58.798 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:07:58.798 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:07:58.813 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:07:58.857 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:58.855+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:58.872 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:07:58.873 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:07:58.890 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:07:58.891 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:07:58.907 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:07:58.908 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:07:58.925 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:07:58.926 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:07:58.927 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:07:58.923+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:07:58.941 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:07:58.950 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:07:58.950 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:07:58.973 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:07:58.973 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:07:58.978 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:58.978 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:58.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:07:58.995 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:07:58.995 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:07:59.018 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:07:59.018 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:07:59.027 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:59.023+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:07:59.121 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:59.122 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:59.128 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:59.123+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:59.136 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:07:59.229 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:07:59.227+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:07:59.284 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:59.285 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:59.297 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:07:59.341 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:07:59.339+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:07:59.404 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:59.405 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:59.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:07:59.461 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:07:59.459+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:07:59.531 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:59.527+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:59.580 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:59.580 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:59.594 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:07:59.641 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:07:59.639+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:07:59.727 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:59.727 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:59.733 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:07:59.727+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:07:59.741 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:07:59.833 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:07:59.830+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:07:59.902 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:07:59.902 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:07:59.915 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:07:59.922 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7] out_osds: [0, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:07:59.922 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:07:59.922 INFO:tasks.thrashosds.thrasher:Reweighting osd 6 to 0.9810361520259717 2024-09-11T07:07:59.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 0.9810361520259717 2024-09-11T07:07:59.942 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:07:59.943 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:07:59.939+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:00.035 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:00.030+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:00.084 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:00.084 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:00.099 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:00.135 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:00.131+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:00.236 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:00.231+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:00.263 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:00.263 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:00.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:00.337 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:00.331+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:00.393 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:00.393 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:00.408 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:00.453 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:00.450+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:00.530 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:00.531 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:00.538 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:00.534+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:00.545 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:00.639 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:00.635+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:00.715 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:00.715 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:00.730 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:00.740 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:00.735+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:00.840 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:00.834+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:00.853 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:00.853 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:00.867 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:00.941 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.6 to 0.981036 (fb25) 2024-09-11T07:08:00.941 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:00.939+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:01.039 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:01.039 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:01.042 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:01.039+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:01.047 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:01.054 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:01.142 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:01.139+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:01.177 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:01.177 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:01.192 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:01.209 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:01.209 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:01.225 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:01.226 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:01.243 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:01.243 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:01.243 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:01.239+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:01.259 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:01.259 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:01.279 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:01.279 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:01.296 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:01.296 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:01.314 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:01.314 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:01.317 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:01.317 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:01.329 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:01.337 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:01.337 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:01.344 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:01.339+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:01.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:01.443+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:01.455 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:08:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:01.455 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 138.38284372800001, 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.456 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:08:01.457 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:08:01.458 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.459 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:08:01.460 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:01.461 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:01.462 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.956673233000004, 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.463 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:08:01.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.956617015999996, 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.467 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:01.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:08:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:08:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:08:01.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.953569854999998, 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.472 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:01.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.474 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.953516754999995, 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:08:01.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:08:01.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.953417849999994, 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.481 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.485 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.953349982000006, 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.486 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.490 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.953293447999997, 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:08:01.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:08:01.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.953240988000005, 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.495 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:08:01.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.953189359999996, 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.500 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:08:01.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.504 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.953137937999998, 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.953086843999998, 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.509 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:08:01.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.513 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.953034884000004, 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.514 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:08:01.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.952935370999995, 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.952876566, 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.952825411999996, 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:08:01.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:08:01.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:08:01.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.952769106000005, 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:01.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.536 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 96.945969590999994, 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:01.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:08:01.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 41.213899566000002, 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:01.541 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:08:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:01.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:08:01.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:01.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.548 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 40.896490518999997, 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.549 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:08:01.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:08:01.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:01.555 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:01.556 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:01.557 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:01.555+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:01.657 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:01.654+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:01.688 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:01.688 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:01.689 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:01.689 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:01.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:01.758 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:01.754+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:01.822 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:01.823 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:01.823 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:01.823 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:01.823 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:01.837 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:01.859 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:01.854+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:01.960 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:01.954+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:01.969 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:01.969 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:01.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:01.969 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:01.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.969 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:01.969 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:08:01.969 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.293554352, 2024-09-11T07:08:01.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:01.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:08:01.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:08:01.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:01.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:01.974 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.29354221200001, 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:01.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:01.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:01.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:01.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:08:01.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:01.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.980 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:01.980 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:08:01.980 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.29289126099999, 2024-09-11T07:08:01.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:08:01.980 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:01.980 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:01.980 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:01.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:01.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:01.980 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:08:01.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:08:01.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.984 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.292834365, 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.985 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:08:01.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:01.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:08:01.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:08:01.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.989 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:01.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.989 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:01.989 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.29280733100001, 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:01.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:08:01.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.290263469, 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:01.994 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:01.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:08:01.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:01.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.290241361, 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:08:01.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:08:02.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:08:02.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.290221746, 2024-09-11T07:08:02.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:02.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:08:02.007 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.29019884100001, 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.008 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:08:02.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.011 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.012 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.28982008, 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:08:02.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:08:02.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.289788578, 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.017 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.021 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.28927130300001, 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:08:02.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:08:02.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.289247174, 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.026 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:08:02.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.029 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.030 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.28923384799999, 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.031 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:08:02.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:08:02.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.28881392, 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:08:02.035 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.039 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.288786511, 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.040 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:08:02.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.041 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:02.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:02.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:08:02.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:08:02.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:08:02.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.288007507, 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:08:02.045 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 111.28290737899999, 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.050 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:02.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:08:02.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:08:02.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:08:02.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:08:02.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:08:02.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:08:02.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:08:02.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:08:02.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.055 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.055 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.055 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:08:02.055 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:02.055 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.525030045999998, 2024-09-11T07:08:02.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:08:02.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:08:02.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:08:02.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:08:02.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:02.063 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.524856232999994, 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:02.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:08:02.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:08:02.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:08:02.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:08:02.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:08:02.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:02.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.072 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:02.072 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:08:02.074 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:02.075 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:02.071+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:02.174 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:02.171+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:02.250 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:02.251 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:02.251 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:02.267 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:02.313 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:02.311+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:02.377 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:02.371+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:02.428 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:02.428 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:02.428 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:02.428 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:02.428 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:02.442 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:02.485 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:02.483+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:02.579 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:02.574+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:02.609 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:02.609 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:02.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:02.609 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:02.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46274 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5447680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.274056967999996, 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042635002999999998, 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46274 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9800000000000004e-07 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331645+0000", 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331652+0000", 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4159999999999998e-06 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331659+0000", 2024-09-11T07:08:02.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2710000000000003e-06 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374165+0000", 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042505493999999998 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374214+0000", 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8826999999999999e-05 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374277+0000", 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3145000000000006e-05 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46275 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5496832~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.274032005999999, 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042748189999999998, 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.614 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46275 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331669+0000", 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2900000000000001e-06 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331686+0000", 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6767999999999999e-05 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331693+0000", 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6599999999999998e-06 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374308+0000", 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042614919000000001 2024-09-11T07:08:02.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374355+0000", 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7166000000000002e-05 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374415+0000", 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9893999999999999e-05 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46276 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5545984~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.27399758, 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042856001999999997, 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46276 2024-09-11T07:08:02.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331702+0000", 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331704+0000", 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5629999999999999e-06 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331712+0000", 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9340000000000006e-06 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331720+0000", 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1049999999999995e-06 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374445+0000", 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042724597000000003 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374494+0000", 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9234999999999999e-05 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374557+0000", 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3058000000000005e-05 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46277 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5595136~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273947234999994, 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042946033000000002, 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46277 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331752+0000", 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2500000000000005e-07 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331755+0000", 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7e-06 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331763+0000", 2024-09-11T07:08:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-11T07:08:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331777+0000", 2024-09-11T07:08:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3749e-05 2024-09-11T07:08:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374591+0000", 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042813898000000003 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374637+0000", 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6492000000000001e-05 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374697+0000", 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0222e-05 2024-09-11T07:08:02.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46278 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5644288~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273912555999999, 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043078449999999997, 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46278 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331787+0000", 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9299999999999997e-07 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331789+0000", 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331797+0000", 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-11T07:08:02.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331804+0000", 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3010000000000001e-06 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374743+0000", 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042938538999999998 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374800+0000", 2024-09-11T07:08:02.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6637e-05 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374865+0000", 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4906999999999994e-05 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46279 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5693440~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:02.632 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273886669999996, 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043192304000000001, 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46279 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:02.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1500000000000005e-07 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331815+0000", 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4080000000000001e-06 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331822+0000", 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3359999999999997e-06 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331831+0000", 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4530000000000002e-06 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374897+0000", 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043066213999999998 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374944+0000", 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7292000000000001e-05 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375004+0000", 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0086e-05 2024-09-11T07:08:02.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46280 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5742592~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273856542000004, 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043330417000000003, 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46280 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331843+0000", 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331848+0000", 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5570000000000003e-06 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331857+0000", 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6689999999999995e-06 2024-09-11T07:08:02.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331863+0000", 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0610000000000001e-06 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375049+0000", 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043186443999999997 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375104+0000", 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4821999999999998e-05 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375172+0000", 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8371e-05 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46281 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5791744~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:02.641 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273828280000004, 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043441781999999998, 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46281 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:02.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331871+0000", 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9900000000000001e-07 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331873+0000", 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.458e-06 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331885+0000", 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1919999999999999e-05 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331891+0000", 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0950000000000001e-06 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375205+0000", 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043314084000000003 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375253+0000", 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8047000000000003e-05 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375312+0000", 2024-09-11T07:08:02.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8678999999999998e-05 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46282 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5840896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273751165999997, 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043532266999999999, 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.646 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46282 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331948+0000", 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7199999999999997e-07 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331952+0000", 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4479999999999999e-06 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331962+0000", 2024-09-11T07:08:02.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7389999999999994e-06 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331968+0000", 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6789999999999999e-06 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375357+0000", 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043388559 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375413+0000", 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5971999999999999e-05 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375480+0000", 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6997999999999998e-05 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46283 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5890048~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:02.650 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273716226000005, 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043635858999999999, 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46283 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331983+0000", 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3799999999999997e-07 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331985+0000", 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4990000000000001e-06 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331993+0000", 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9629999999999998e-06 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332003+0000", 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8199999999999992e-06 2024-09-11T07:08:02.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375512+0000", 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043508865000000001 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375560+0000", 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8004999999999999e-05 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375618+0000", 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8168999999999998e-05 2024-09-11T07:08:02.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46284 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5939200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273687839000004, 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043772483000000001, 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46284 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0699999999999997e-07 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332014+0000", 2024-09-11T07:08:02.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4619999999999999e-06 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332021+0000", 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650000000000004e-06 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332029+0000", 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-06 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375663+0000", 2024-09-11T07:08:02.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043634233000000001 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375717+0000", 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4209000000000002e-05 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375783+0000", 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6297000000000006e-05 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46285 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5988352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273661398000002, 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043885753, 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46285 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332038+0000", 2024-09-11T07:08:02.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332040+0000", 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332048+0000", 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5830000000000001e-06 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332054+0000", 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0340000000000002e-06 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375817+0000", 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043762574999999998 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375865+0000", 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8637000000000002e-05 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375923+0000", 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7757000000000003e-05 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46286 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6037504~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273637210999993, 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044027821000000002, 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.664 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46286 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332062+0000", 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332064+0000", 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2740000000000002e-06 2024-09-11T07:08:02.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332073+0000", 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6719999999999993e-06 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332079+0000", 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8579999999999996e-06 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.667 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375967+0000", 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043888476000000003 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376022+0000", 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4208e-05 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376089+0000", 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7688000000000007e-05 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.668 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46287 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6086656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273587208999999, 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044117732999999999, 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.669 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46287 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:02.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332112+0000", 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332115+0000", 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6680000000000001e-06 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332123+0000", 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3110000000000006e-06 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332129+0000", 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4230000000000002e-06 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376121+0000", 2024-09-11T07:08:02.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043991816000000003 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376171+0000", 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9540999999999999e-05 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376229+0000", 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8328999999999997e-05 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.673 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46288 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6135808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273560854999999, 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044260648, 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46288 2024-09-11T07:08:02.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:02.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7000000000000004e-07 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332141+0000", 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4449999999999999e-06 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332153+0000", 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1772e-05 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332159+0000", 2024-09-11T07:08:02.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-11T07:08:02.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376274+0000", 2024-09-11T07:08:02.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044115170000000002 2024-09-11T07:08:02.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376333+0000", 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9017000000000001e-05 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376398+0000", 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5506999999999995e-05 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46289 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6184960~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273517482000003, 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044357445000000002, 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46289 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332182+0000", 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3200000000000005e-07 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332184+0000", 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332192+0000", 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332200+0000", 2024-09-11T07:08:02.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3170000000000004e-06 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376431+0000", 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044230923999999998 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376479+0000", 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8072999999999999e-05 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376539+0000", 2024-09-11T07:08:02.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9789e-05 2024-09-11T07:08:02.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.683 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46290 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6234112~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.683 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:02.683 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273490874000004, 2024-09-11T07:08:02.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044494765999999998, 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46290 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:02.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:02.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0100000000000005e-07 2024-09-11T07:08:02.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332211+0000", 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099999999999998e-06 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332222+0000", 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1443999999999999e-05 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332228+0000", 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376583+0000", 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044355252999999997 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376639+0000", 2024-09-11T07:08:02.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5278000000000002e-05 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376703+0000", 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3885000000000002e-05 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46291 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6283264~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.688 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.273462572, 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044598027999999998, 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46291 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332237+0000", 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332239+0000", 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4399999999999999e-06 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332246+0000", 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332253+0000", 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0379999999999996e-06 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376728+0000", 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044475317 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376777+0000", 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9475999999999999e-05 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376834+0000", 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6749999999999997e-05 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46955 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9379840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.057537378000006, 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042646256, 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.693 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46955 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3099999999999999e-07 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548163+0000", 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.127e-06 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548166+0000", 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.179e-06 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548169+0000", 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8609999999999998e-06 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590717+0000", 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042547883000000002 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590754+0000", 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.765e-05 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590808+0000", 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3325000000000002e-05 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46956 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9428992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:02.697 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.057526113999998, 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042772421999999997, 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46956 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:02.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548174+0000", 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1790000000000001e-06 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548177+0000", 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2119999999999999e-06 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548180+0000", 2024-09-11T07:08:02.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7369999999999998e-06 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590827+0000", 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042647353999999998 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590886+0000", 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8968999999999997e-05 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:02.701 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:02.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590945+0000", 2024-09-11T07:08:02.702 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8754e-05 2024-09-11T07:08:02.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.702 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.702 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:02.702 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:02.702 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:02.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:02.704 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:02.699+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:02.805 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:02.802+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:02.871 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:02.872 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:02.872 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:02.872 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:02.885 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:02.906 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:02.902+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:02.965 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:08:03.006 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:03.003+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:03.019 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:03.019 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:03.019 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:03.020 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:03.020 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:03.035 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:03.108 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:03.102+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:03.203 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:03.203 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:03.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:03.203 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:03.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.203 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59289 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:head [stat,truncate 11010048] snapc 20=[20] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 62.185774731999999, 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024828697, 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59289 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015467+0000", 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6200000000000001e-06 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015483+0000", 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5962999999999999e-05 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015531+0000", 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7964999999999999e-05 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015554+0000", 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3493e-05 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015723+0000", 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169121 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016035+0000", 2024-09-11T07:08:03.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031174000000000002 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016468+0000", 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043272900000000002 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.039067+0000", 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022598894000000001 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040107+0000", 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010398860000000001 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040212+0000", 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010577399999999999 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040292+0000", 2024-09-11T07:08:03.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9511999999999994e-05 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62120 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3457024~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.402438756999999, 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011832135000000001, 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.210 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62120 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798800+0000", 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6400000000000002e-07 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798804+0000", 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0419999999999996e-06 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798813+0000", 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6870000000000006e-06 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798819+0000", 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6810000000000003e-06 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810180+0000", 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011361069999999999 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810372+0000", 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000191456 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810631+0000", 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025963499999999998 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62121 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3522560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:03.214 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.402410576999998, 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01236723, 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62121 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798828+0000", 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:08:03.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798830+0000", 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-06 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798839+0000", 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3019999999999995e-06 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798844+0000", 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2549999999999997e-06 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810713+0000", 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011869151 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810925+0000", 2024-09-11T07:08:03.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021164999999999999 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811195+0000", 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026976099999999998 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62122 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3588096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:03.219 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.402371649999999, 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012886078, 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62122 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:03.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798867+0000", 2024-09-11T07:08:03.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798870+0000", 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0630000000000002e-06 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798878+0000", 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8669999999999994e-06 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798902+0000", 2024-09-11T07:08:03.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4167000000000001e-05 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811275+0000", 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012373454000000001 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811484+0000", 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020880000000000001 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811752+0000", 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026820099999999998 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62123 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3653632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.402323271999997, 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013329191000000001, 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62123 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6300000000000004e-07 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798918+0000", 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0750000000000002e-06 2024-09-11T07:08:03.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798926+0000", 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8839999999999994e-06 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798933+0000", 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0169999999999999e-06 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811830+0000", 2024-09-11T07:08:03.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012896179000000001 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812072+0000", 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024236200000000001 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812244+0000", 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017191099999999999 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:103753 3.a 3.fa1caca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.873918453999998, 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89411045099999997, 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 103753 2024-09-11T07:08:03.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327322+0000", 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5799999999999999e-06 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327333+0000", 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.117e-05 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327355+0000", 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327367+0000", 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2242000000000001e-05 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327446+0000", 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9503000000000001e-05 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327454+0000", 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6510000000000001e-06 2024-09-11T07:08:03.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:35.221416+0000", 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89396147999999998 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:35.221430+0000", 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4338000000000001e-05 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:109788 3.a 3:562ca8e0:::rbd_data.1161dd0f3253.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 6291456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.47192373, 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012764114, 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 109788 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.234 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729318+0000", 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1060000000000002e-06 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731829+0000", 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025105679999999999 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731859+0000", 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0043e-05 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731879+0000", 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305e-05 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732019+0000", 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013981900000000001 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732286+0000", 2024-09-11T07:08:03.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026720599999999998 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732745+0000", 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045896799999999997 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741444+0000", 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086986819999999992 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:03.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741887+0000", 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044320900000000002 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741972+0000", 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5326000000000003e-05 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.742078+0000", 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105882 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.239 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:109791 3.9 e102/101 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head v 102'194, mlcod=102'192)", 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.455753817000002, 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012074544, 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745486+0000", 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.886e-06 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750110+0000", 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004624459 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750140+0000", 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9947999999999999e-05 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750161+0000", 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0449e-05 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750277+0000", 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115986 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750315+0000", 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7954000000000003e-05 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.757455+0000", 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0071403680000000002 2024-09-11T07:08:03.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.757559+0000", 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103494 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:109908 3.a 3:562ca8e0:::rbd_data.1161dd0f3253.0000000000000007:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.176013172000001, 2024-09-11T07:08:03.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047375651999999997, 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 109908 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:03.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025228+0000", 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.993e-06 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025241+0000", 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3363000000000001e-05 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025272+0000", 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0633999999999998e-05 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025305+0000", 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2821999999999998e-05 2024-09-11T07:08:03.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025442+0000", 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000137575 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025572+0000", 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012960200000000001 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:03.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.033596+0000", 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080244159999999995 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072266+0000", 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038670084 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072397+0000", 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130653 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072491+0000", 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4320000000000005e-05 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072600+0000", 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010919 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.250 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4449.0:109908 3.a e102/101 ondisk, result = 0)", 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.142073127, 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013453283, 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059167+0000", 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9989999999999998e-06 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059178+0000", 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1240000000000001e-05 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059211+0000", 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3417999999999998e-05 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059242+0000", 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0775000000000003e-05 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072352+0000", 2024-09-11T07:08:03.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013109536999999999 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072380+0000", 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7905000000000001e-05 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072618+0000", 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238409 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.254 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112577 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.236774698, 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01152213, 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112577 2024-09-11T07:08:03.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964464+0000", 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.27e-07 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964470+0000", 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3840000000000002e-06 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964478+0000", 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2989999999999997e-06 2024-09-11T07:08:03.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964483+0000", 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9559999999999996e-06 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975836+0000", 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011353221 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975904+0000", 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7229000000000003e-05 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975985+0000", 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1613999999999995e-05 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112578 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 4653056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:03.259 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.236712341, 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011630053, 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112578 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6499999999999999e-07 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964529+0000", 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964537+0000", 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7489999999999998e-06 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964543+0000", 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9070000000000004e-06 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976015+0000", 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011472141999999999 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976077+0000", 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2373999999999996e-05 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976156+0000", 2024-09-11T07:08:03.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8547999999999994e-05 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112579 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 5177344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.236687466999999, 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011724089, 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.264 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112579 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964551+0000", 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3600000000000004e-07 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964553+0000", 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2419999999999999e-06 2024-09-11T07:08:03.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964560+0000", 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3409999999999999e-06 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964565+0000", 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976180+0000", 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011615122 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976221+0000", 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1115000000000002e-05 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976275+0000", 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3507000000000001e-05 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.268 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112580 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.236665973999999, 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011867212, 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.269 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112580 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1199999999999998e-07 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964574+0000", 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.013e-06 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964581+0000", 2024-09-11T07:08:03.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1019999999999999e-06 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964587+0000", 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6289999999999998e-06 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976300+0000", 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011712854999999999 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976361+0000", 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0788000000000001e-05 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976439+0000", 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8412999999999996e-05 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112581 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:03.273 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.236643841999999, 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012017570999999999, 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112581 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6699999999999999e-07 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964597+0000", 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1040000000000001e-06 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964603+0000", 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0419999999999999e-06 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964608+0000", 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9439999999999996e-06 2024-09-11T07:08:03.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976465+0000", 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01185747 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976527+0000", 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2198000000000003e-05 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976612+0000", 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4445999999999998e-05 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112582 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 6750208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.236623653000001, 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012177538999999999, 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.278 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112582 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964615+0000", 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3300000000000003e-07 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964617+0000", 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0090000000000002e-06 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964623+0000", 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0109999999999997e-06 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964627+0000", 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7949999999999998e-06 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976641+0000", 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012013642 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976707+0000", 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5747000000000006e-05 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976792+0000", 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4901999999999995e-05 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112583 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.236604010000001, 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012338040999999999, 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112583 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9999999999999998e-07 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964636+0000", 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964642+0000", 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0970000000000002e-06 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964654+0000", 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1616e-05 2024-09-11T07:08:03.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976820+0000", 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012165924999999999 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976884+0000", 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3818000000000005e-05 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976972+0000", 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8184999999999997e-05 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112584 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.236575954999999, 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012480952999999999, 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.287 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112584 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7e-07 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964665+0000", 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3590000000000002e-06 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964671+0000", 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3169999999999998e-06 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964676+0000", 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1120000000000004e-06 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977003+0000", 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012326467000000001 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977069+0000", 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6172000000000003e-05 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977143+0000", 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4055999999999997e-05 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112585 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:03.291 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.236554603, 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012584098, 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112585 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964684+0000", 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7599999999999997e-07 2024-09-11T07:08:03.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964686+0000", 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.131e-06 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964692+0000", 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2360000000000001e-06 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964697+0000", 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.967e-06 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977169+0000", 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01247183 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977224+0000", 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4632999999999997e-05 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977267+0000", 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3724999999999999e-05 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:113546 3.9 3:95ef5f75:::rbd_data.1161428332f9.0000000000000020:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 14.349846031, 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019568058999999999, 2024-09-11T07:08:03.296 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 113546 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851395+0000", 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.853e-06 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851410+0000", 2024-09-11T07:08:03.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5259000000000001e-05 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851445+0000", 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5048000000000001e-05 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851469+0000", 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3555999999999999e-05 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851597+0000", 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000128594 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851838+0000", 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240941 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.855619+0000", 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037808859999999998 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870762+0000", 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015143115 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870793+0000", 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0525000000000003e-05 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870882+0000", 2024-09-11T07:08:03.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9159000000000005e-05 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870960+0000", 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8122999999999997e-05 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:03.302 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:03.304 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:03.304 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:03.299+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:03.355 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:08:03.438 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:03.435+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:03.474 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:03.474 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:03.475 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:03.475 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:03.489 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:03.531 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:03.531 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:03.531 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:03.527+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:03.606 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:03.603+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:03.644 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:03.644 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:03.644 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:03.645 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:03.645 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:03.658 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:03.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:03.703+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:03.766 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:03.767 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:03.783 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:03.784 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:03.801 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:03.801 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:03.806 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:03.803+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:03.824 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:03.825 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:03.840 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:03.840 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:03.847 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:03.847 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:03.854 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:03.870 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:03.870 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:03.892 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:03.892 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:03.907 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:03.903+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:03.986 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:03.986 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:04.005 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:04.007 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:04.002+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:04.108 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:04.102+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:04.130 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:04.130 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:04.144 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:04.229 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:04.226+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:04.310 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:04.306+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:04.313 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:04.313 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:04.327 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:04.413 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:04.410+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:04.492 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:04.492 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:04.505 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:04.514 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:04.511+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:04.617 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:04.615+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:04.670 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:04.670 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:04.685 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:04.718 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:04.715+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:04.802 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:04.802 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:04.816 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:04.818 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:04.814+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:04.918 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:04.915+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:04.935 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:04.936 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:04.951 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:04.994 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:08:05.019 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:05.014+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:05.084 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:05.084 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:05.099 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:05.141 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:05.138+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:05.221 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:05.218+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:05.262 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:05.263 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:05.276 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:05.322 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:05.319+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:05.423 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:05.419+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:05.441 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:05.441 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:05.455 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:05.524 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:05.519+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:05.578 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:05.578 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:05.592 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:05.637 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:05.634+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:05.708 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:05.709 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:05.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:05.725 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:05.723+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:05.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:05.823+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:05.853 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:05.854 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:05.868 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:05.910 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:05.927 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:05.922+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:05.977 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7] out_osds: [0, 4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:08:05.977 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:08:05.977 INFO:tasks.thrashosds.thrasher:Adding osd 0 2024-09-11T07:08:05.977 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 0 2024-09-11T07:08:05.999 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:08:06.028 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:06.022+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:06.048 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:06.048 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:06.067 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:06.071 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:06.072 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:06.090 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:06.091 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:06.111 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:06.111 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:06.129 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:06.126+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:06.137 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:06.137 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:06.172 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:06.173 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:06.195 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:06.195 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:06.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:06.195 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:06.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.195 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6983 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6864896~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.195 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:08:06.195 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.521903713, 2024-09-11T07:08:06.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049378788, 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6983 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671231+0000", 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5400000000000002e-07 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671233+0000", 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7540000000000001e-06 2024-09-11T07:08:06.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671237+0000", 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8700000000000002e-06 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671239+0000", 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.773e-06 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720518+0000", 2024-09-11T07:08:06.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049278359000000001 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720561+0000", 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3282999999999999e-05 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720610+0000", 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8495000000000002e-05 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.199 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.521891573, 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.201 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6986 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7208960~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.52124062199999, 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049292590999999997, 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.204 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6986 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671894+0000", 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7899999999999999e-07 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671897+0000", 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671904+0000", 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3490000000000003e-06 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671918+0000", 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3534e-05 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721047+0000", 2024-09-11T07:08:06.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049128672999999998 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721117+0000", 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0166000000000005e-05 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721186+0000", 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9622000000000005e-05 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6987 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7847936~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.521183726, 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049405155999999999, 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6987 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.209 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671951+0000", 2024-09-11T07:08:06.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671954+0000", 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.022e-06 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671963+0000", 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5269999999999998e-06 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671969+0000", 2024-09-11T07:08:06.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6540000000000004e-06 2024-09-11T07:08:06.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721214+0000", 2024-09-11T07:08:06.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049245852999999999 2024-09-11T07:08:06.212 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.212 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.212 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721289+0000", 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4221000000000006e-05 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721356+0000", 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7249000000000006e-05 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.52115669200001, 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:08:06.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7094 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2195456~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.218 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.51861283, 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049348159000000003, 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7094 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674522+0000", 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0499999999999999e-07 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674525+0000", 2024-09-11T07:08:06.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6220000000000001e-06 2024-09-11T07:08:06.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674531+0000", 2024-09-11T07:08:06.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7179999999999999e-06 2024-09-11T07:08:06.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674536+0000", 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8400000000000002e-06 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723710+0000", 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049173809999999998 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723781+0000", 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0757e-05 2024-09-11T07:08:06.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723870+0000", 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9006999999999997e-05 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.518590722, 2024-09-11T07:08:06.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:06.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.227 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.518571107, 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:08:06.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.232 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.51854820200001, 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.518169441, 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.237 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:08:06.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.241 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.518137939, 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:08:06.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.51762066400001, 2024-09-11T07:08:06.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:08:06.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.250 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.517596535, 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.251 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:08:06.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:08:06.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.51758320899999, 2024-09-11T07:08:06.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:08:06.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.260 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.260 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.260 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:06.260 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.51716328099999, 2024-09-11T07:08:06.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:08:06.260 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:08:06.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:08:06.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:08:06.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:08:06.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:08:06.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.517135872, 2024-09-11T07:08:06.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:08:06.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:08:06.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7107 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 5259264~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.516356868, 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049416136999999999, 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.270 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7107 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.271 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676778+0000", 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677343+0000", 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00056545499999999997 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677348+0000", 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3770000000000004e-06 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677359+0000", 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0601000000000001e-05 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.677367+0000", 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6879999999999999e-06 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726063+0000", 2024-09-11T07:08:06.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048696152999999999 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726130+0000", 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7506e-05 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.726194+0000", 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3356999999999997e-05 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.274 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 115.51125673999999, 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.275 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:08:06.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.279 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:08:06.280 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:06.280 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.753379406999997, 2024-09-11T07:08:06.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:08:06.280 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.280 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.280 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:06.280 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.280 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.280 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.280 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:08:06.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:06.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:08:06.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:06.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.287 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.753205593999994, 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:08:06.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:08:06.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:08:06.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:08:06.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:08:06.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:06.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:08:06.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:08:06.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:08:06.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:08:06.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.295 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.296 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.296 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.296 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:06.297 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:06.297 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:06.298 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:06.298 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:06.299 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:06.299 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:06.300 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:06.300 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:06.294+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:06.353 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-11T07:08:06.351+0000 7f4290681640 -1 mon.a@0(leader).osd e126 definitely_dead 0 2024-09-11T07:08:06.398 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:06.395+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:06.451 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:06.451 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:06.451 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:06.464 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:06.499 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:06.494+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:06.600 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:06.595+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:06.619 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:06.619 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:06.632 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:06.701 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:06.698+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:06.798 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:06.798 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:06.798 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:06.798 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:06.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.798 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46274 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5447680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.798 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:06.798 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462990364999996, 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042635002999999998, 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46274 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:06.799 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9800000000000004e-07 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.800 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331645+0000", 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331652+0000", 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4159999999999998e-06 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331659+0000", 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2710000000000003e-06 2024-09-11T07:08:06.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374165+0000", 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042505493999999998 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374214+0000", 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8826999999999999e-05 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.802 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374277+0000", 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3145000000000006e-05 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46275 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5496832~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462965402999998, 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042748189999999998, 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.803 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46275 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.804 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331669+0000", 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2900000000000001e-06 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331686+0000", 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6767999999999999e-05 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331693+0000", 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6599999999999998e-06 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374308+0000", 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042614919000000001 2024-09-11T07:08:06.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374355+0000", 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7166000000000002e-05 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374415+0000", 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9893999999999999e-05 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.807 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46276 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5545984~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462930976999999, 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042856001999999997, 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46276 2024-09-11T07:08:06.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.809 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.809 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331702+0000", 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:08:06.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331704+0000", 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5629999999999999e-06 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331712+0000", 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9340000000000006e-06 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.811 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331720+0000", 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1049999999999995e-06 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374445+0000", 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042724597000000003 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374494+0000", 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9234999999999999e-05 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374557+0000", 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3058000000000005e-05 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46277 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5595136~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462880631999994, 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042946033000000002, 2024-09-11T07:08:06.813 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46277 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.814 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331752+0000", 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2500000000000005e-07 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.815 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331755+0000", 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7e-06 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331763+0000", 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331777+0000", 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3749e-05 2024-09-11T07:08:06.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374591+0000", 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042813898000000003 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374637+0000", 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6492000000000001e-05 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.817 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374697+0000", 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0222e-05 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46278 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5644288~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462845952999999, 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043078449999999997, 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.818 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46278 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331787+0000", 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9299999999999997e-07 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331789+0000", 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331797+0000", 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331804+0000", 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3010000000000001e-06 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374743+0000", 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042938538999999998 2024-09-11T07:08:06.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374800+0000", 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6637e-05 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374865+0000", 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4906999999999994e-05 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46279 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5693440~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462820066999996, 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043192304000000001, 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46279 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.823 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1500000000000005e-07 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331815+0000", 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4080000000000001e-06 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331822+0000", 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3359999999999997e-06 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331831+0000", 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4530000000000002e-06 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374897+0000", 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043066213999999998 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374944+0000", 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7292000000000001e-05 2024-09-11T07:08:06.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375004+0000", 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0086e-05 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46280 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5742592~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462789939000004, 2024-09-11T07:08:06.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043330417000000003, 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46280 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331843+0000", 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331848+0000", 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5570000000000003e-06 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331857+0000", 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6689999999999995e-06 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331863+0000", 2024-09-11T07:08:06.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0610000000000001e-06 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375049+0000", 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043186443999999997 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375104+0000", 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4821999999999998e-05 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375172+0000", 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8371e-05 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46281 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5791744~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462761677000003, 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043441781999999998, 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.832 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46281 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331871+0000", 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9900000000000001e-07 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331873+0000", 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.458e-06 2024-09-11T07:08:06.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331885+0000", 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1919999999999999e-05 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331891+0000", 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0950000000000001e-06 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375205+0000", 2024-09-11T07:08:06.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043314084000000003 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375253+0000", 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8047000000000003e-05 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375312+0000", 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8678999999999998e-05 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46282 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5840896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462684562999996, 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043532266999999999, 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46282 2024-09-11T07:08:06.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331948+0000", 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7199999999999997e-07 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331952+0000", 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4479999999999999e-06 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331962+0000", 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7389999999999994e-06 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331968+0000", 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6789999999999999e-06 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375357+0000", 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043388559 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375413+0000", 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5971999999999999e-05 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375480+0000", 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6997999999999998e-05 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46283 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5890048~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462649623000004, 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043635858999999999, 2024-09-11T07:08:06.841 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46283 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331983+0000", 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3799999999999997e-07 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331985+0000", 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4990000000000001e-06 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331993+0000", 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9629999999999998e-06 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332003+0000", 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8199999999999992e-06 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375512+0000", 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043508865000000001 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375560+0000", 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8004999999999999e-05 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375618+0000", 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8168999999999998e-05 2024-09-11T07:08:06.845 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46284 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5939200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462621236000004, 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043772483000000001, 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.846 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46284 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0699999999999997e-07 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332014+0000", 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4619999999999999e-06 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332021+0000", 2024-09-11T07:08:06.848 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650000000000004e-06 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332029+0000", 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-06 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375663+0000", 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043634233000000001 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375717+0000", 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4209000000000002e-05 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375783+0000", 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6297000000000006e-05 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46285 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5988352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.850 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462594795000001, 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043885753, 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46285 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332038+0000", 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332040+0000", 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332048+0000", 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5830000000000001e-06 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332054+0000", 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0340000000000002e-06 2024-09-11T07:08:06.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375817+0000", 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043762574999999998 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375865+0000", 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8637000000000002e-05 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375923+0000", 2024-09-11T07:08:06.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7757000000000003e-05 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46286 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6037504~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462570607999993, 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044027821000000002, 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46286 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332062+0000", 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332064+0000", 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2740000000000002e-06 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332073+0000", 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6719999999999993e-06 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332079+0000", 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8579999999999996e-06 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375967+0000", 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043888476000000003 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376022+0000", 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4208e-05 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376089+0000", 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7688000000000007e-05 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46287 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6086656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.859 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462520605999998, 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044117732999999999, 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46287 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.860 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332112+0000", 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:08:06.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332115+0000", 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6680000000000001e-06 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332123+0000", 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3110000000000006e-06 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332129+0000", 2024-09-11T07:08:06.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4230000000000002e-06 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376121+0000", 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043991816000000003 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376171+0000", 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9540999999999999e-05 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376229+0000", 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8328999999999997e-05 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46288 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6135808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462494251999999, 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044260648, 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.864 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46288 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.865 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7000000000000004e-07 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332141+0000", 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4449999999999999e-06 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332153+0000", 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1772e-05 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332159+0000", 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376274+0000", 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044115170000000002 2024-09-11T07:08:06.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376333+0000", 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9017000000000001e-05 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376398+0000", 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5506999999999995e-05 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46289 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6184960~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462450879000002, 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044357445000000002, 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.869 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46289 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332182+0000", 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3200000000000005e-07 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332184+0000", 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332192+0000", 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-11T07:08:06.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332200+0000", 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3170000000000004e-06 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376431+0000", 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044230923999999998 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376479+0000", 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8072999999999999e-05 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376539+0000", 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9789e-05 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46290 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6234112~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.873 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462424271000003, 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044494765999999998, 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46290 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0100000000000005e-07 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332211+0000", 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099999999999998e-06 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332222+0000", 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1443999999999999e-05 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332228+0000", 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376583+0000", 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044355252999999997 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376639+0000", 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5278000000000002e-05 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376703+0000", 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3885000000000002e-05 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46291 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6283264~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.462395968999999, 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044598027999999998, 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.878 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46291 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332237+0000", 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332239+0000", 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4399999999999999e-06 2024-09-11T07:08:06.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332246+0000", 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332253+0000", 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0379999999999996e-06 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376728+0000", 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044475317 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376777+0000", 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9475999999999999e-05 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376834+0000", 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6749999999999997e-05 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.882 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46955 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9379840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.246470775000006, 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042646256, 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.883 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46955 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3099999999999999e-07 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548163+0000", 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.127e-06 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548166+0000", 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.179e-06 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548169+0000", 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8609999999999998e-06 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590717+0000", 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042547883000000002 2024-09-11T07:08:06.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590754+0000", 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.765e-05 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590808+0000", 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3325000000000002e-05 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46956 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9428992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.246459510999998, 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042772421999999997, 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46956 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.888 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:06.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548174+0000", 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1790000000000001e-06 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548177+0000", 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2119999999999999e-06 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548180+0000", 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7369999999999998e-06 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590827+0000", 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042647353999999998 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590886+0000", 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8968999999999997e-05 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:06.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590945+0000", 2024-09-11T07:08:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8754e-05 2024-09-11T07:08:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:06.892 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:06.892 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:06.894 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:06.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:06.891+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:06.995 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:06.990+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:07.006 INFO:teuthology.orchestra.run.smithi079.stderr:marked in osd.0. 2024-09-11T07:08:07.037 INFO:tasks.thrashosds.thrasher:Added osd 0 2024-09-11T07:08:07.073 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:07.073 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:07.073 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:07.073 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:07.086 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:07.096 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:07.090+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:07.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:07.191+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:07.399 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:07.399 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:07.399 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:07.399 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:07.399 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:07.399 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:07.400 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:07.394+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:07.500 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:07.495+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:07.567 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:07.567 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:07.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:07.567 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:07.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.567 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59289 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:head [stat,truncate 11010048] snapc 20=[20] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:07.567 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 66.548300834000003, 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024828697, 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59289 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015467+0000", 2024-09-11T07:08:07.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6200000000000001e-06 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015483+0000", 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5962999999999999e-05 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015531+0000", 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7964999999999999e-05 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015554+0000", 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3493e-05 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015723+0000", 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169121 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016035+0000", 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031174000000000002 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016468+0000", 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043272900000000002 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.039067+0000", 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022598894000000001 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040107+0000", 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010398860000000001 2024-09-11T07:08:07.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040212+0000", 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010577399999999999 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040292+0000", 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9511999999999994e-05 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62120 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3457024~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.764964859000003, 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011832135000000001, 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62120 2024-09-11T07:08:07.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798800+0000", 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6400000000000002e-07 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798804+0000", 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0419999999999996e-06 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798813+0000", 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6870000000000006e-06 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798819+0000", 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6810000000000003e-06 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810180+0000", 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011361069999999999 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810372+0000", 2024-09-11T07:08:07.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000191456 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810631+0000", 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025963499999999998 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62121 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3522560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:07.578 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.764936679000002, 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01236723, 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62121 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:07.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798828+0000", 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798830+0000", 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-06 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798839+0000", 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3019999999999995e-06 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798844+0000", 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2549999999999997e-06 2024-09-11T07:08:07.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810713+0000", 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011869151 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810925+0000", 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021164999999999999 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811195+0000", 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026976099999999998 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62122 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3588096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.764897751999996, 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012886078, 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.583 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62122 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798867+0000", 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798870+0000", 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0630000000000002e-06 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798878+0000", 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8669999999999994e-06 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798902+0000", 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4167000000000001e-05 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811275+0000", 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012373454000000001 2024-09-11T07:08:07.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811484+0000", 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020880000000000001 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811752+0000", 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026820099999999998 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.587 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62123 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3653632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.764849373999994, 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013329191000000001, 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.588 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62123 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6300000000000004e-07 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798918+0000", 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0750000000000002e-06 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798926+0000", 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8839999999999994e-06 2024-09-11T07:08:07.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798933+0000", 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0169999999999999e-06 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811830+0000", 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012896179000000001 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812072+0000", 2024-09-11T07:08:07.591 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024236200000000001 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812244+0000", 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017191099999999999 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:103753 3.a 3.fa1caca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:07.592 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.236444556000002, 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89411045099999997, 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 103753 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:07.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327322+0000", 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5799999999999999e-06 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327333+0000", 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.117e-05 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327355+0000", 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327367+0000", 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2242000000000001e-05 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327446+0000", 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9503000000000001e-05 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327454+0000", 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6510000000000001e-06 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:35.221416+0000", 2024-09-11T07:08:07.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89396147999999998 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:35.221430+0000", 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4338000000000001e-05 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:109788 3.a 3:562ca8e0:::rbd_data.1161dd0f3253.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 6291456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.834449832000001, 2024-09-11T07:08:07.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012764114, 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 109788 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:07.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729318+0000", 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1060000000000002e-06 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731829+0000", 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025105679999999999 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731859+0000", 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0043e-05 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731879+0000", 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305e-05 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732019+0000", 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013981900000000001 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732286+0000", 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026720599999999998 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732745+0000", 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045896799999999997 2024-09-11T07:08:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741444+0000", 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086986819999999992 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741887+0000", 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044320900000000002 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:07.602 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741972+0000", 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5326000000000003e-05 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.742078+0000", 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105882 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:109791 3.9 e102/101 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head v 102'194, mlcod=102'192)", 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:07.603 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.818279918999998, 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012074544, 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745486+0000", 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.886e-06 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750110+0000", 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004624459 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750140+0000", 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9947999999999999e-05 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750161+0000", 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0449e-05 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750277+0000", 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115986 2024-09-11T07:08:07.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750315+0000", 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7954000000000003e-05 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.757455+0000", 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0071403680000000002 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.757559+0000", 2024-09-11T07:08:07.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103494 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:109908 3.a 3:562ca8e0:::rbd_data.1161dd0f3253.0000000000000007:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.538539274000001, 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047375651999999997, 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:07.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 109908 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025228+0000", 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.993e-06 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025241+0000", 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3363000000000001e-05 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025272+0000", 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0633999999999998e-05 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025305+0000", 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2821999999999998e-05 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025442+0000", 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000137575 2024-09-11T07:08:07.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025572+0000", 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012960200000000001 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.033596+0000", 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080244159999999995 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:07.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072266+0000", 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038670084 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072397+0000", 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130653 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072491+0000", 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4320000000000005e-05 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072600+0000", 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010919 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4449.0:109908 3.a e102/101 ondisk, result = 0)", 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.504599229, 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013453283, 2024-09-11T07:08:07.614 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059167+0000", 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9989999999999998e-06 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059178+0000", 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1240000000000001e-05 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059211+0000", 2024-09-11T07:08:07.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3417999999999998e-05 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059242+0000", 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0775000000000003e-05 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072352+0000", 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013109536999999999 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.617 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072380+0000", 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7905000000000001e-05 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072618+0000", 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238409 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112577 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:07.618 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.599300800000002, 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01152213, 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112577 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964464+0000", 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.27e-07 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964470+0000", 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3840000000000002e-06 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964478+0000", 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2989999999999997e-06 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964483+0000", 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9559999999999996e-06 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975836+0000", 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011353221 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975904+0000", 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7229000000000003e-05 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975985+0000", 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1613999999999995e-05 2024-09-11T07:08:07.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112578 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 4653056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.599238443000001, 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011630053, 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112578 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6499999999999999e-07 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964529+0000", 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964537+0000", 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7489999999999998e-06 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964543+0000", 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9070000000000004e-06 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976015+0000", 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011472141999999999 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976077+0000", 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2373999999999996e-05 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976156+0000", 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8547999999999994e-05 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112579 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 5177344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.599213569, 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011724089, 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112579 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964551+0000", 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3600000000000004e-07 2024-09-11T07:08:07.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964553+0000", 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2419999999999999e-06 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964560+0000", 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3409999999999999e-06 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964565+0000", 2024-09-11T07:08:07.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976180+0000", 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011615122 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976221+0000", 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1115000000000002e-05 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976275+0000", 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3507000000000001e-05 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112580 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.599192076000001, 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011867212, 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112580 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1199999999999998e-07 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964574+0000", 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.013e-06 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964581+0000", 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1019999999999999e-06 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964587+0000", 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6289999999999998e-06 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976300+0000", 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011712854999999999 2024-09-11T07:08:07.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976361+0000", 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0788000000000001e-05 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976439+0000", 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8412999999999996e-05 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112581 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.599169944, 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012017570999999999, 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112581 2024-09-11T07:08:07.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6699999999999999e-07 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964597+0000", 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1040000000000001e-06 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964603+0000", 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0419999999999999e-06 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964608+0000", 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9439999999999996e-06 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976465+0000", 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01185747 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976527+0000", 2024-09-11T07:08:07.640 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2198000000000003e-05 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976612+0000", 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4445999999999998e-05 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112582 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 6750208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.599149754999999, 2024-09-11T07:08:07.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012177538999999999, 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112582 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964615+0000", 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3300000000000003e-07 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964617+0000", 2024-09-11T07:08:07.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0090000000000002e-06 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964623+0000", 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0109999999999997e-06 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964627+0000", 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7949999999999998e-06 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976641+0000", 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012013642 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976707+0000", 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5747000000000006e-05 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976792+0000", 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4901999999999995e-05 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.645 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112583 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.599130112000001, 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012338040999999999, 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.646 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112583 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9999999999999998e-07 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964636+0000", 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964642+0000", 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0970000000000002e-06 2024-09-11T07:08:07.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964654+0000", 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1616e-05 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976820+0000", 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012165924999999999 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976884+0000", 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3818000000000005e-05 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976972+0000", 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8184999999999997e-05 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112584 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:07.650 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.599102057, 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012480952999999999, 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112584 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:07.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7e-07 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.652 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964665+0000", 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3590000000000002e-06 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964671+0000", 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3169999999999998e-06 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964676+0000", 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1120000000000004e-06 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977003+0000", 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012326467000000001 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977069+0000", 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6172000000000003e-05 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977143+0000", 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4055999999999997e-05 2024-09-11T07:08:07.654 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112585 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.599080704999999, 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012584098, 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.655 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112585 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964684+0000", 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7599999999999997e-07 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964686+0000", 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.131e-06 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964692+0000", 2024-09-11T07:08:07.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2360000000000001e-06 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964697+0000", 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.967e-06 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977169+0000", 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01247183 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977224+0000", 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4632999999999997e-05 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977267+0000", 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3724999999999999e-05 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:113546 3.9 3:95ef5f75:::rbd_data.1161428332f9.0000000000000020:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:07.659 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 18.712372132999999, 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019568058999999999, 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 113546 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:07.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851395+0000", 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.853e-06 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851410+0000", 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5259000000000001e-05 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851445+0000", 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5048000000000001e-05 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851469+0000", 2024-09-11T07:08:07.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3555999999999999e-05 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851597+0000", 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000128594 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851838+0000", 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240941 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-11T07:08:07.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.855619+0000", 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037808859999999998 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870762+0000", 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015143115 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870793+0000", 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0525000000000003e-05 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870882+0000", 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9159000000000005e-05 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870960+0000", 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8122999999999997e-05 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:07.665 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:07.667 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:07.667 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:07.662+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:07.768 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:07.763+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:07.836 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:07.836 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:07.836 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:07.836 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:07.851 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:07.869 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:07.862+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:07.970 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:07.967+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:08.022 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:08.022 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:08.022 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:08.022 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:08.023 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:08.031 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:08:08.045 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:08.089 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:08.087+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:08.172 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:08.167+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:08.212 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:08.212 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:08.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:08.212 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:08.212 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.212 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:08:08.212 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:08.212 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 90.585566482000004, 2024-09-11T07:08:08.212 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:08:08.212 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.213 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:08:08.214 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.215 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.216 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:08:08.217 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59115 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 67.198964928999999, 2024-09-11T07:08:08.218 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038255633999999997, 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59115 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:08.219 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010877+0000", 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.083e-06 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.220 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010885+0000", 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0400000000000004e-06 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010931+0000", 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6452000000000002e-05 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010947+0000", 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5786000000000001e-05 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.221 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049022+0000", 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038075472999999999 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049076+0000", 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4131000000000001e-05 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049132+0000", 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5668999999999998e-05 2024-09-11T07:08:08.222 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59119 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 67.198873278999997, 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038492673999999998, 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.223 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59119 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.224 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010969+0000", 2024-09-11T07:08:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:08:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010976+0000", 2024-09-11T07:08:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4529999999999999e-06 2024-09-11T07:08:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.225 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010994+0000", 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8672999999999999e-05 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011009+0000", 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4122e-05 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049189+0000", 2024-09-11T07:08:08.226 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038180218000000002 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049342+0000", 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015341899999999999 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049461+0000", 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118522 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.227 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59138 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 67.198814463999994, 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038631255000000003, 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59138 2024-09-11T07:08:08.228 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.229 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011028+0000", 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011034+0000", 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011049+0000", 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5702999999999999e-05 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.230 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011063+0000", 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3373000000000001e-05 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049512+0000", 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038449050999999998 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049601+0000", 2024-09-11T07:08:08.231 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9395999999999996e-05 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049658+0000", 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6861999999999999e-05 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59147 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:08.232 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 67.198575782000006, 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038436533000000002, 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59147 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.233 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011267+0000", 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.46e-06 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.234 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011278+0000", 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.119e-05 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011457+0000", 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017874699999999999 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011481+0000", 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4283000000000001e-05 2024-09-11T07:08:08.235 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049693+0000", 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038212053000000003 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049702+0000", 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.236 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59148 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 67.198318603999994, 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038227694999999999, 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59148 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.237 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011525+0000", 2024-09-11T07:08:08.238 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011536+0000", 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011561+0000", 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5494999999999999e-05 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.239 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011579+0000", 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7292999999999999e-05 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049739+0000", 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038159803999999999 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049750+0000", 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.240 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59149 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 67.198237293000005, 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038196747000000003, 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.241 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59149 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.242 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011605+0000", 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011614+0000", 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3219999999999993e-06 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011634+0000", 2024-09-11T07:08:08.243 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0703000000000002e-05 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011649+0000", 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4603000000000001e-05 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049788+0000", 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038138500999999998 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.244 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.245 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.245 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049801+0000", 2024-09-11T07:08:08.245 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3244000000000001e-05 2024-09-11T07:08:08.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.245 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.245 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.245 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.245 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.245 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59150 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:08.245 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 67.198171271999996, 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038171956999999999, 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59150 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.246 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011671+0000", 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.247 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011678+0000", 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011696+0000", 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-05 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011710+0000", 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3516000000000001e-05 2024-09-11T07:08:08.248 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049835+0000", 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038125004999999997 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049842+0000", 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0299999999999996e-06 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59154 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 67.197935563000001, 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038170655999999997, 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59154 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.250 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011907+0000", 2024-09-11T07:08:08.251 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1739999999999999e-06 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011974+0000", 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7200999999999996e-05 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011995+0000", 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1058999999999999e-05 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.252 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012015+0000", 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9857e-05 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050060+0000", 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038045074999999998 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050076+0000", 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6290000000000002e-05 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.253 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:70560 3.2 3:459eba64:::rbd_data.11618cc4d69.000000000000003a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 52.749704958999999, 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064825956000000004, 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 70560 2024-09-11T07:08:08.254 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460139+0000", 2024-09-11T07:08:08.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460150+0000", 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0824e-05 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460178+0000", 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8449000000000002e-05 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460199+0000", 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1075999999999999e-05 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460319+0000", 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119714 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460451+0000", 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013264 2024-09-11T07:08:08.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.472543+0000", 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091437 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524779+0000", 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052236339 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524853+0000", 2024-09-11T07:08:08.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524913+0000", 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0825000000000001e-05 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524962+0000", 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8999999999999998e-05 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71632 3.18 3:194b1b54:::rbd_data.1161b94a6d64.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 48.767447633000003, 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039963481000000002, 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71632 2024-09-11T07:08:08.260 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.261 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442395+0000", 2024-09-11T07:08:08.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-11T07:08:08.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.262 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442403+0000", 2024-09-11T07:08:08.262 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6210000000000004e-06 2024-09-11T07:08:08.262 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.262 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.262 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442416+0000", 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3011e-05 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442422+0000", 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2620000000000004e-06 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442495+0000", 2024-09-11T07:08:08.263 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2977000000000003e-05 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442647+0000", 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015205199999999999 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.450708+0000", 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080612589999999994 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.264 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482090+0000", 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031381543999999997 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482176+0000", 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6302000000000001e-05 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482279+0000", 2024-09-11T07:08:08.265 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010242399999999999 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482357+0000", 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8565000000000004e-05 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73806 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14024704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.627040807999997, 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038245594000000001, 2024-09-11T07:08:08.266 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73806 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.267 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582804+0000", 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.836e-06 2024-09-11T07:08:08.268 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582813+0000", 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030000000000003e-06 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582820+0000", 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9e-06 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.269 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620766+0000", 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037946800000000003 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620895+0000", 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012861799999999999 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.270 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621046+0000", 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015100700000000001 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73807 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14417920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.627013106, 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038841537000000002, 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.271 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73807 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.272 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582829+0000", 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582857+0000", 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.779e-05 2024-09-11T07:08:08.273 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582874+0000", 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7584999999999999e-05 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582882+0000", 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7999999999999999e-06 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.274 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621135+0000", 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038253044 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621390+0000", 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000254689 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621670+0000", 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027999500000000001 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.275 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73808 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14811136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.626948046999999, 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039162267000000001, 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73808 2024-09-11T07:08:08.276 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582894+0000", 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582897+0000", 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4240000000000002e-06 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582907+0000", 2024-09-11T07:08:08.278 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4299999999999995e-06 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582919+0000", 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1826e-05 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621769+0000", 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038850735999999997 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.279 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621898+0000", 2024-09-11T07:08:08.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012898099999999999 2024-09-11T07:08:08.280 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.280 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.280 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.280 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622056+0000", 2024-09-11T07:08:08.280 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015718000000000001 2024-09-11T07:08:08.280 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73809 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15204352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.626913930999997, 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039738290000000002, 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.281 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73809 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582928+0000", 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9999999999999997e-07 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582932+0000", 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8029999999999998e-06 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.283 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582947+0000", 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5099999999999999e-05 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582959+0000", 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.206e-05 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622144+0000", 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039184999999999998 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.284 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622390+0000", 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024606600000000003 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622666+0000", 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027566100000000002 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.285 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73810 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15597568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.626865232, 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040289497000000001, 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73810 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.286 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582977+0000", 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0100000000000001e-06 2024-09-11T07:08:08.287 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582983+0000", 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583000+0000", 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7237000000000001e-05 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583014+0000", 2024-09-11T07:08:08.288 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4076999999999999e-05 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622759+0000", 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039744806000000001 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622998+0000", 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000239385 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.289 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623266+0000", 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026730900000000003 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73811 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15990784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.626809213000001, 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040666513000000001, 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.290 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73811 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:08.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583033+0000", 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.037e-06 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583039+0000", 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583079+0000", 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0438999999999997e-05 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583092+0000", 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2367e-05 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623365+0000", 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040273182999999997 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623518+0000", 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015322099999999999 2024-09-11T07:08:08.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623699+0000", 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018055299999999999 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73812 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 16384000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.626736833999999, 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041168972999999998, 2024-09-11T07:08:08.295 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73812 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583109+0000", 2024-09-11T07:08:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1799999999999998e-06 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583120+0000", 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0380000000000001e-05 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583127+0000", 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.029e-06 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623766+0000", 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040639210000000002 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624006+0000", 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240466 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624273+0000", 2024-09-11T07:08:08.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026699100000000001 2024-09-11T07:08:08.300 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.300 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.300 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.300 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:74137 3.1 3:833ccc20:::rbd_data.1161634664ee.0000000000000009:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:08.300 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:08.301 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 42.417489166999999, 2024-09-11T07:08:08.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045679127999999999, 2024-09-11T07:08:08.301 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.301 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.301 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:08.301 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.301 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.301 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.301 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 74137 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792355+0000", 2024-09-11T07:08:08.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.23e-06 2024-09-11T07:08:08.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792368+0000", 2024-09-11T07:08:08.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449000000000001e-05 2024-09-11T07:08:08.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792398+0000", 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0519999999999999e-05 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792413+0000", 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4216000000000001e-05 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792538+0000", 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012526099999999999 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792679+0000", 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014143099999999999 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.800911+0000", 2024-09-11T07:08:08.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082317989999999997 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837839+0000", 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036927588999999997 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837869+0000", 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0355999999999999e-05 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:08.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837956+0000", 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6967999999999998e-05 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.838031+0000", 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5308999999999993e-05 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:114986 3.8 3:16fde53f:::rbd_data.1161a6ce22ad.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.795950338000001, 2024-09-11T07:08:08.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047341314000000002, 2024-09-11T07:08:08.308 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:08.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:08.308 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:08.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:08.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:08.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:08.308 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 114986 2024-09-11T07:08:08.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.308 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:08.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413894+0000", 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2660000000000002e-06 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413906+0000", 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2157000000000001e-05 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413935+0000", 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8585000000000002e-05 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413949+0000", 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4365999999999999e-05 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.414062+0000", 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000112342 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:08.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.414287+0000", 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022574300000000001 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.423201+0000", 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089138370000000008 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.460776+0000", 2024-09-11T07:08:08.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037574278000000003 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.460916+0000", 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014091 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.461094+0000", 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000177176 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:08.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:08.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.461232+0000", 2024-09-11T07:08:08.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013865399999999999 2024-09-11T07:08:08.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.314 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.314 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:08.314 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:08.314 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:08.315 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:08:08.316 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:08.317 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:08.314+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:08.417 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:08.410+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:08.450 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:08.450 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:08.450 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:08.450 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:08.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:08.501 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:08.501 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:08.518 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:08.519 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:08.535 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:08.535 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:08.549 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:08.546+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:08.551 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:08.568 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:08.569 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:08.588 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:08.588 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:08.606 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:08.606 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:08.619 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:08.615+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:08.625 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:08.625 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:08.628 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:08.628 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:08.643 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:08.729 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:08.726+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:08.802 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:08.803 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:08.817 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:08.821 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:08.815+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:08.826 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:08:08.921 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:08.919+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:08.983 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:08.983 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:08.997 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:09.045 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:09.042+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:09.122 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:09.122 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:09.123 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:09.118+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:09.136 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:09.223 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:09.219+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:09.298 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:09.298 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:09.316 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:09.323 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:09.319+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:09.425 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:09.423+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:09.441 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:09.441 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:09.455 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:09.526 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:09.523+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:09.577 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:09.577 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:09.591 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:09.637 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:09.634+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:09.710 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:09.711 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:09.725 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:09.765 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:09.762+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:09.830 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:09.827+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:09.889 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:09.890 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:09.905 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:09.949 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:09.946+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:10.031 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:10.026+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:10.036 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:10.036 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:10.052 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:10.132 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:10.127+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:10.219 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:10.219 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:10.233 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:10.227+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:10.234 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:10.333 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:10.327+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:10.383 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:10.401 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:10.434 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:10.430+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:10.535 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:10.531+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:10.576 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:10.577 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:10.592 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:10.637 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:10.635+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:10.643 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:10.737 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:10.734+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:10.759 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:10.775 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:10.837 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:10.835+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:10.845 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:10.846 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:10.865 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:08:10.867 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:10.867 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:10.890 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:10.891 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:10.911 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:10.911 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:10.913 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:10.913 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:10.913 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:10.931 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:10.935 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:10.935 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:10.939 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:10.934+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:10.965 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:10.965 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:10.993 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:10.993 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:11.019 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:11.019 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:11.039 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:11.035+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:11.084 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:11.084 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:11.084 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:11.084 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:11.084 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:11.104 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:11.140 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:11.134+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:11.241 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:11.235+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:11.290 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:11.290 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:11.290 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:11.290 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:11.290 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46274 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5447680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956675726, 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042635002999999998, 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46274 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.291 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:11.292 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9800000000000004e-07 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331645+0000", 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331652+0000", 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4159999999999998e-06 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.293 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331659+0000", 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2710000000000003e-06 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374165+0000", 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042505493999999998 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374214+0000", 2024-09-11T07:08:11.294 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8826999999999999e-05 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374277+0000", 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3145000000000006e-05 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46275 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5496832~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956650764000003, 2024-09-11T07:08:11.295 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042748189999999998, 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46275 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:11.296 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.297 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331669+0000", 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2900000000000001e-06 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331686+0000", 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6767999999999999e-05 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331693+0000", 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6599999999999998e-06 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.298 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374308+0000", 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042614919000000001 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374355+0000", 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7166000000000002e-05 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374415+0000", 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9893999999999999e-05 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.299 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46276 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5545984~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956616338000003, 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042856001999999997, 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.300 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46276 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.301 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331702+0000", 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331704+0000", 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5629999999999999e-06 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331712+0000", 2024-09-11T07:08:11.302 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9340000000000006e-06 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331720+0000", 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1049999999999995e-06 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374445+0000", 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042724597000000003 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374494+0000", 2024-09-11T07:08:11.303 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9234999999999999e-05 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374557+0000", 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3058000000000005e-05 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46277 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5595136~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.304 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956565992999998, 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042946033000000002, 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46277 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.305 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331752+0000", 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2500000000000005e-07 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.306 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331755+0000", 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7e-06 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331763+0000", 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331777+0000", 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3749e-05 2024-09-11T07:08:11.307 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374591+0000", 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042813898000000003 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374637+0000", 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6492000000000001e-05 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.308 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374697+0000", 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0222e-05 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46278 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5644288~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956531314000003, 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043078449999999997, 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.309 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46278 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331787+0000", 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9299999999999997e-07 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331789+0000", 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331797+0000", 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331804+0000", 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3010000000000001e-06 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374743+0000", 2024-09-11T07:08:11.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042938538999999998 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374800+0000", 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6637e-05 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374865+0000", 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4906999999999994e-05 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.313 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46279 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5693440~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956505428, 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043192304000000001, 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46279 2024-09-11T07:08:11.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.315 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1500000000000005e-07 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331815+0000", 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4080000000000001e-06 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331822+0000", 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3359999999999997e-06 2024-09-11T07:08:11.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331831+0000", 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4530000000000002e-06 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374897+0000", 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043066213999999998 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374944+0000", 2024-09-11T07:08:11.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7292000000000001e-05 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375004+0000", 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0086e-05 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46280 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5742592~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:11.318 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956475299999994, 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043330417000000003, 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46280 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331843+0000", 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331848+0000", 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5570000000000003e-06 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331857+0000", 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6689999999999995e-06 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331863+0000", 2024-09-11T07:08:11.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0610000000000001e-06 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375049+0000", 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043186443999999997 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375104+0000", 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4821999999999998e-05 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375172+0000", 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8371e-05 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46281 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5791744~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956447037999993, 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043441781999999998, 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.323 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46281 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331871+0000", 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9900000000000001e-07 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331873+0000", 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.458e-06 2024-09-11T07:08:11.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331885+0000", 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1919999999999999e-05 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331891+0000", 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0950000000000001e-06 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375205+0000", 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043314084000000003 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375253+0000", 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8047000000000003e-05 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375312+0000", 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8678999999999998e-05 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.327 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46282 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5840896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956369924000001, 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043532266999999999, 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.328 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46282 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331948+0000", 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7199999999999997e-07 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331952+0000", 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4479999999999999e-06 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331962+0000", 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7389999999999994e-06 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331968+0000", 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6789999999999999e-06 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375357+0000", 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043388559 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375413+0000", 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5971999999999999e-05 2024-09-11T07:08:11.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375480+0000", 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6997999999999998e-05 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46283 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5890048~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956334983999994, 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043635858999999999, 2024-09-11T07:08:11.332 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46283 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331983+0000", 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3799999999999997e-07 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331985+0000", 2024-09-11T07:08:11.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4990000000000001e-06 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331993+0000", 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9629999999999998e-06 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332003+0000", 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8199999999999992e-06 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375512+0000", 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043508865000000001 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375560+0000", 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8004999999999999e-05 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375618+0000", 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8168999999999998e-05 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.336 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46284 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5939200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956306596999994, 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043772483000000001, 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.337 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46284 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0699999999999997e-07 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332014+0000", 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4619999999999999e-06 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332021+0000", 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650000000000004e-06 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332029+0000", 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-06 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375663+0000", 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043634233000000001 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.340 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375717+0000", 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4209000000000002e-05 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375783+0000", 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6297000000000006e-05 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46285 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5988352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.341 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956280156000005, 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043885753, 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46285 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332038+0000", 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332040+0000", 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332048+0000", 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5830000000000001e-06 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332054+0000", 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0340000000000002e-06 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375817+0000", 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043762574999999998 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375865+0000", 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8637000000000002e-05 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375923+0000", 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7757000000000003e-05 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46286 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6037504~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956255968999997, 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044027821000000002, 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46286 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.346 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332062+0000", 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332064+0000", 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2740000000000002e-06 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332073+0000", 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6719999999999993e-06 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332079+0000", 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8579999999999996e-06 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375967+0000", 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043888476000000003 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376022+0000", 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4208e-05 2024-09-11T07:08:11.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376089+0000", 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7688000000000007e-05 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46287 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6086656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956205967000002, 2024-09-11T07:08:11.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044117732999999999, 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46287 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332112+0000", 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332115+0000", 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6680000000000001e-06 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332123+0000", 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3110000000000006e-06 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332129+0000", 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4230000000000002e-06 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376121+0000", 2024-09-11T07:08:11.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043991816000000003 2024-09-11T07:08:11.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376171+0000", 2024-09-11T07:08:11.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9540999999999999e-05 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376229+0000", 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8328999999999997e-05 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46288 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6135808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.355 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956179613000003, 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044260648, 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46288 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7000000000000004e-07 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332141+0000", 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4449999999999999e-06 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332153+0000", 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1772e-05 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332159+0000", 2024-09-11T07:08:11.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376274+0000", 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044115170000000002 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376333+0000", 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9017000000000001e-05 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376398+0000", 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5506999999999995e-05 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46289 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6184960~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956136240000006, 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044357445000000002, 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.360 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46289 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332182+0000", 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3200000000000005e-07 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332184+0000", 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332192+0000", 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332200+0000", 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3170000000000004e-06 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376431+0000", 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044230923999999998 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376479+0000", 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8072999999999999e-05 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376539+0000", 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9789e-05 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.364 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46290 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6234112~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956109631999993, 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044494765999999998, 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46290 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0100000000000005e-07 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332211+0000", 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099999999999998e-06 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332222+0000", 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1443999999999999e-05 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332228+0000", 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-11T07:08:11.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376583+0000", 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044355252999999997 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376639+0000", 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5278000000000002e-05 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376703+0000", 2024-09-11T07:08:11.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3885000000000002e-05 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46291 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6283264~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.956081330000004, 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044598027999999998, 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.369 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46291 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332237+0000", 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332239+0000", 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4399999999999999e-06 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332246+0000", 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-11T07:08:11.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332253+0000", 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0379999999999996e-06 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376728+0000", 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044475317 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376777+0000", 2024-09-11T07:08:11.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9475999999999999e-05 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376834+0000", 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6749999999999997e-05 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46955 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9379840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.740156135999996, 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042646256, 2024-09-11T07:08:11.373 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46955 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3099999999999999e-07 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548163+0000", 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.127e-06 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548166+0000", 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.179e-06 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548169+0000", 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8609999999999998e-06 2024-09-11T07:08:11.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590717+0000", 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042547883000000002 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590754+0000", 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.765e-05 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590808+0000", 2024-09-11T07:08:11.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3325000000000002e-05 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46956 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9428992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 82.740144872000002, 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042772421999999997, 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.380 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46956 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:11.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:11.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:08:11.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548174+0000", 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1790000000000001e-06 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548177+0000", 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2119999999999999e-06 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548180+0000", 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7369999999999998e-06 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590827+0000", 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042647353999999998 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590886+0000", 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8968999999999997e-05 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590945+0000", 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8754e-05 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.384 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.385 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.385 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.385 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:11.386 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:11.387 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:11.383+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:11.488 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:11.482+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:11.570 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:11.571 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:11.571 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:11.585 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:11.589 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:11.582+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:11.689 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:11.686+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:11.710 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:11.710 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:11.710 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:11.724 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:11.790 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:11.786+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:11.865 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59289 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:head [stat,truncate 11010048] snapc 20=[20] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.847834200999998, 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024828697, 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:11.866 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59289 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:11.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015467+0000", 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6200000000000001e-06 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015483+0000", 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5962999999999999e-05 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015531+0000", 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7964999999999999e-05 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015554+0000", 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3493e-05 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015723+0000", 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169121 2024-09-11T07:08:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016035+0000", 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031174000000000002 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016468+0000", 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043272900000000002 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.039067+0000", 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022598894000000001 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040107+0000", 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010398860000000001 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040212+0000", 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010577399999999999 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040292+0000", 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9511999999999994e-05 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62120 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3457024~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.064498225999998, 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011832135000000001, 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.872 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62120 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798800+0000", 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6400000000000002e-07 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798804+0000", 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0419999999999996e-06 2024-09-11T07:08:11.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798813+0000", 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6870000000000006e-06 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798819+0000", 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6810000000000003e-06 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810180+0000", 2024-09-11T07:08:11.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011361069999999999 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810372+0000", 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000191456 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810631+0000", 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025963499999999998 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.876 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62121 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3522560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.064470045999997, 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01236723, 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.877 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62121 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798828+0000", 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798830+0000", 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-06 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798839+0000", 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3019999999999995e-06 2024-09-11T07:08:11.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798844+0000", 2024-09-11T07:08:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2549999999999997e-06 2024-09-11T07:08:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810713+0000", 2024-09-11T07:08:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011869151 2024-09-11T07:08:11.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810925+0000", 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021164999999999999 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811195+0000", 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026976099999999998 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62122 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3588096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.064431119000005, 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012886078, 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62122 2024-09-11T07:08:11.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798867+0000", 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798870+0000", 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0630000000000002e-06 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798878+0000", 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8669999999999994e-06 2024-09-11T07:08:11.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798902+0000", 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4167000000000001e-05 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811275+0000", 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012373454000000001 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.885 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811484+0000", 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020880000000000001 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811752+0000", 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026820099999999998 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62123 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3653632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:11.886 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 70.064382741000003, 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013329191000000001, 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62123 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:11.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6300000000000004e-07 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798918+0000", 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0750000000000002e-06 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798926+0000", 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8839999999999994e-06 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798933+0000", 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0169999999999999e-06 2024-09-11T07:08:11.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811830+0000", 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012896179000000001 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812072+0000", 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024236200000000001 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812244+0000", 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017191099999999999 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:103753 3.a 3.fa1caca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.535977922999997, 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89411045099999997, 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.891 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 103753 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327322+0000", 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5799999999999999e-06 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327333+0000", 2024-09-11T07:08:11.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.117e-05 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327355+0000", 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327367+0000", 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2242000000000001e-05 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327446+0000", 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9503000000000001e-05 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327454+0000", 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6510000000000001e-06 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:35.221416+0000", 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89396147999999998 2024-09-11T07:08:11.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:35.221430+0000", 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4338000000000001e-05 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:109788 3.a 3:562ca8e0:::rbd_data.1161dd0f3253.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 6291456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.133983198999999, 2024-09-11T07:08:11.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012764114, 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 109788 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729318+0000", 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1060000000000002e-06 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731829+0000", 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025105679999999999 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731859+0000", 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0043e-05 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731879+0000", 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305e-05 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732019+0000", 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013981900000000001 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732286+0000", 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026720599999999998 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732745+0000", 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045896799999999997 2024-09-11T07:08:11.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741444+0000", 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086986819999999992 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741887+0000", 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044320900000000002 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741972+0000", 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5326000000000003e-05 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.742078+0000", 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105882 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.902 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:109791 3.9 e102/101 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head v 102'194, mlcod=102'192)", 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.117813286000001, 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012074544, 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745486+0000", 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.886e-06 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750110+0000", 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004624459 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750140+0000", 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9947999999999999e-05 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750161+0000", 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0449e-05 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750277+0000", 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115986 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750315+0000", 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7954000000000003e-05 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.757455+0000", 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0071403680000000002 2024-09-11T07:08:11.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.757559+0000", 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103494 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:109908 3.a 3:562ca8e0:::rbd_data.1161dd0f3253.0000000000000007:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.838072640999997, 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047375651999999997, 2024-09-11T07:08:11.907 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 109908 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.908 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025228+0000", 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.993e-06 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025241+0000", 2024-09-11T07:08:11.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3363000000000001e-05 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025272+0000", 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0633999999999998e-05 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025305+0000", 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2821999999999998e-05 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025442+0000", 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000137575 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025572+0000", 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012960200000000001 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.033596+0000", 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080244159999999995 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072266+0000", 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038670084 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072397+0000", 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130653 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072491+0000", 2024-09-11T07:08:11.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4320000000000005e-05 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072600+0000", 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010919 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4449.0:109908 3.a e102/101 ondisk, result = 0)", 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:11.913 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.804132596000002, 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013453283, 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059167+0000", 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9989999999999998e-06 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059178+0000", 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1240000000000001e-05 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059211+0000", 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3417999999999998e-05 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059242+0000", 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0775000000000003e-05 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072352+0000", 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013109536999999999 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072380+0000", 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7905000000000001e-05 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072618+0000", 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238409 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.917 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112577 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.898834167, 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01152213, 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112577 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964464+0000", 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.27e-07 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964470+0000", 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3840000000000002e-06 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964478+0000", 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2989999999999997e-06 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964483+0000", 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9559999999999996e-06 2024-09-11T07:08:11.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975836+0000", 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011353221 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975904+0000", 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7229000000000003e-05 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975985+0000", 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1613999999999995e-05 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112578 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 4653056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.89877181, 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011630053, 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.922 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112578 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:11.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6499999999999999e-07 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964529+0000", 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964537+0000", 2024-09-11T07:08:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7489999999999998e-06 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964543+0000", 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9070000000000004e-06 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976015+0000", 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011472141999999999 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976077+0000", 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2373999999999996e-05 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976156+0000", 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8547999999999994e-05 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112579 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 5177344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.898746935999998, 2024-09-11T07:08:11.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011724089, 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112579 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.927 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964551+0000", 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3600000000000004e-07 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964553+0000", 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2419999999999999e-06 2024-09-11T07:08:11.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964560+0000", 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3409999999999999e-06 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964565+0000", 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976180+0000", 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011615122 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976221+0000", 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1115000000000002e-05 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976275+0000", 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3507000000000001e-05 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.930 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112580 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.898725443, 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011867212, 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112580 2024-09-11T07:08:11.931 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:11.932 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1199999999999998e-07 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964574+0000", 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.013e-06 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964581+0000", 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1019999999999999e-06 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964587+0000", 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6289999999999998e-06 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976300+0000", 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011712854999999999 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976361+0000", 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0788000000000001e-05 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976439+0000", 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8412999999999996e-05 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112581 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.898703310999998, 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012017570999999999, 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.935 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112581 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.936 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6699999999999999e-07 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964597+0000", 2024-09-11T07:08:11.937 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1040000000000001e-06 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964603+0000", 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0419999999999999e-06 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964608+0000", 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9439999999999996e-06 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.938 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976465+0000", 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01185747 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976527+0000", 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2198000000000003e-05 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976612+0000", 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4445999999999998e-05 2024-09-11T07:08:11.939 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112582 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 6750208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.898683122000001, 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012177538999999999, 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.940 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112582 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.941 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964615+0000", 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3300000000000003e-07 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964617+0000", 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0090000000000002e-06 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.942 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964623+0000", 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0109999999999997e-06 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964627+0000", 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7949999999999998e-06 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976641+0000", 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012013642 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.943 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976707+0000", 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5747000000000006e-05 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976792+0000", 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4901999999999995e-05 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.944 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112583 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.898663479, 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012338040999999999, 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112583 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.945 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9999999999999998e-07 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.946 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964636+0000", 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964642+0000", 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0970000000000002e-06 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964654+0000", 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1616e-05 2024-09-11T07:08:11.947 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976820+0000", 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012165924999999999 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976884+0000", 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3818000000000005e-05 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976972+0000", 2024-09-11T07:08:11.948 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8184999999999997e-05 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112584 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.898635423999998, 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012480952999999999, 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.949 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112584 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.950 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7e-07 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964665+0000", 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3590000000000002e-06 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964671+0000", 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3169999999999998e-06 2024-09-11T07:08:11.951 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964676+0000", 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1120000000000004e-06 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977003+0000", 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012326467000000001 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.952 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977069+0000", 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6172000000000003e-05 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977143+0000", 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4055999999999997e-05 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112585 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:11.953 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.898614072000001, 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012584098, 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112585 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964684+0000", 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7599999999999997e-07 2024-09-11T07:08:11.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964686+0000", 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.131e-06 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964692+0000", 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2360000000000001e-06 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964697+0000", 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.967e-06 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977169+0000", 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01247183 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977224+0000", 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4632999999999997e-05 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977267+0000", 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3724999999999999e-05 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:113546 3.9 3:95ef5f75:::rbd_data.1161428332f9.0000000000000020:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 23.011905500000001, 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019568058999999999, 2024-09-11T07:08:11.958 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 113546 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851395+0000", 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.853e-06 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:11.960 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851410+0000", 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5259000000000001e-05 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851445+0000", 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5048000000000001e-05 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851469+0000", 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3555999999999999e-05 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851597+0000", 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000128594 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851838+0000", 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240941 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.855619+0000", 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037808859999999998 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870762+0000", 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015143115 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870793+0000", 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0525000000000003e-05 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870882+0000", 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9159000000000005e-05 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:11.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:11.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:11.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870960+0000", 2024-09-11T07:08:11.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8122999999999997e-05 2024-09-11T07:08:11.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:11.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:11.964 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:11.966 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:11.966 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:11.962+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:12.038 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7, 0] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:08:12.039 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:08:12.039 INFO:tasks.thrashosds.thrasher:inject_pause on osd.6 2024-09-11T07:08:12.039 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T07:08:12.039 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T07:08:12.039 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok config set filestore_inject_stall 3 2024-09-11T07:08:12.066 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:12.063+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:12.070 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:08:12.119 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:12.120 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:12.120 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:12.140 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:12.167 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:12.162+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:12.177 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:12.177 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "" 2024-09-11T07:08:12.177 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:12.268 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:12.263+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:12.304 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:12.304 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:12.304 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:12.304 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:12.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:12.406 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:12.403+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:12.470 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:12.466+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:12.485 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:12.485 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:12.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 94.857507329000001, 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.486 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:12.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.488 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:08:12.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:08:12.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59115 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.470905775999995, 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038255633999999997, 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.492 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59115 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.493 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010877+0000", 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.083e-06 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010885+0000", 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0400000000000004e-06 2024-09-11T07:08:12.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010931+0000", 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6452000000000002e-05 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010947+0000", 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5786000000000001e-05 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049022+0000", 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038075472999999999 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049076+0000", 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4131000000000001e-05 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049132+0000", 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5668999999999998e-05 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.496 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59119 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.470814125999993, 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038492673999999998, 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.497 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59119 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:12.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010969+0000", 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010976+0000", 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4529999999999999e-06 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010994+0000", 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8672999999999999e-05 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011009+0000", 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4122e-05 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049189+0000", 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038180218000000002 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049342+0000", 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015341899999999999 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049461+0000", 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118522 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.501 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59138 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.470755311000005, 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038631255000000003, 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59138 2024-09-11T07:08:12.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011028+0000", 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011034+0000", 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011049+0000", 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5702999999999999e-05 2024-09-11T07:08:12.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011063+0000", 2024-09-11T07:08:12.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3373000000000001e-05 2024-09-11T07:08:12.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049512+0000", 2024-09-11T07:08:12.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038449050999999998 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049601+0000", 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9395999999999996e-05 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049658+0000", 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6861999999999999e-05 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.506 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59147 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.470516629000002, 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038436533000000002, 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.507 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59147 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011267+0000", 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.46e-06 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011278+0000", 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.119e-05 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011457+0000", 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017874699999999999 2024-09-11T07:08:12.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011481+0000", 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4283000000000001e-05 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049693+0000", 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038212053000000003 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049702+0000", 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59148 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.470259451000004, 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038227694999999999, 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.511 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59148 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.512 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011525+0000", 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011536+0000", 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011561+0000", 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5494999999999999e-05 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011579+0000", 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7292999999999999e-05 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049739+0000", 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038159803999999999 2024-09-11T07:08:12.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049750+0000", 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59149 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.470178140000002, 2024-09-11T07:08:12.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038196747000000003, 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59149 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:12.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011605+0000", 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011614+0000", 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3219999999999993e-06 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011634+0000", 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0703000000000002e-05 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011649+0000", 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4603000000000001e-05 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049788+0000", 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038138500999999998 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049801+0000", 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3244000000000001e-05 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.519 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59150 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.470112119000007, 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038171956999999999, 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59150 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.520 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011671+0000", 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-11T07:08:12.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011678+0000", 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011696+0000", 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-05 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011710+0000", 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3516000000000001e-05 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049835+0000", 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038125004999999997 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049842+0000", 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0299999999999996e-06 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.523 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59154 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 71.469876409999998, 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038170655999999997, 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.524 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59154 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011907+0000", 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1739999999999999e-06 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011974+0000", 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7200999999999996e-05 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011995+0000", 2024-09-11T07:08:12.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1058999999999999e-05 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012015+0000", 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9857e-05 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050060+0000", 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038045074999999998 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050076+0000", 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6290000000000002e-05 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:70560 3.2 3:459eba64:::rbd_data.11618cc4d69.000000000000003a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.021645806000002, 2024-09-11T07:08:12.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064825956000000004, 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 70560 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460139+0000", 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460150+0000", 2024-09-11T07:08:12.530 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0824e-05 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460178+0000", 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8449000000000002e-05 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460199+0000", 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1075999999999999e-05 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.531 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460319+0000", 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119714 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460451+0000", 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013264 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.472543+0000", 2024-09-11T07:08:12.532 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091437 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524779+0000", 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052236339 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524853+0000", 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524913+0000", 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0825000000000001e-05 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524962+0000", 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8999999999999998e-05 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71632 3.18 3:194b1b54:::rbd_data.1161b94a6d64.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:12.534 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 53.03938848, 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039963481000000002, 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71632 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442395+0000", 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442403+0000", 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6210000000000004e-06 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442416+0000", 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3011e-05 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442422+0000", 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2620000000000004e-06 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442495+0000", 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2977000000000003e-05 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442647+0000", 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015205199999999999 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.450708+0000", 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080612589999999994 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482090+0000", 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031381543999999997 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482176+0000", 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6302000000000001e-05 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482279+0000", 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010242399999999999 2024-09-11T07:08:12.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482357+0000", 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8565000000000004e-05 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73806 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14024704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.898981655, 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038245594000000001, 2024-09-11T07:08:12.540 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73806 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582804+0000", 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.836e-06 2024-09-11T07:08:12.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582813+0000", 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030000000000003e-06 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582820+0000", 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9e-06 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620766+0000", 2024-09-11T07:08:12.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037946800000000003 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620895+0000", 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012861799999999999 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621046+0000", 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015100700000000001 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73807 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14417920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.898953953000003, 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038841537000000002, 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73807 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.545 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582829+0000", 2024-09-11T07:08:12.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582857+0000", 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.779e-05 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582874+0000", 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7584999999999999e-05 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582882+0000", 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7999999999999999e-06 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621135+0000", 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038253044 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621390+0000", 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000254689 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621670+0000", 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027999500000000001 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73808 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14811136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.898888894000002, 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039162267000000001, 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:12.549 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73808 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582894+0000", 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582897+0000", 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4240000000000002e-06 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582907+0000", 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4299999999999995e-06 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582919+0000", 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1826e-05 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621769+0000", 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038850735999999997 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621898+0000", 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012898099999999999 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622056+0000", 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015718000000000001 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73809 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15204352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:12.553 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.898854778, 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039738290000000002, 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73809 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582928+0000", 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9999999999999997e-07 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582932+0000", 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8029999999999998e-06 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582947+0000", 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5099999999999999e-05 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582959+0000", 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.206e-05 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622144+0000", 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039184999999999998 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622390+0000", 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024606600000000003 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622666+0000", 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027566100000000002 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.557 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73810 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15597568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.898806079000003, 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040289497000000001, 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.558 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73810 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582977+0000", 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0100000000000001e-06 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582983+0000", 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583000+0000", 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7237000000000001e-05 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583014+0000", 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4076999999999999e-05 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622759+0000", 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039744806000000001 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622998+0000", 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000239385 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623266+0000", 2024-09-11T07:08:12.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026730900000000003 2024-09-11T07:08:12.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.562 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.562 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73811 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15990784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.898750059999998, 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040666513000000001, 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73811 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.563 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583033+0000", 2024-09-11T07:08:12.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.037e-06 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583039+0000", 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583079+0000", 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0438999999999997e-05 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583092+0000", 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2367e-05 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623365+0000", 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040273182999999997 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623518+0000", 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015322099999999999 2024-09-11T07:08:12.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623699+0000", 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018055299999999999 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73812 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 16384000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.898677681000002, 2024-09-11T07:08:12.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041168972999999998, 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73812 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:12.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583109+0000", 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1799999999999998e-06 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583120+0000", 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0380000000000001e-05 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583127+0000", 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.029e-06 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.570 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623766+0000", 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040639210000000002 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624006+0000", 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240466 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624273+0000", 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026699100000000001 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.571 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:74137 3.1 3:833ccc20:::rbd_data.1161634664ee.0000000000000009:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 46.689430014000003, 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045679127999999999, 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 74137 2024-09-11T07:08:12.572 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.573 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792355+0000", 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.23e-06 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792368+0000", 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449000000000001e-05 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792398+0000", 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0519999999999999e-05 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792413+0000", 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4216000000000001e-05 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792538+0000", 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012526099999999999 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792679+0000", 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014143099999999999 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.800911+0000", 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082317989999999997 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837839+0000", 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036927588999999997 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837869+0000", 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0355999999999999e-05 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837956+0000", 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6967999999999998e-05 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.838031+0000", 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5308999999999993e-05 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:114986 3.8 3:16fde53f:::rbd_data.1161a6ce22ad.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 20.067891185000001, 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047341314000000002, 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 114986 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:12.578 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:12.579 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413894+0000", 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2660000000000002e-06 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413906+0000", 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2157000000000001e-05 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413935+0000", 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8585000000000002e-05 2024-09-11T07:08:12.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413949+0000", 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4365999999999999e-05 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.414062+0000", 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000112342 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.581 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.414287+0000", 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022574300000000001 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.423201+0000", 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089138370000000008 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.460776+0000", 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037574278000000003 2024-09-11T07:08:12.582 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.460916+0000", 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014091 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.461094+0000", 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000177176 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:12.583 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.461232+0000", 2024-09-11T07:08:12.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013865399999999999 2024-09-11T07:08:12.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.584 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.584 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:12.584 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:12.584 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:12.586 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:12.586 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:12.582+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:12.686 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:12.683+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:12.717 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:12.717 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:12.717 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:12.717 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:12.731 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:12.786 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:12.783+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:12.853 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:12.854 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:12.854 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:12.868 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:12.887 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:12.883+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:12.988 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.69830324900001, 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:12.989 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:12.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:08:12.993 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.698231166, 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:12.994 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:12.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.69817567299999, 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:12.998 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:12.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:13.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.000 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:08:13.000 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:13.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.000 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:08:13.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:08:13.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.001 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.001 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:08:13.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:08:13.001 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.001 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:08:13.002 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.003 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:13.004 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.496303705, 2024-09-11T07:08:13.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:08:13.004 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.004 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.004 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.004 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.004 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:08:13.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:08:13.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.008 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.009 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.009 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.009 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:13.009 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.496241115, 2024-09-11T07:08:13.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:08:13.009 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.009 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.009 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:08:13.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:13.014 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.496184059, 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:08:13.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:08:13.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:08:13.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:08:13.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:08:13.020 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.021 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.021 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.021 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.021 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:13.021 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.496127942, 2024-09-11T07:08:13.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:08:13.021 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.021 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.023 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:08:13.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:08:13.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:08:13.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:08:13.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.026 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.027 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:13.027 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.49600667999999, 2024-09-11T07:08:13.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:08:13.027 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.027 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.027 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.027 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.027 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:13.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.029 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.030 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:08:13.031 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.495902411, 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.032 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.033 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.034 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:08:13.035 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.036 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.495796872, 2024-09-11T07:08:13.037 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.038 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:08:13.039 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:08:13.040 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.041 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.042 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.495729709, 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.043 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.044 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.045 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.046 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:08:13.047 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.495630503, 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.048 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.049 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:13.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.050 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.050 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.050 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:08:13.050 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:08:13.050 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.051 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.052 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.053 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.495543544, 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.054 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.055 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.056 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:08:13.057 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.058 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.495483267, 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.059 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.060 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.061 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.062 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:08:13.063 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.064 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.49532956199999, 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.065 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.066 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:08:13.067 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:08:13.068 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.069 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.495242386, 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.070 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:13.071 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.072 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:08:13.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:08:13.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.073 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.073 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:08:13.073 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:08:13.073 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.073 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.074 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.495178483, 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:08:13.075 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.076 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:08:13.077 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:08:13.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:08:13.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:08:13.078 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.078 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.078 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.078 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:08:13.078 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:08:13.079 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:08:13.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:08:13.080 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.080 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.080 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.080 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:08:13.080 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:08:13.080 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.49511864, 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.081 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.082 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.082 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:08:13.082 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.082 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.082 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.082 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.082 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:13.082 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:08:13.083 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.084 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:08:13.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:08:13.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.085 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.085 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:08:13.085 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:08:13.085 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.085 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.086 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.495040558, 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.087 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:13.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.088 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.088 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.088 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:13.088 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.088 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.089 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:08:13.090 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.091 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.494982788, 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:13.092 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:13.093 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.094 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.095 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:08:13.096 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:13.097 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:13.097 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:13.097 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:08:13.098 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:12.987+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:13.099 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:13.100 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:13.095+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:13.200 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:13.194+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:13.229 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:13.229 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:13.229 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:13.243 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:13.257 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:13.257 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:13.273 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:13.273 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:13.290 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:13.290 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:13.300 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:13.295+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:13.307 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:13.307 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:13.324 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:13.324 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:13.341 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:13.341 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:13.360 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:13.361 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:13.380 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:13.381 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:13.409 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:13.409 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:13.423 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:13.441 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:13.439+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:13.503 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:13.499+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:13.543 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:13.543 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:13.558 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:13.605 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:13.602+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:13.681 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:13.681 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:13.695 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:13.705 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:13.699+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:13.805 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:13.802+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:13.860 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:13.861 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:13.874 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:13.917 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:13.914+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:14.007 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:14.002+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:14.036 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:14.036 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:14.050 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:14.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:08:14.137 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:14.134+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:14.209 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:14.203+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:14.220 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:14.220 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:14.236 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:14.309 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:14.307+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:14.402 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:14.402 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:14.410 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:14.406+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:14.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:14.510 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:14.507+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:14.582 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:14.596 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:14.641 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:14.639+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:14.713 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:14.707+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:14.724 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:14.724 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:14.738 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:14.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:14.822+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:14.902 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:14.902 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:14.915 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:14.910+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:14.916 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:15.016 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:15.010+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:15.077 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:15.077 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:15.092 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:15.101 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:08:15.117 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:15.110+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:15.218 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:15.214+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:15.222 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:15.222 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:15.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:15.319 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:15.314+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:15.374 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:15.374 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:15.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:15.398 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:15.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:15.426+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:15.521 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:15.518+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:15.551 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:15.551 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:15.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:15.569 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:15.570 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:15.586 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:15.586 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:15.602 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:15.603 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:15.619 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:15.619 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:15.622 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:15.618+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:15.640 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:15.640 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:15.660 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:15.660 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:15.681 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:15.681 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:15.682 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:15.682 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:15.683 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:15.683 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:15.697 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:15.703 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:15.703 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:15.769 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:15.766+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:15.823 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:15.824 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:15.824 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:15.824 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:15.824 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:15.824 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:15.818+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:15.838 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:15.925 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:15.918+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:16.013 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:16.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59289 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:head [stat,truncate 11010048] snapc 20=[20] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.994444686999998, 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024828697, 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59289 2024-09-11T07:08:16.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015467+0000", 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6200000000000001e-06 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015483+0000", 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5962999999999999e-05 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015531+0000", 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7964999999999999e-05 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015554+0000", 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3493e-05 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015723+0000", 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169121 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016035+0000", 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031174000000000002 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016468+0000", 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043272900000000002 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.039067+0000", 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022598894000000001 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040107+0000", 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010398860000000001 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040212+0000", 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010577399999999999 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040292+0000", 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9511999999999994e-05 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.019 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62120 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3457024~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.211108711999998, 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011832135000000001, 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62120 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798800+0000", 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6400000000000002e-07 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798804+0000", 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0419999999999996e-06 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798813+0000", 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6870000000000006e-06 2024-09-11T07:08:16.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798819+0000", 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6810000000000003e-06 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810180+0000", 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011361069999999999 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810372+0000", 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000191456 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810631+0000", 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025963499999999998 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62121 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3522560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.024 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.211080531999997, 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01236723, 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62121 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798828+0000", 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798830+0000", 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-06 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798839+0000", 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3019999999999995e-06 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798844+0000", 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2549999999999997e-06 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810713+0000", 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011869151 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810925+0000", 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021164999999999999 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811195+0000", 2024-09-11T07:08:16.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026976099999999998 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62122 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3588096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.211041605000005, 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012886078, 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62122 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:16.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798867+0000", 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798870+0000", 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0630000000000002e-06 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798878+0000", 2024-09-11T07:08:16.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8669999999999994e-06 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798902+0000", 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4167000000000001e-05 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811275+0000", 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012373454000000001 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811484+0000", 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020880000000000001 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811752+0000", 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026820099999999998 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.033 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62123 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3653632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 74.210993227000003, 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013329191000000001, 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62123 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:16.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6300000000000004e-07 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798918+0000", 2024-09-11T07:08:16.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0750000000000002e-06 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798926+0000", 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8839999999999994e-06 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798933+0000", 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0169999999999999e-06 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811830+0000", 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012896179000000001 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812072+0000", 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024236200000000001 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812244+0000", 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017191099999999999 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.037 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:103753 3.a 3.fa1caca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.682588408999997, 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89411045099999997, 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 103753 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327322+0000", 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5799999999999999e-06 2024-09-11T07:08:16.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327333+0000", 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.117e-05 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327355+0000", 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327367+0000", 2024-09-11T07:08:16.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2242000000000001e-05 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327446+0000", 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9503000000000001e-05 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327454+0000", 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6510000000000001e-06 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:35.221416+0000", 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89396147999999998 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:35.221430+0000", 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4338000000000001e-05 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:109788 3.a 3:562ca8e0:::rbd_data.1161dd0f3253.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 6291456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:16.042 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.280593684999999, 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012764114, 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 109788 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729318+0000", 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1060000000000002e-06 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731829+0000", 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025105679999999999 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731859+0000", 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0043e-05 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731879+0000", 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305e-05 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732019+0000", 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013981900000000001 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732286+0000", 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026720599999999998 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732745+0000", 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045896799999999997 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741444+0000", 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086986819999999992 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741887+0000", 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044320900000000002 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741972+0000", 2024-09-11T07:08:16.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5326000000000003e-05 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.742078+0000", 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105882 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:109791 3.9 e102/101 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head v 102'194, mlcod=102'192)", 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:16.048 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.264423772000001, 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012074544, 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745486+0000", 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.886e-06 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750110+0000", 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004624459 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750140+0000", 2024-09-11T07:08:16.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9947999999999999e-05 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750161+0000", 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0449e-05 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750277+0000", 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115986 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750315+0000", 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7954000000000003e-05 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.757455+0000", 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0071403680000000002 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.757559+0000", 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103494 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:109908 3.a 3:562ca8e0:::rbd_data.1161dd0f3253.0000000000000007:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.984683126999997, 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047375651999999997, 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 109908 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025228+0000", 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.993e-06 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025241+0000", 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3363000000000001e-05 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025272+0000", 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0633999999999998e-05 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025305+0000", 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2821999999999998e-05 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025442+0000", 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000137575 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025572+0000", 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012960200000000001 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.033596+0000", 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080244159999999995 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072266+0000", 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038670084 2024-09-11T07:08:16.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072397+0000", 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130653 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072491+0000", 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4320000000000005e-05 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072600+0000", 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010919 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4449.0:109908 3.a e102/101 ondisk, result = 0)", 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 36.950743082000002, 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013453283, 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.059 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059167+0000", 2024-09-11T07:08:16.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9989999999999998e-06 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059178+0000", 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1240000000000001e-05 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059211+0000", 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3417999999999998e-05 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059242+0000", 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0775000000000003e-05 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072352+0000", 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013109536999999999 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072380+0000", 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7905000000000001e-05 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072618+0000", 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238409 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112577 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.045444653000001, 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01152213, 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.063 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112577 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964464+0000", 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.27e-07 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964470+0000", 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3840000000000002e-06 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964478+0000", 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2989999999999997e-06 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964483+0000", 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9559999999999996e-06 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975836+0000", 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011353221 2024-09-11T07:08:16.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975904+0000", 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7229000000000003e-05 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975985+0000", 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1613999999999995e-05 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.067 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112578 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 4653056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.045382296, 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011630053, 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112578 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6499999999999999e-07 2024-09-11T07:08:16.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964529+0000", 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964537+0000", 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7489999999999998e-06 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964543+0000", 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9070000000000004e-06 2024-09-11T07:08:16.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976015+0000", 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011472141999999999 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976077+0000", 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2373999999999996e-05 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976156+0000", 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8547999999999994e-05 2024-09-11T07:08:16.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112579 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 5177344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.045357421999999, 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011724089, 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.072 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112579 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:16.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964551+0000", 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3600000000000004e-07 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964553+0000", 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2419999999999999e-06 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964560+0000", 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3409999999999999e-06 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964565+0000", 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976180+0000", 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011615122 2024-09-11T07:08:16.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976221+0000", 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1115000000000002e-05 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976275+0000", 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3507000000000001e-05 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112580 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.045335929, 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011867212, 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112580 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.077 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1199999999999998e-07 2024-09-11T07:08:16.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964574+0000", 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.013e-06 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964581+0000", 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1019999999999999e-06 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964587+0000", 2024-09-11T07:08:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6289999999999998e-06 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976300+0000", 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011712854999999999 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976361+0000", 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0788000000000001e-05 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.080 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976439+0000", 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8412999999999996e-05 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112581 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.045313796999999, 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012017570999999999, 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.081 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112581 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:16.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6699999999999999e-07 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964597+0000", 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1040000000000001e-06 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964603+0000", 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0419999999999999e-06 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964608+0000", 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9439999999999996e-06 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976465+0000", 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01185747 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976527+0000", 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2198000000000003e-05 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976612+0000", 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4445999999999998e-05 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.085 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112582 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 6750208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:16.086 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:16.086 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.045293608000001, 2024-09-11T07:08:16.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012177538999999999, 2024-09-11T07:08:16.086 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.086 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.086 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.087 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.087 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112582 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964615+0000", 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3300000000000003e-07 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964617+0000", 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0090000000000002e-06 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964623+0000", 2024-09-11T07:08:16.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0109999999999997e-06 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964627+0000", 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7949999999999998e-06 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976641+0000", 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012013642 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976707+0000", 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5747000000000006e-05 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976792+0000", 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4901999999999995e-05 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112583 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.045273965, 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012338040999999999, 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112583 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.092 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9999999999999998e-07 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964636+0000", 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964642+0000", 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0970000000000002e-06 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.094 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964654+0000", 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1616e-05 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976820+0000", 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012165924999999999 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976884+0000", 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3818000000000005e-05 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976972+0000", 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8184999999999997e-05 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112584 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.045245909999998, 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012480952999999999, 2024-09-11T07:08:16.096 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112584 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7e-07 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964665+0000", 2024-09-11T07:08:16.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3590000000000002e-06 2024-09-11T07:08:16.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964671+0000", 2024-09-11T07:08:16.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3169999999999998e-06 2024-09-11T07:08:16.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.099 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964676+0000", 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1120000000000004e-06 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977003+0000", 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012326467000000001 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977069+0000", 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6172000000000003e-05 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977143+0000", 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4055999999999997e-05 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112585 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.045224558000001, 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012584098, 2024-09-11T07:08:16.101 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112585 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964684+0000", 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7599999999999997e-07 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.103 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964686+0000", 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.131e-06 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964692+0000", 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2360000000000001e-06 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964697+0000", 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.967e-06 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977169+0000", 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01247183 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977224+0000", 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4632999999999997e-05 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977267+0000", 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3724999999999999e-05 2024-09-11T07:08:16.105 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:113546 3.9 3:95ef5f75:::rbd_data.1161428332f9.0000000000000020:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 27.158515986000001, 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019568058999999999, 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.106 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 113546 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851395+0000", 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.853e-06 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851410+0000", 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5259000000000001e-05 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851445+0000", 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5048000000000001e-05 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851469+0000", 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3555999999999999e-05 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851597+0000", 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000128594 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851838+0000", 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240941 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.855619+0000", 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037808859999999998 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870762+0000", 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015143115 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870793+0000", 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0525000000000003e-05 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870882+0000", 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9159000000000005e-05 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870960+0000", 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8122999999999997e-05 2024-09-11T07:08:16.111 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.112 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.112 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.112 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.112 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:16.113 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:16.114 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:16.110+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:16.215 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:16.210+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:16.255 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:16.255 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:16.255 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.255 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118842 3.1e 3:7884a9d1:::rbd_object_map.11614049bfb5:head [call lock.assert_locked in=44b,call rbd.object_map_update in=39b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e136)", 2024-09-11T07:08:16.255 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:16.251314+0000", 2024-09-11T07:08:16.255 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.0032636560000000002, 2024-09-11T07:08:16.255 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0032988169999999999, 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118842 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:16.251314+0000", 2024-09-11T07:08:16.256 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:16.251314+0000", 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:16.251315+0000", 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.418e-06 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.257 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:16.251323+0000", 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9869999999999999e-06 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:16.251342+0000", 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9477e-05 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:16.251357+0000", 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4786999999999999e-05 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.258 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:16.251438+0000", 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0989000000000007e-05 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:16.251543+0000", 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000104999 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:16.251969+0000", 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00042533399999999998 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.259 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:16.253030+0000", 2024-09-11T07:08:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010614229999999999 2024-09-11T07:08:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:16.260 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 1 2024-09-11T07:08:16.260 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:16.273 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:16.316 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:16.310+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:16.417 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:16.414+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:16.443 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:16.443 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:16.443 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:16.457 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:16.518 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:16.514+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:16.582 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:16.583 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:16.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:16.583 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:16.583 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.583 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:08:16.583 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:16.583 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 98.954791244999996, 2024-09-11T07:08:16.583 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:08:16.583 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:16.584 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:08:16.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.587 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:08:16.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.589 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59115 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.568189692000004, 2024-09-11T07:08:16.590 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038255633999999997, 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59115 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.591 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:16.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.592 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.592 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:16.592 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.592 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010877+0000", 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.083e-06 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010885+0000", 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0400000000000004e-06 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.593 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010931+0000", 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6452000000000002e-05 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010947+0000", 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5786000000000001e-05 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049022+0000", 2024-09-11T07:08:16.594 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038075472999999999 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049076+0000", 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4131000000000001e-05 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049132+0000", 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5668999999999998e-05 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59119 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.568098042000003, 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038492673999999998, 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.596 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59119 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.597 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010969+0000", 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010976+0000", 2024-09-11T07:08:16.598 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4529999999999999e-06 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010994+0000", 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8672999999999999e-05 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011009+0000", 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4122e-05 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049189+0000", 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038180218000000002 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049342+0000", 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015341899999999999 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.600 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.601 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049461+0000", 2024-09-11T07:08:16.601 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118522 2024-09-11T07:08:16.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.601 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.601 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59138 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.568039227, 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038631255000000003, 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59138 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.602 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:16.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.603 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.603 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:16.603 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011028+0000", 2024-09-11T07:08:16.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-09-11T07:08:16.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.604 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.604 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011034+0000", 2024-09-11T07:08:16.604 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:08:16.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011049+0000", 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5702999999999999e-05 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011063+0000", 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3373000000000001e-05 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049512+0000", 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038449050999999998 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049601+0000", 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9395999999999996e-05 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.606 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049658+0000", 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6861999999999999e-05 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59147 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.567800544999997, 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038436533000000002, 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59147 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:16.608 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011267+0000", 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.46e-06 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.609 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011278+0000", 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.119e-05 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011457+0000", 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017874699999999999 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.610 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011481+0000", 2024-09-11T07:08:16.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4283000000000001e-05 2024-09-11T07:08:16.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.611 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049693+0000", 2024-09-11T07:08:16.611 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038212053000000003 2024-09-11T07:08:16.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.611 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049702+0000", 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59148 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.567543366999999, 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038227694999999999, 2024-09-11T07:08:16.612 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59148 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.613 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011525+0000", 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011536+0000", 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011561+0000", 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5494999999999999e-05 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.615 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011579+0000", 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7292999999999999e-05 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049739+0000", 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038159803999999999 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049750+0000", 2024-09-11T07:08:16.616 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59149 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.567462055999997, 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038196747000000003, 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59149 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:16.618 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011605+0000", 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011614+0000", 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3219999999999993e-06 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011634+0000", 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0703000000000002e-05 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.620 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011649+0000", 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4603000000000001e-05 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049788+0000", 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038138500999999998 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.621 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049801+0000", 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3244000000000001e-05 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59150 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.567396035000002, 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038171956999999999, 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.622 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59150 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:16.623 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011671+0000", 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-11T07:08:16.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011678+0000", 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011696+0000", 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-05 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011710+0000", 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3516000000000001e-05 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049835+0000", 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038125004999999997 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049842+0000", 2024-09-11T07:08:16.626 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0299999999999996e-06 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59154 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 75.567160326000007, 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038170655999999997, 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.627 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59154 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011907+0000", 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1739999999999999e-06 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.629 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011974+0000", 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7200999999999996e-05 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011995+0000", 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1058999999999999e-05 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012015+0000", 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9857e-05 2024-09-11T07:08:16.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050060+0000", 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038045074999999998 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050076+0000", 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6290000000000002e-05 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.632 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:70560 3.2 3:459eba64:::rbd_data.11618cc4d69.000000000000003a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-11T07:08:16.632 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:16.632 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.118929721999997, 2024-09-11T07:08:16.632 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064825956000000004, 2024-09-11T07:08:16.632 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.632 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:16.632 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 70560 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.633 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460139+0000", 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.634 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460150+0000", 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0824e-05 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460178+0000", 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8449000000000002e-05 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460199+0000", 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1075999999999999e-05 2024-09-11T07:08:16.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460319+0000", 2024-09-11T07:08:16.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119714 2024-09-11T07:08:16.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.636 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.636 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460451+0000", 2024-09-11T07:08:16.636 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013264 2024-09-11T07:08:16.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.472543+0000", 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091437 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524779+0000", 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052236339 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524853+0000", 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524913+0000", 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0825000000000001e-05 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.638 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524962+0000", 2024-09-11T07:08:16.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8999999999999998e-05 2024-09-11T07:08:16.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.639 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.639 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.639 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71632 3.18 3:194b1b54:::rbd_data.1161b94a6d64.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:16.639 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:16.639 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 57.136672396000002, 2024-09-11T07:08:16.639 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039963481000000002, 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71632 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.640 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442395+0000", 2024-09-11T07:08:16.641 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442403+0000", 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6210000000000004e-06 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442416+0000", 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3011e-05 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442422+0000", 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2620000000000004e-06 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442495+0000", 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2977000000000003e-05 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.643 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442647+0000", 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015205199999999999 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.450708+0000", 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080612589999999994 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482090+0000", 2024-09-11T07:08:16.644 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031381543999999997 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482176+0000", 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6302000000000001e-05 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482279+0000", 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010242399999999999 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482357+0000", 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8565000000000004e-05 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73806 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14024704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 50.996265571000002, 2024-09-11T07:08:16.646 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038245594000000001, 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73806 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.647 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:08:16.648 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582804+0000", 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.836e-06 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582813+0000", 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030000000000003e-06 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.649 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582820+0000", 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9e-06 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620766+0000", 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037946800000000003 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.650 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620895+0000", 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012861799999999999 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621046+0000", 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015100700000000001 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.651 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73807 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14417920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 50.996237868999998, 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038841537000000002, 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73807 2024-09-11T07:08:16.652 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.653 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582829+0000", 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582857+0000", 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.779e-05 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.654 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582874+0000", 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7584999999999999e-05 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582882+0000", 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7999999999999999e-06 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621135+0000", 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038253044 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.655 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621390+0000", 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000254689 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621670+0000", 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027999500000000001 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.656 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.657 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.657 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73808 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14811136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:16.657 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:16.657 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 50.996172809999997, 2024-09-11T07:08:16.657 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039162267000000001, 2024-09-11T07:08:16.657 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.657 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.657 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.657 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.657 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73808 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.658 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582894+0000", 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582897+0000", 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4240000000000002e-06 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.659 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582907+0000", 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4299999999999995e-06 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582919+0000", 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1826e-05 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.660 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621769+0000", 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038850735999999997 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621898+0000", 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012898099999999999 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.661 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622056+0000", 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015718000000000001 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73809 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15204352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 50.996138694000003, 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039738290000000002, 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.662 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73809 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.663 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582928+0000", 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9999999999999997e-07 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.664 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582932+0000", 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8029999999999998e-06 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582947+0000", 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5099999999999999e-05 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582959+0000", 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.206e-05 2024-09-11T07:08:16.665 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622144+0000", 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039184999999999998 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622390+0000", 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024606600000000003 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.666 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622666+0000", 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027566100000000002 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73810 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15597568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 50.996089994999998, 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040289497000000001, 2024-09-11T07:08:16.667 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73810 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:16.668 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582977+0000", 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0100000000000001e-06 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.669 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582983+0000", 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583000+0000", 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7237000000000001e-05 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.670 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583014+0000", 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4076999999999999e-05 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622759+0000", 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039744806000000001 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.671 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622998+0000", 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000239385 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623266+0000", 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026730900000000003 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.672 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73811 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15990784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 50.996033976, 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040666513000000001, 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.673 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73811 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.674 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583033+0000", 2024-09-11T07:08:16.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.037e-06 2024-09-11T07:08:16.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.675 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.675 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583039+0000", 2024-09-11T07:08:16.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:08:16.675 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583079+0000", 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0438999999999997e-05 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583092+0000", 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2367e-05 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623365+0000", 2024-09-11T07:08:16.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040273182999999997 2024-09-11T07:08:16.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623518+0000", 2024-09-11T07:08:16.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015322099999999999 2024-09-11T07:08:16.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623699+0000", 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018055299999999999 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73812 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 16384000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:16.678 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 50.995961596999997, 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041168972999999998, 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73812 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.680 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583109+0000", 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1799999999999998e-06 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583120+0000", 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0380000000000001e-05 2024-09-11T07:08:16.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583127+0000", 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.029e-06 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623766+0000", 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040639210000000002 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624006+0000", 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240466 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624273+0000", 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026699100000000001 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:74137 3.1 3:833ccc20:::rbd_data.1161634664ee.0000000000000009:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 50.786713929999998, 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045679127999999999, 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 74137 2024-09-11T07:08:16.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792355+0000", 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.23e-06 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792368+0000", 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449000000000001e-05 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792398+0000", 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0519999999999999e-05 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792413+0000", 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4216000000000001e-05 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792538+0000", 2024-09-11T07:08:16.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012526099999999999 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792679+0000", 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014143099999999999 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.800911+0000", 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082317989999999997 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837839+0000", 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036927588999999997 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837869+0000", 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0355999999999999e-05 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:16.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837956+0000", 2024-09-11T07:08:16.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6967999999999998e-05 2024-09-11T07:08:16.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.690 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.690 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.838031+0000", 2024-09-11T07:08:16.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5308999999999993e-05 2024-09-11T07:08:16.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:114986 3.8 3:16fde53f:::rbd_data.1161a6ce22ad.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.165175100999999, 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047341314000000002, 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:16.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:16.692 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 114986 2024-09-11T07:08:16.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.692 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:16.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:16.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:16.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413894+0000", 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2660000000000002e-06 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:16.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413906+0000", 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2157000000000001e-05 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413935+0000", 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8585000000000002e-05 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413949+0000", 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4365999999999999e-05 2024-09-11T07:08:16.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.414062+0000", 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000112342 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.414287+0000", 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022574300000000001 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.423201+0000", 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089138370000000008 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.460776+0000", 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037574278000000003 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.460916+0000", 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014091 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.461094+0000", 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000177176 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:16.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.461232+0000", 2024-09-11T07:08:16.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013865399999999999 2024-09-11T07:08:16.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.698 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:16.698 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:16.698 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:16.700 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:16.700 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:16.694+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:16.800 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:16.794+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:16.832 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:16.832 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:16.832 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:16.847 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:16.901 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:16.894+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:16.971 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:16.971 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:16.972 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:16.985 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:17.001 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:16.998+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:17.102 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:17.098+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:17.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:08:17.157 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.157 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.866626079, 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:08:17.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:08:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:08:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:08:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:08:17.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.86655399599999, 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.163 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:08:17.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:17.168 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.866498503, 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:08:17.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:08:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:08:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:08:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:08:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.173 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.664626535, 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:08:17.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.664563945, 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.179 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.184 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66450688899999, 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.185 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:08:17.189 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.664450772, 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.190 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66432951, 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:08:17.195 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:17.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.664225241, 2024-09-11T07:08:17.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:08:17.201 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.201 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.201 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.201 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:08:17.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.201 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:08:17.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66411970199999, 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.206 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.207 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:08:17.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.210 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.664052539, 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.211 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:08:17.213 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.214 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.215 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66395333299999, 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.216 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:08:17.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.217 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:17.217 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.217 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.217 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.217 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.217 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.218 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.219 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:08:17.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66386637399999, 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.221 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66380609700001, 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:08:17.226 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:17.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.228 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:08:17.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:08:17.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:08:17.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.231 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.231 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.231 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.663652392, 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:08:17.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:08:17.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66356521599999, 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.237 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:08:17.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.663501313, 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.242 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:08:17.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.246 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66344147, 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.247 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:17.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:08:17.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:17.252 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.66336338799999, 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:08:17.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.255 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:08:17.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.663305618, 2024-09-11T07:08:17.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.260 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.262 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:17.263 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7, 0] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:08:17.263 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:08:17.263 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T07:08:17.263 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T07:08:17.265 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:17.265 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:17.258+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:17.366 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:17.362+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:17.442 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:17.443 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:17.443 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:17.443 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:17.458 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:17.505 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:17.502+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:17.568 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:17.562+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:17.572 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:08:17.572 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:17.572 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 137, 2024-09-11T07:08:17.572 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "e1313abd-54a9-4e53-ab67-469f744048b1", 2024-09-11T07:08:17.572 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-11T07:05:29.098467+0000", 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-11T07:08:17.111239+0000", 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-11T07:05:41.051856+0000", 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-11T07:08:07.002217+0000", 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5804032, 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "nodeep-scrub", 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-11T07:08:17.573 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "luminous", 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "squid", 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:41.897005+0000", 2024-09-11T07:08:17.574 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-11T07:08:17.575 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:08:17.576 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:08:17.577 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:08:17.578 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-11T07:08:17.579 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 6.9000000953674316, 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 6.9000000953674316, 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.28999999165534973, 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.580 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:47.687214+0000", 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:08:17.581 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:08:17.582 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "20", 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 2, 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 20, 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:08:17.583 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:08:17.584 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:08:17.585 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.75, 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.75, 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 1, 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.75, 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.75, 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.586 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:57.298060+0000", 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:08:17.587 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:08:17.588 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "137", 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 49, 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 137, 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:08:17.589 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:08:17.590 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:08:17.591 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.5299999713897705, 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.5299999713897705, 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 1, 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.592 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "24d57cdb-2f3a-4a96-903d-11be7dc26a20", 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 132, 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:17.593 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-11T07:08:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.594 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.595 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.596 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:17.597 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/1708235775", 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/1708235775", 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/1708235775", 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/1708235775", 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:17.598 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "aa51dc1b-b783-4212-8736-1f666239613b", 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 131, 2024-09-11T07:08:17.599 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.600 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:17.601 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.602 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.603 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/2076268206", 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/2076268206", 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/2076268206", 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/2076268206", 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "141a913f-7353-44a9-9dbd-70219bcee638", 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:17.604 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 131, 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-11T07:08:17.605 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:17.606 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.607 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.608 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/1904492349", 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/1904492349", 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/1904492349", 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/1904492349", 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:17.609 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "32550aeb-0c8d-4ca9-afd5-3e5258e7255b", 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:17.610 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 133, 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.611 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:17.612 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.613 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.614 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/1327328912", 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/1327328912", 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/1327328912", 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/1327328912", 2024-09-11T07:08:17.615 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc", 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 0, 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0, 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 0, 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:17.616 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6808", 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.617 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6809", 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6810", 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.618 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6811", 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6814", 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.619 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6815", 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6812", 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.620 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6813", 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6809/4087452871", 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6811/4087452871", 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6815/4087452871", 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6813/4087452871", 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:17.621 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "42c83053-328e-4c9b-bdaf-09e1a4cc8b7d", 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 108, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:17.622 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6824", 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6825", 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.623 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6826", 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6827", 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.624 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6830", 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6831", 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.625 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6828", 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6829", 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.626 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6825/2133006853", 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6827/2133006853", 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6831/2133006853", 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6829/2133006853", 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "0ab29b1f-3012-4528-8f47-2cac908122c9", 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:17.627 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0.9810333251953125, 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 0.3728179931640625, 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 131, 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6816", 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:17.628 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6817", 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6818", 2024-09-11T07:08:17.629 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6819", 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6822", 2024-09-11T07:08:17.630 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6823", 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6820", 2024-09-11T07:08:17.631 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6821", 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6817/2083734892", 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6819/2083734892", 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6823/2083734892", 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6821/2083734892", 2024-09-11T07:08:17.632 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d9c7d12b-be93-41c9-a246-773faa65ecaf", 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:17.633 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 132, 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6800", 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6801", 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:17.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6802", 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6803", 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.635 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6806", 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6807", 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.636 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6804", 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6805", 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6801/2322042784", 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6803/2322042784", 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2322042784", 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2322042784", 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:17.638 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.653648+0000", 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.846269+0000", 2024-09-11T07:08:17.639 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.970884+0000", 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:08:17.640 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.985630+0000", 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:17.641 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 65536, 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.236412+0000", 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.336953+0000", 2024-09-11T07:08:17.642 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.306806+0000", 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.643 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.104744+0000", 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [ 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: "pgid": "2.0", 2024-09-11T07:08:17.644 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: 0, 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: 6 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [ 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: "pgid": "3.17", 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: "mappings": [ 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: "from": 5, 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: "to": 2 2024-09-11T07:08:17.645 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-11T07:08:17.646 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [ 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 31, 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 6 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [ 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 31, 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 1 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:17.648 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-11T07:08:17.649 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-11T07:08:17.649 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-11T07:08:17.649 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-11T07:08:17.649 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-11T07:08:17.649 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-11T07:08:17.649 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-11T07:08:17.649 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-11T07:08:17.649 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-11T07:08:17.649 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:17.649 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:17.651 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:17.651 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:17.651 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:17.652 INFO:tasks.thrashosds.thrasher:j is {'epoch': 137, 'fsid': 'e1313abd-54a9-4e53-ab67-469f744048b1', 'created': '2024-09-11T07:05:29.098467+0000', 'modified': '2024-09-11T07:08:17.111239+0000', 'last_up_change': '2024-09-11T07:05:41.051856+0000', 'last_in_change': '2024-09-11T07:08:07.002217+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T07:05:41.897005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T07:05:47.687214+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T07:05:57.298060+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '137', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 49, 'snap_epoch': 137, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5299999713897705, 'score_stable': 1.5299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}], 'osds': [{'osd': 0, 'uuid': '24d57cdb-2f3a-4a96-903d-11be7dc26a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6825', 'nonce': 1708235775}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6826', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 1708235775}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6830', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 1708235775}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6829', 'nonce': 1708235775}]}, 'public_addr': '172.21.15.79:6825/1708235775', 'cluster_addr': '172.21.15.79:6827/1708235775', 'heartbeat_back_addr': '172.21.15.79:6831/1708235775', 'heartbeat_front_addr': '172.21.15.79:6829/1708235775', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa51dc1b-b783-4212-8736-1f666239613b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 2076268206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 2076268206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 2076268206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 2076268206}]}, 'public_addr': '172.21.15.79:6801/2076268206', 'cluster_addr': '172.21.15.79:6803/2076268206', 'heartbeat_back_addr': '172.21.15.79:6807/2076268206', 'heartbeat_front_addr': '172.21.15.79:6805/2076268206', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '141a913f-7353-44a9-9dbd-70219bcee638', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6817', 'nonce': 1904492349}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6818', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1904492349}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6822', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 1904492349}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6821', 'nonce': 1904492349}]}, 'public_addr': '172.21.15.79:6817/1904492349', 'cluster_addr': '172.21.15.79:6819/1904492349', 'heartbeat_back_addr': '172.21.15.79:6823/1904492349', 'heartbeat_front_addr': '172.21.15.79:6821/1904492349', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '32550aeb-0c8d-4ca9-afd5-3e5258e7255b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 1327328912}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 1327328912}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 1327328912}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 1327328912}]}, 'public_addr': '172.21.15.79:6809/1327328912', 'cluster_addr': '172.21.15.79:6811/1327328912', 'heartbeat_back_addr': '172.21.15.79:6815/1327328912', 'heartbeat_front_addr': '172.21.15.79:6813/1327328912', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 100, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 4087452871}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 4087452871}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 4087452871}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 4087452871}]}, 'public_addr': '172.21.15.110:6809/4087452871', 'cluster_addr': '172.21.15.110:6811/4087452871', 'heartbeat_back_addr': '172.21.15.110:6815/4087452871', 'heartbeat_front_addr': '172.21.15.110:6813/4087452871', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '42c83053-328e-4c9b-bdaf-09e1a4cc8b7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 108, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 2133006853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 2133006853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 2133006853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 2133006853}]}, 'public_addr': '172.21.15.110:6825/2133006853', 'cluster_addr': '172.21.15.110:6827/2133006853', 'heartbeat_back_addr': '172.21.15.110:6831/2133006853', 'heartbeat_front_addr': '172.21.15.110:6829/2133006853', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0ab29b1f-3012-4528-8f47-2cac908122c9', 'up': 1, 'in': 1, 'weight': 0.9810333251953125, 'primary_affinity': 0.3728179931640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 2083734892}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 2083734892}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 2083734892}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 2083734892}]}, 'public_addr': '172.21.15.110:6817/2083734892', 'cluster_addr': '172.21.15.110:6819/2083734892', 'heartbeat_back_addr': '172.21.15.110:6823/2083734892', 'heartbeat_front_addr': '172.21.15.110:6821/2083734892', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'd9c7d12b-be93-41c9-a246-773faa65ecaf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2322042784}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2322042784}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2322042784}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2322042784}]}, 'public_addr': '172.21.15.110:6801/2322042784', 'cluster_addr': '172.21.15.110:6803/2322042784', 'heartbeat_back_addr': '172.21.15.110:6807/2322042784', 'heartbeat_front_addr': '172.21.15.110:6805/2322042784', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.653648+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.846269+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.970884+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.985630+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.236412+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.336953+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.306806+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.104744+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.0', 'osds': [0, 6]}], 'pg_upmap_items': [{'pgid': '3.17', 'mappings': [{'from': 5, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 31, 'length': 6}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 31, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T07:08:17.652 INFO:tasks.thrashosds.thrasher:Clearing pg_upmap on 3.17 2024-09-11T07:08:17.652 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd rm-pg-upmap-items 3.17 2024-09-11T07:08:17.653 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:17.694 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:17.690+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:17.724 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:08:17.781 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:17.778+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.511328761, 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.825 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:08:17.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.829 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.511247924, 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.830 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.834 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.511204578, 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:08:17.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:08:17.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.511134453, 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.839 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:17.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.843 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.511066329, 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.847 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.511025863, 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.848 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:08:17.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:08:17.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:17.852 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.510987822, 2024-09-11T07:08:17.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:08:17.853 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.853 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.853 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.853 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:08:17.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:08:17.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:17.857 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.510948852, 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:08:17.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:08:17.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.51090797800001, 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.865 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.510580205, 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.869 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.510513695, 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:08:17.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:08:17.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.510445976, 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:08:17.874 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.510401038, 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:08:17.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.881 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.509601413, 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.883 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:08:17.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.50956707100001, 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.888 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:08:17.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.509204396, 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.892 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:08:17.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.896 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 109.571303445, 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:08:17.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:08:17.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.902 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109724 3.1d 3:bd9f0dd6:::rbd_data.1161dd0f3253.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.301428207000001, 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.063964249000000001, 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.903 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109724 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519447+0000", 2024-09-11T07:08:17.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1799999999999999e-06 2024-09-11T07:08:17.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523605+0000", 2024-09-11T07:08:17.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041584270000000001 2024-09-11T07:08:17.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523644+0000", 2024-09-11T07:08:17.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8908000000000001e-05 2024-09-11T07:08:17.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523661+0000", 2024-09-11T07:08:17.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7198999999999999e-05 2024-09-11T07:08:17.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523781+0000", 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011950799999999999 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.524055+0000", 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027451199999999998 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:17.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.548286+0000", 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.024231249 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583267+0000", 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.034980245 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583326+0000", 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9815999999999998e-05 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583372+0000", 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6074e-05 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583409+0000", 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6130999999999997e-05 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.909 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109733 3.5 3:a2b45ebf:::rbd_data.1161dd0f3253.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 39.219827502000001, 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067924668999999993, 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109733 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.910 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601047+0000", 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.029e-06 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601058+0000", 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0974e-05 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601083+0000", 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4757999999999999e-05 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601099+0000", 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5733e-05 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601212+0000", 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113857 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601453+0000", 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240657 2024-09-11T07:08:17.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.613355+0000", 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01190186 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668765+0000", 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055410261000000002 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:17.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668796+0000", 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0833000000000001e-05 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668891+0000", 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4708000000000002e-05 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668970+0000", 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8998999999999994e-05 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:111102 3.1d 3:b9ff0ad7:::rbd_object_map.1161dd0f3253:head [read 0~42] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 33.984997012000001, 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.014308821, 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 111102 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.916 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835877+0000", 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.564e-06 2024-09-11T07:08:17.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835883+0000", 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0909999999999998e-06 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835900+0000", 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.668e-05 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835907+0000", 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2660000000000004e-06 2024-09-11T07:08:17.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835963+0000", 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5933999999999997e-05 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835972+0000", 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1449999999999997e-06 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849359+0000", 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0133867839999999 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849663+0000", 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030396600000000002 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.850184+0000", 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052139099999999996 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:17.920 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:17.921 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:17.922 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:17.922 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:17.923 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:17.923 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:17.923 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:17.918+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:17.924 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:17.924 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:17.929 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:17.930 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:17.950 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:17.950 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:17.970 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:17.970 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:17.989 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:17.989 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:18.007 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:18.008 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:18.023 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:18.018+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:18.093 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:18.108 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:18.123 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:18.118+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:18.134 INFO:teuthology.orchestra.run.smithi079.stderr:clear 3.17 pg_upmap_items mapping 2024-09-11T07:08:18.140 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:08:18.225 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:18.218+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:18.281 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:18.282 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:18.297 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:18.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:18.322+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:18.426 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:18.422+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:18.465 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:18.465 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:18.479 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:18.527 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:18.522+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:18.601 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:18.601 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:18.615 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:18.628 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:18.622+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:18.729 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:18.726+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:18.737 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:18.737 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:18.751 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:18.830 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:18.826+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:18.872 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:18.872 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:18.886 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:18.931 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:18.926+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:19.019 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:19.019 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:19.032 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:19.026+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:19.033 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:19.133 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:19.130+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:19.159 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:19.159 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:19.174 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:19.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:19.230+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:19.297 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:19.297 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:19.312 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:19.354 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:19.350+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:19.436 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:19.434+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:19.476 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:19.476 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:19.491 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:19.537 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:19.534+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:19.612 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:19.612 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:19.626 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:19.670 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:19.666+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:19.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:19.734+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:19.791 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:19.791 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:19.805 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:19.850 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:19.846+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:19.940 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:19.934+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:19.972 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:19.973 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:19.987 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:20.025 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:20.041 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:20.038+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:20.142 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:20.138+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:20.161 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:20.161 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:20.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:08:20.180 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:20.182 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:20.183 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:20.202 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:20.202 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:20.221 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:20.221 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:20.241 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:20.242 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:20.243 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:20.238+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:20.265 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:20.265 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:20.286 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:20.286 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:20.307 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.307 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59289 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:head [stat,truncate 11010048] snapc 20=[20] ondisk+write+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.289943375000007, 2024-09-11T07:08:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.024828697, 2024-09-11T07:08:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.308 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59289 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015463+0000", 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.309 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015467+0000", 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6200000000000001e-06 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015483+0000", 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5962999999999999e-05 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015531+0000", 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7964999999999999e-05 2024-09-11T07:08:20.310 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015554+0000", 2024-09-11T07:08:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3493e-05 2024-09-11T07:08:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.311 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.015723+0000", 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000169121 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016035+0000", 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00031174000000000002 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 3", 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.016468+0000", 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00043272900000000002 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.312 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.039067+0000", 2024-09-11T07:08:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.022598894000000001 2024-09-11T07:08:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040107+0000", 2024-09-11T07:08:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0010398860000000001 2024-09-11T07:08:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.313 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040212+0000", 2024-09-11T07:08:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010577399999999999 2024-09-11T07:08:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.314 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.040292+0000", 2024-09-11T07:08:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9511999999999994e-05 2024-09-11T07:08:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62120 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3457024~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.315 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.506607400000007, 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011832135000000001, 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62120 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.316 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798799+0000", 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798800+0000", 2024-09-11T07:08:20.317 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6400000000000002e-07 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798804+0000", 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0419999999999996e-06 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798813+0000", 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6870000000000006e-06 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.318 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798819+0000", 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6810000000000003e-06 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810180+0000", 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011361069999999999 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810372+0000", 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000191456 2024-09-11T07:08:20.319 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810631+0000", 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00025963499999999998 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62121 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3522560~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.506579220000006, 2024-09-11T07:08:20.320 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01236723, 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62121 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:20.321 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798827+0000", 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798828+0000", 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7800000000000002e-07 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.322 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798830+0000", 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.633e-06 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798839+0000", 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3019999999999995e-06 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798844+0000", 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2549999999999997e-06 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.323 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810713+0000", 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011869151 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.810925+0000", 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00021164999999999999 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811195+0000", 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026976099999999998 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.324 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62122 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3588096~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.506540293, 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012886078, 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.325 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62122 2024-09-11T07:08:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.326 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798866+0000", 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798867+0000", 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2600000000000002e-07 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798870+0000", 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0630000000000002e-06 2024-09-11T07:08:20.327 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798878+0000", 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8669999999999994e-06 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798902+0000", 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4167000000000001e-05 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811275+0000", 2024-09-11T07:08:20.328 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012373454000000001 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811484+0000", 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020880000000000001 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811752+0000", 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026820099999999998 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.329 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:62123 3.17 3:ef1c1218:::rbd_data.11614049bfb5.0000000000000002:20 [read 3653632~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 78.506491914999998, 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013329191000000001, 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 62123 2024-09-11T07:08:20.330 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:20.331 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798915+0000", 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6300000000000004e-07 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798918+0000", 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0750000000000002e-06 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.332 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798926+0000", 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8839999999999994e-06 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.798933+0000", 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0169999999999999e-06 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.811830+0000", 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012896179000000001 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.333 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812072+0000", 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024236200000000001 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.812244+0000", 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017191099999999999 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.334 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:103753 3.a 3.fa1caca (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e98)", 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 45.978087097, 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89411045099999997, 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 103753 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.335 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327319+0000", 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327322+0000", 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5799999999999999e-06 2024-09-11T07:08:20.336 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327333+0000", 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.117e-05 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327355+0000", 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1486999999999999e-05 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.337 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327367+0000", 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2242000000000001e-05 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327446+0000", 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9503000000000001e-05 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:34.327454+0000", 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6510000000000001e-06 2024-09-11T07:08:20.338 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:35.221416+0000", 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.89396147999999998 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:35.221430+0000", 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4338000000000001e-05 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.339 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:109788 3.a 3:562ca8e0:::rbd_data.1161dd0f3253.0000000000000007:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 6291456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.576092373000002, 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012764114, 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 109788 2024-09-11T07:08:20.340 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729314+0000", 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.341 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.729318+0000", 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1060000000000002e-06 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731829+0000", 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0025105679999999999 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731859+0000", 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0043e-05 2024-09-11T07:08:20.342 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.731879+0000", 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0305e-05 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732019+0000", 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013981900000000001 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732286+0000", 2024-09-11T07:08:20.343 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026720599999999998 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.732745+0000", 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00045896799999999997 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741444+0000", 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0086986819999999992 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:20.344 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741887+0000", 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00044320900000000002 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.741972+0000", 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5326000000000003e-05 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.742078+0000", 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000105882 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.345 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop(client.4449.0:109791 3.9 e102/101 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head v 102'194, mlcod=102'192)", 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.559922460000003, 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012074544, 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:20.346 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745484+0000", 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.745486+0000", 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.886e-06 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.347 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750110+0000", 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.004624459 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750140+0000", 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9947999999999999e-05 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750161+0000", 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0449e-05 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.348 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750277+0000", 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000115986 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.750315+0000", 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7954000000000003e-05 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.757455+0000", 2024-09-11T07:08:20.349 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0071403680000000002 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:38.757559+0000", 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103494 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:109908 3.a 3:562ca8e0:::rbd_data.1161dd0f3253.0000000000000007:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.280181814999999, 2024-09-11T07:08:20.350 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047375651999999997, 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 109908 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:20.351 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025225+0000", 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025228+0000", 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.993e-06 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.352 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025241+0000", 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3363000000000001e-05 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025272+0000", 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0633999999999998e-05 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025305+0000", 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2821999999999998e-05 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.353 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025442+0000", 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000137575 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.025572+0000", 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012960200000000001 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.033596+0000", 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080244159999999995 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.354 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072266+0000", 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038670084 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072397+0000", 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000130653 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072491+0000", 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4320000000000005e-05 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.355 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072600+0000", 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010919 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_repop_reply(client.4449.0:109908 3.a e102/101 ondisk, result = 0)", 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 41.246241769999997, 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013453283, 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.356 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059165+0000", 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.357 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059167+0000", 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9989999999999998e-06 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059178+0000", 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1240000000000001e-05 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059211+0000", 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3417999999999998e-05 2024-09-11T07:08:20.358 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.059242+0000", 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0775000000000003e-05 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072352+0000", 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.013109536999999999 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072380+0000", 2024-09-11T07:08:20.359 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7905000000000001e-05 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:39.072618+0000", 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000238409 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112577 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 4128768~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.340943340999999, 2024-09-11T07:08:20.360 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01152213, 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112577 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.361 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964463+0000", 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964464+0000", 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.27e-07 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964470+0000", 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3840000000000002e-06 2024-09-11T07:08:20.362 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964478+0000", 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2989999999999997e-06 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964483+0000", 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9559999999999996e-06 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975836+0000", 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011353221 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.363 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975904+0000", 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7229000000000003e-05 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.975985+0000", 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1613999999999995e-05 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.364 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112578 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 4653056~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.340880984000002, 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011630053, 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112578 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.365 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964526+0000", 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6499999999999999e-07 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.366 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964529+0000", 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.768e-06 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964537+0000", 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7489999999999998e-06 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.367 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964543+0000", 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9070000000000004e-06 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976015+0000", 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011472141999999999 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976077+0000", 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2373999999999996e-05 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.368 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976156+0000", 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8547999999999994e-05 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112579 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 5177344~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.340856109999997, 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011724089, 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.369 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112579 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964550+0000", 2024-09-11T07:08:20.370 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964551+0000", 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3600000000000004e-07 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964553+0000", 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2419999999999999e-06 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.371 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964560+0000", 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3409999999999999e-06 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964565+0000", 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2259999999999996e-06 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976180+0000", 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011615122 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.372 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976221+0000", 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1115000000000002e-05 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976275+0000", 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3507000000000001e-05 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.373 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112580 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 5701632~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.340834616999999, 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011867212, 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112580 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.374 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964572+0000", 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1199999999999998e-07 2024-09-11T07:08:20.375 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964574+0000", 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.013e-06 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964581+0000", 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1019999999999999e-06 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.376 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964587+0000", 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6289999999999998e-06 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976300+0000", 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.011712854999999999 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976361+0000", 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0788000000000001e-05 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.377 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976439+0000", 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8412999999999996e-05 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112581 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 6225920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.340812485000001, 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012017570999999999, 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.378 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112581 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.379 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964594+0000", 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6699999999999999e-07 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964597+0000", 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1040000000000001e-06 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.380 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964603+0000", 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0419999999999999e-06 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964608+0000", 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9439999999999996e-06 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976465+0000", 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01185747 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.381 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976527+0000", 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2198000000000003e-05 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976612+0000", 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4445999999999998e-05 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112582 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 6750208~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:20.382 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.340792295999996, 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012177538999999999, 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112582 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:20.383 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964614+0000", 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964615+0000", 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3300000000000003e-07 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.384 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964617+0000", 2024-09-11T07:08:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0090000000000002e-06 2024-09-11T07:08:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964623+0000", 2024-09-11T07:08:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0109999999999997e-06 2024-09-11T07:08:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.385 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964627+0000", 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7949999999999998e-06 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976641+0000", 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012013642 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976707+0000", 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5747000000000006e-05 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.386 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976792+0000", 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4901999999999995e-05 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112583 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 7274496~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.340772653000002, 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012338040999999999, 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.387 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112583 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.388 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964634+0000", 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9999999999999998e-07 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964636+0000", 2024-09-11T07:08:20.389 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9999999999999999e-06 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964642+0000", 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0970000000000002e-06 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964654+0000", 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1616e-05 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.390 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976820+0000", 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012165924999999999 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976884+0000", 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3818000000000005e-05 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.976972+0000", 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8184999999999997e-05 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.391 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112584 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 7798784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.340744598000001, 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012480952999999999, 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.392 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112584 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.393 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964662+0000", 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7e-07 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964665+0000", 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3590000000000002e-06 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964671+0000", 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3169999999999998e-06 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.394 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964676+0000", 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1120000000000004e-06 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977003+0000", 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012326467000000001 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977069+0000", 2024-09-11T07:08:20.395 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6172000000000003e-05 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977143+0000", 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4055999999999997e-05 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:112585 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:2e [sparse-read 8323072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:20.396 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.340723246000003, 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012584098, 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 112585 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.397 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964683+0000", 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964684+0000", 2024-09-11T07:08:20.398 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7599999999999997e-07 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964686+0000", 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.131e-06 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964692+0000", 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2360000000000001e-06 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.399 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.964697+0000", 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.967e-06 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977169+0000", 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.01247183 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977224+0000", 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4632999999999997e-05 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.400 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:47.977267+0000", 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3724999999999999e-05 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:113546 3.9 3:95ef5f75:::rbd_data.1161428332f9.0000000000000020:head [set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 31.454014674, 2024-09-11T07:08:20.401 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.019568058999999999, 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 113546 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.402 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851392+0000", 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851395+0000", 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.853e-06 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851410+0000", 2024-09-11T07:08:20.403 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5259000000000001e-05 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851445+0000", 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.5048000000000001e-05 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851469+0000", 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3555999999999999e-05 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851597+0000", 2024-09-11T07:08:20.404 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000128594 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.851838+0000", 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240941 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 7", 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.855619+0000", 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0037808859999999998 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:20.405 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870762+0000", 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.015143115 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870793+0000", 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0525000000000003e-05 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870882+0000", 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9159000000000005e-05 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.406 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:48.870960+0000", 2024-09-11T07:08:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8122999999999997e-05 2024-09-11T07:08:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.407 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.407 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:20.408 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:20.408 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:20.409 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:20.410 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:20.410 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:20.411 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:20.402+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:20.509 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:20.502+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:20.579 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:20.579 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:20.579 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:20.594 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:20.610 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:20.606+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:20.711 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:20.706+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:20.760 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:20.760 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:20.760 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:20.774 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:20.818 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:20.814+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:20.838 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:08:20.913 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:20.906+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:20.953 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 103.327240128, 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.954 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.955 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:08:20.956 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.957 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.958 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.959 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59115 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.940638574999994, 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038255633999999997, 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.960 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59115 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.961 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010877+0000", 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.083e-06 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010885+0000", 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0400000000000004e-06 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010931+0000", 2024-09-11T07:08:20.962 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6452000000000002e-05 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010947+0000", 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5786000000000001e-05 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049022+0000", 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038075472999999999 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.963 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049076+0000", 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4131000000000001e-05 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049132+0000", 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5668999999999998e-05 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59119 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.940546925000007, 2024-09-11T07:08:20.964 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038492673999999998, 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59119 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.965 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010969+0000", 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010976+0000", 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4529999999999999e-06 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.966 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010994+0000", 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8672999999999999e-05 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011009+0000", 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4122e-05 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049189+0000", 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038180218000000002 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.967 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049342+0000", 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015341899999999999 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049461+0000", 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118522 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59138 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.968 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.940488110000004, 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038631255000000003, 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59138 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:20.969 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011028+0000", 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.970 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011034+0000", 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011049+0000", 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5702999999999999e-05 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011063+0000", 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3373000000000001e-05 2024-09-11T07:08:20.971 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049512+0000", 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038449050999999998 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049601+0000", 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9395999999999996e-05 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.972 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049658+0000", 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6861999999999999e-05 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59147 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.940249428000001, 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038436533000000002, 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.973 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59147 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:20.974 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011267+0000", 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.46e-06 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011278+0000", 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.119e-05 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.975 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011457+0000", 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017874699999999999 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011481+0000", 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4283000000000001e-05 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049693+0000", 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038212053000000003 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.976 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049702+0000", 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59148 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.939992250000003, 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038227694999999999, 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.977 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59148 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:20.978 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011525+0000", 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011536+0000", 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.979 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011561+0000", 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5494999999999999e-05 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011579+0000", 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7292999999999999e-05 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049739+0000", 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038159803999999999 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049750+0000", 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59149 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.939910939000001, 2024-09-11T07:08:20.981 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038196747000000003, 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59149 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.982 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011605+0000", 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011614+0000", 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3219999999999993e-06 2024-09-11T07:08:20.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011634+0000", 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0703000000000002e-05 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011649+0000", 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4603000000000001e-05 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.984 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049788+0000", 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038138500999999998 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049801+0000", 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3244000000000001e-05 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.985 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59150 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.939844918000006, 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038171956999999999, 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59150 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.986 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011671+0000", 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.987 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011678+0000", 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011696+0000", 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-05 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011710+0000", 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3516000000000001e-05 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.988 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049835+0000", 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038125004999999997 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049842+0000", 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0299999999999996e-06 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59154 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:20.989 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 79.939609208999997, 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038170655999999997, 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59154 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.990 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011907+0000", 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1739999999999999e-06 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011974+0000", 2024-09-11T07:08:20.991 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7200999999999996e-05 2024-09-11T07:08:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011995+0000", 2024-09-11T07:08:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1058999999999999e-05 2024-09-11T07:08:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012015+0000", 2024-09-11T07:08:20.992 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9857e-05 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050060+0000", 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038045074999999998 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050076+0000", 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6290000000000002e-05 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.993 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:70560 3.2 3:459eba64:::rbd_data.11618cc4d69.000000000000003a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.491378604999994, 2024-09-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064825956000000004, 2024-09-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:20.994 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 70560 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:20.995 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460139+0000", 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460150+0000", 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0824e-05 2024-09-11T07:08:20.996 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460178+0000", 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8449000000000002e-05 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460199+0000", 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1075999999999999e-05 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:20.997 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460319+0000", 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119714 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460451+0000", 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013264 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.472543+0000", 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091437 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.998 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524779+0000", 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052236339 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524853+0000", 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524913+0000", 2024-09-11T07:08:20.999 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0825000000000001e-05 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524962+0000", 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8999999999999998e-05 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71632 3.18 3:194b1b54:::rbd_data.1161b94a6d64.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 61.509121278999999, 2024-09-11T07:08:21.000 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039963481000000002, 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71632 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.001 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442395+0000", 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.002 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442403+0000", 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6210000000000004e-06 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442416+0000", 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3011e-05 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442422+0000", 2024-09-11T07:08:21.003 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2620000000000004e-06 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442495+0000", 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2977000000000003e-05 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442647+0000", 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015205199999999999 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.450708+0000", 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080612589999999994 2024-09-11T07:08:21.004 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482090+0000", 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031381543999999997 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482176+0000", 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6302000000000001e-05 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:21.005 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482279+0000", 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010242399999999999 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482357+0000", 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8565000000000004e-05 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73806 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14024704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:21.006 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.368714453999999, 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038245594000000001, 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73806 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:21.007 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582804+0000", 2024-09-11T07:08:21.008 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.836e-06 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582813+0000", 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030000000000003e-06 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582820+0000", 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9e-06 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.009 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620766+0000", 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037946800000000003 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620895+0000", 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012861799999999999 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621046+0000", 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015100700000000001 2024-09-11T07:08:21.010 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73807 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14417920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.368686752000002, 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038841537000000002, 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:21.011 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73807 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.012 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582829+0000", 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582857+0000", 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.779e-05 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582874+0000", 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7584999999999999e-05 2024-09-11T07:08:21.013 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582882+0000", 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7999999999999999e-06 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621135+0000", 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038253044 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:21.014 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621390+0000", 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000254689 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621670+0000", 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027999500000000001 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73808 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14811136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:21.015 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.368621693000001, 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039162267000000001, 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73808 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:21.016 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582894+0000", 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.017 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582897+0000", 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4240000000000002e-06 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582907+0000", 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4299999999999995e-06 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582919+0000", 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1826e-05 2024-09-11T07:08:21.018 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621769+0000", 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038850735999999997 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621898+0000", 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012898099999999999 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.019 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622056+0000", 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015718000000000001 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73809 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15204352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.368587577, 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039738290000000002, 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:21.020 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73809 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:21.021 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582928+0000", 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9999999999999997e-07 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582932+0000", 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8029999999999998e-06 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:21.022 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582947+0000", 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5099999999999999e-05 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582959+0000", 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.206e-05 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622144+0000", 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039184999999999998 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:21.023 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622390+0000", 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024606600000000003 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622666+0000", 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027566100000000002 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73810 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15597568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:21.024 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.368538878000003, 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040289497000000001, 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73810 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:21.025 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582977+0000", 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0100000000000001e-06 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582983+0000", 2024-09-11T07:08:21.026 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583000+0000", 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7237000000000001e-05 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583014+0000", 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4076999999999999e-05 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.027 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622759+0000", 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039744806000000001 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622998+0000", 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000239385 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623266+0000", 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026730900000000003 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.028 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73811 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15990784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.368482858999997, 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040666513000000001, 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.029 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73811 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.030 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583033+0000", 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.037e-06 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583039+0000", 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583079+0000", 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0438999999999997e-05 2024-09-11T07:08:21.031 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583092+0000", 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2367e-05 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623365+0000", 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040273182999999997 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.032 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623518+0000", 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015322099999999999 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623699+0000", 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018055299999999999 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.033 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73812 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 16384000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.368410480000001, 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041168972999999998, 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73812 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.034 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.035 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583109+0000", 2024-09-11T07:08:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1799999999999998e-06 2024-09-11T07:08:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583120+0000", 2024-09-11T07:08:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0380000000000001e-05 2024-09-11T07:08:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.036 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583127+0000", 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.029e-06 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623766+0000", 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040639210000000002 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624006+0000", 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240466 2024-09-11T07:08:21.037 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624273+0000", 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026699100000000001 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:74137 3.1 3:833ccc20:::rbd_data.1161634664ee.0000000000000009:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 55.159162813000002, 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045679127999999999, 2024-09-11T07:08:21.038 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 74137 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.039 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792355+0000", 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.23e-06 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792368+0000", 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449000000000001e-05 2024-09-11T07:08:21.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792398+0000", 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0519999999999999e-05 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792413+0000", 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4216000000000001e-05 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.041 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792538+0000", 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012526099999999999 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792679+0000", 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014143099999999999 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.800911+0000", 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082317989999999997 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.042 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837839+0000", 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036927588999999997 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837869+0000", 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0355999999999999e-05 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837956+0000", 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6967999999999998e-05 2024-09-11T07:08:21.043 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.838031+0000", 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5308999999999993e-05 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:114986 3.8 3:16fde53f:::rbd_data.1161a6ce22ad.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.537623984, 2024-09-11T07:08:21.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047341314000000002, 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 114986 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413894+0000", 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2660000000000002e-06 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413906+0000", 2024-09-11T07:08:21.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2157000000000001e-05 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413935+0000", 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8585000000000002e-05 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413949+0000", 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4365999999999999e-05 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.414062+0000", 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000112342 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.414287+0000", 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022574300000000001 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.423201+0000", 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089138370000000008 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.460776+0000", 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037574278000000003 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.460916+0000", 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014091 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:21.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.461094+0000", 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000177176 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.461232+0000", 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013865399999999999 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:21.050 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:21.052 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:21.052 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:21.046+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:21.153 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:21.146+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:21.183 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:21.184 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:21.184 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:21.184 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:21.199 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:21.254 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:21.250+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:21.321 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:21.321 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:21.321 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:21.336 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:21.381 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:21.378+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:21.456 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:21.450+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:21.464 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:21.464 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:21.464 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:21.464 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.173819107, 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:08:21.465 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.466 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.467 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:08:21.468 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.17374702399999, 2024-09-11T07:08:21.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:08:21.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.173691531, 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.474 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:21.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:08:21.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:21.478 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.971819563, 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.479 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.482 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.971756973, 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.483 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:08:21.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:21.487 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.971699917, 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.9716438, 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:08:21.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:08:21.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.971522538, 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:08:21.496 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:08:21.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.500 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.971418269, 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.501 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.97131272999999, 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.506 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:08:21.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:08:21.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.971245567, 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:08:21.510 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:08:21.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.971146361, 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:08:21.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:21.519 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.97105940199999, 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:08:21.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.523 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.97099912500001, 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.524 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:08:21.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.97084542, 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:08:21.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:08:21.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:21.533 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.970758244, 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:21.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:08:21.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.970694341, 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:08:21.538 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:08:21.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:08:21.542 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.970634498, 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:21.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.97055641599999, 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.548 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:08:21.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.970498646, 2024-09-11T07:08:21.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:08:21.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:08:21.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:21.556 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:21.557 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:21.558 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:21.558 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:21.554+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:21.658 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:21.654+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:21.729 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:21.730 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:21.730 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:21.730 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:21.744 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:21.760 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:21.758+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:21.860 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:21.854+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:21.913 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:21.913 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:21.914 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:21.914 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:21.928 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:21.961 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:21.958+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:22.062 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:22.058+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:22.102 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:22.102 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:22.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:22.102 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:22.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.78863657399999, 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:08:22.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.106 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.107 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.788555737, 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:22.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:22.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:08:22.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:08:22.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:08:22.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:08:22.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:08:22.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.788512391, 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:08:22.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.114 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:22.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:22.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.115 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.115 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:08:22.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:08:22.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.118 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:22.119 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.788442266, 2024-09-11T07:08:22.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:08:22.119 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.119 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.119 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.119 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.119 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.119 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.119 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:08:22.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.788374142, 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.124 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:08:22.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.128 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.78833367599999, 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:08:22.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.788295635, 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:08:22.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:08:22.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.138 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.78825666500001, 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:08:22.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:08:22.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:08:22.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:08:22.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:08:22.143 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.143 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.144 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.144 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.144 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:22.144 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.788215791, 2024-09-11T07:08:22.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:08:22.145 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.145 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.145 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.145 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.146 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.146 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:08:22.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.146 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:08:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:08:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:08:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:08:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:08:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:08:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:08:22.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:08:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:08:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:08:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:08:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:08:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:08:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:08:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.152 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.787888018, 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.153 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.156 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.157 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.78782150799999, 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:08:22.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:08:22.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.78775378900001, 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.162 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:08:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:08:22.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:08:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:08:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:08:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:08:22.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.787708851, 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.168 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:22.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.170 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.172 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:22.173 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.78690922600001, 2024-09-11T07:08:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:08:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:08:22.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.175 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:08:22.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.786874884, 2024-09-11T07:08:22.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:22.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.181 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.78651220899999, 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.183 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:08:22.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:08:22.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.187 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 113.84861125800001, 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.188 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:08:22.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.191 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:22.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109724 3.1d 3:bd9f0dd6:::rbd_data.1161dd0f3253.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.578736020000001, 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.063964249000000001, 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.194 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109724 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:22.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519447+0000", 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1799999999999999e-06 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523605+0000", 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041584270000000001 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523644+0000", 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8908000000000001e-05 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523661+0000", 2024-09-11T07:08:22.197 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7198999999999999e-05 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523781+0000", 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011950799999999999 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.524055+0000", 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027451199999999998 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.198 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.548286+0000", 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.024231249 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583267+0000", 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.034980245 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583326+0000", 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9815999999999998e-05 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.199 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583372+0000", 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6074e-05 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583409+0000", 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6130999999999997e-05 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109733 3.5 3:a2b45ebf:::rbd_data.1161dd0f3253.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:22.200 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 43.497135315000001, 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067924668999999993, 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109733 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.201 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.202 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601047+0000", 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.029e-06 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601058+0000", 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0974e-05 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601083+0000", 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4757999999999999e-05 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.203 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601099+0000", 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5733e-05 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601212+0000", 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113857 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.204 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601453+0000", 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240657 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.613355+0000", 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01190186 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668765+0000", 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055410261000000002 2024-09-11T07:08:22.205 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668796+0000", 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0833000000000001e-05 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668891+0000", 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4708000000000002e-05 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668970+0000", 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8998999999999994e-05 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.206 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:111102 3.1d 3:b9ff0ad7:::rbd_object_map.1161dd0f3253:head [read 0~42] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 38.262304825000001, 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.014308821, 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:22.207 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 111102 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.208 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835877+0000", 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.564e-06 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835883+0000", 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0909999999999998e-06 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835900+0000", 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.668e-05 2024-09-11T07:08:22.209 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835907+0000", 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2660000000000004e-06 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835963+0000", 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5933999999999997e-05 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:22.210 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835972+0000", 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1449999999999997e-06 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849359+0000", 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0133867839999999 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849663+0000", 2024-09-11T07:08:22.211 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030396600000000002 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.850184+0000", 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052139099999999996 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:22.212 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:22.214 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:22.214 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:22.210+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:22.315 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:22.310+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:22.384 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:22.384 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:22.384 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:22.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:22.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:08:22.441 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:22.438+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:22.516 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:22.510+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:22.565 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:22.566 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:22.566 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:22.566 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:22.567 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:22.567 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:22.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:22.582 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:22.582 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:22.598 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:22.598 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:22.616 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:22.616 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:22.617 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:22.610+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:22.636 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:22.636 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:22.654 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:22.654 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:22.672 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:22.672 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:22.690 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:22.690 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:22.744 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:22.745 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:22.750 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:22.746+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:22.759 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:22.819 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:22.814+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:22.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:08:22.884 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:22.885 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:22.902 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:22.949 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:22.946+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:23.021 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:23.018+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:23.022 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:23.022 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:23.036 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:23.123 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:23.118+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:23.169 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7, 0] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:08:23.169 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:08:23.169 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-11T07:08:23.169 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T07:08:23.169 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T07:08:23.170 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-11T07:08:23.208 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:23.208 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:23.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:23.224 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:23.218+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:23.294 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T07:08:23.294 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:23.324 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:23.318+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:23.342 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:23.343 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:23.356 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:23.445 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:23.442+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:23.512 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:23.512 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:23.526 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:23.522+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:23.527 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:23.627 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:23.622+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:23.690 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:23.690 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:23.704 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:23.753 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:23.750+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:23.825 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:23.826 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:23.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:23.822+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:23.839 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:23.857 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:08:23.929 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:23.926+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:23.989 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:23.989 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:24.005 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:24.030 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:24.026+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:24.131 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:24.126+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:24.181 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:24.181 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:24.195 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:24.232 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:24.226+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:24.319 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:24.319 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:24.333 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:24.334 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:24.330+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:24.434 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:24.430+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:24.454 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:24.454 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:24.468 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:24.553 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:24.550+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:24.635 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:24.635 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:24.636 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:24.630+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:24.650 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:24.708 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:24.737 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:24.734+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:24.820 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:24.820 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:24.836 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:24.837 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:24.834+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:24.881 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:24.882 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:24.902 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:24.902 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:24.926 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:24.926 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:24.938 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:24.934+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:24.945 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:24.945 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:24.967 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:24.968 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:24.971 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:24.971 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:24.972 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:24.972 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:24.972 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:24.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:24.992 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:24.992 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:25.014 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:25.014 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:25.036 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:25.036 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:25.039 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:25.034+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:37775 3.18 3:1c9b42c8:::rbd_data.1161d1131845.000000000000001a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 107.483353575, 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047301559999999999, 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:25.110 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 37775 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624275+0000", 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624277+0000", 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2189999999999998e-06 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624289+0000", 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1590000000000001e-05 2024-09-11T07:08:25.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624320+0000", 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1081000000000003e-05 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624335+0000", 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5213e-05 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624489+0000", 2024-09-11T07:08:25.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015366300000000001 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.624880+0000", 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00039157900000000003 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.633629+0000", 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0087485340000000005 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671366+0000", 2024-09-11T07:08:25.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037736883999999998 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671400+0000", 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4107999999999999e-05 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671495+0000", 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5223999999999995e-05 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:37.671576+0000", 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1464999999999993e-05 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59115 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5570560~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.096752022000004, 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038255633999999997, 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.116 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59115 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:25.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010876+0000", 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010877+0000", 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.083e-06 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.118 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010885+0000", 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0400000000000004e-06 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010931+0000", 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6452000000000002e-05 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010947+0000", 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5786000000000001e-05 2024-09-11T07:08:25.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049022+0000", 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038075472999999999 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049076+0000", 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4131000000000001e-05 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049132+0000", 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5668999999999998e-05 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59119 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5603328~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.096660372000002, 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038492673999999998, 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.121 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59119 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010968+0000", 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010969+0000", 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010976+0000", 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4529999999999999e-06 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.123 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.010994+0000", 2024-09-11T07:08:25.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.8672999999999999e-05 2024-09-11T07:08:25.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011009+0000", 2024-09-11T07:08:25.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4122e-05 2024-09-11T07:08:25.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049189+0000", 2024-09-11T07:08:25.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038180218000000002 2024-09-11T07:08:25.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049342+0000", 2024-09-11T07:08:25.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015341899999999999 2024-09-11T07:08:25.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049461+0000", 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118522 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59138 3.8 3:11835d46:::rbd_data.11616c31e2ad.0000000000000005:1e [read 5505024~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.096601557, 2024-09-11T07:08:25.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038631255000000003, 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59138 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:25.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011027+0000", 2024-09-11T07:08:25.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011028+0000", 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.08e-06 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011034+0000", 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7899999999999996e-06 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011049+0000", 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5702999999999999e-05 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011063+0000", 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3373000000000001e-05 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049512+0000", 2024-09-11T07:08:25.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038449050999999998 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049601+0000", 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9395999999999996e-05 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049658+0000", 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6861999999999999e-05 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.131 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.132 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59147 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:25.132 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:25.132 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.096362874999997, 2024-09-11T07:08:25.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038436533000000002, 2024-09-11T07:08:25.132 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.132 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.132 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59147 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011266+0000", 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011267+0000", 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.46e-06 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011278+0000", 2024-09-11T07:08:25.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.119e-05 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011457+0000", 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00017874699999999999 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011481+0000", 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4283000000000001e-05 2024-09-11T07:08:25.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049693+0000", 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038212053000000003 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049702+0000", 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8000000000000004e-06 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59148 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.096105696999999, 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038227694999999999, 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.137 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59148 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011523+0000", 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011525+0000", 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1069999999999999e-06 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011536+0000", 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.11e-05 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011561+0000", 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5494999999999999e-05 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011579+0000", 2024-09-11T07:08:25.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7292999999999999e-05 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049739+0000", 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038159803999999999 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049750+0000", 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1895999999999999e-05 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.140 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59149 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.096024385999996, 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038196747000000003, 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59149 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011604+0000", 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011605+0000", 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3740000000000001e-06 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011614+0000", 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3219999999999993e-06 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011634+0000", 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.0703000000000002e-05 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011649+0000", 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4603000000000001e-05 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049788+0000", 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038138500999999998 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049801+0000", 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3244000000000001e-05 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59150 3.8 3.62bac188 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:25.144 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.095958365000001, 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038171956999999999, 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59150 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.145 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011670+0000", 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011671+0000", 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.297e-06 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.146 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011678+0000", 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8390000000000001e-06 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011696+0000", 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.827e-05 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011710+0000", 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3516000000000001e-05 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.147 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049835+0000", 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038125004999999997 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.049842+0000", 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0299999999999996e-06 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.148 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:59154 3.8 3.8dfc6728 (undecoded) ondisk+read+known_if_redirected+supports_pool_eio e74)", 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 84.095722656000007, 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038170655999999997, 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 59154 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.149 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011906+0000", 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.150 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011907+0000", 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1739999999999999e-06 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011974+0000", 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7200999999999996e-05 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.011995+0000", 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1058999999999999e-05 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.151 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.012015+0000", 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9857e-05 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050060+0000", 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038045074999999998 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:01.050076+0000", 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6290000000000002e-05 2024-09-11T07:08:25.152 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:70560 3.2 3:459eba64:::rbd_data.11618cc4d69.000000000000003a:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 69.647492052000004, 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.064825956000000004, 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.153 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 70560 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.154 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460136+0000", 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460139+0000", 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3999999999999999e-06 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460150+0000", 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0824e-05 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.155 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460178+0000", 2024-09-11T07:08:25.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8449000000000002e-05 2024-09-11T07:08:25.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.156 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.156 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.156 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460199+0000", 2024-09-11T07:08:25.156 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1075999999999999e-05 2024-09-11T07:08:25.156 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460319+0000", 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000119714 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.460451+0000", 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013264 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.157 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 5", 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.472543+0000", 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012091437 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524779+0000", 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.052236339 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524853+0000", 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3251999999999996e-05 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.158 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524913+0000", 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0825000000000001e-05 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:15.524962+0000", 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8999999999999998e-05 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.159 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:71632 3.18 3:194b1b54:::rbd_data.1161b94a6d64.0000000000000002:head [set-alloc-hint object_size 33554432 write_size 33554432,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 65.665234725999994, 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039963481000000002, 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 71632 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.160 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.161 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:25.161 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.161 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.161 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.161 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442394+0000", 2024-09-11T07:08:25.162 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.162 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.162 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.162 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.162 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442395+0000", 2024-09-11T07:08:25.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4640000000000001e-06 2024-09-11T07:08:25.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.163 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.163 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.163 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442403+0000", 2024-09-11T07:08:25.163 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6210000000000004e-06 2024-09-11T07:08:25.163 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442416+0000", 2024-09-11T07:08:25.164 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3011e-05 2024-09-11T07:08:25.164 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.164 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.164 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.164 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442422+0000", 2024-09-11T07:08:25.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2620000000000004e-06 2024-09-11T07:08:25.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.165 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.165 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442495+0000", 2024-09-11T07:08:25.165 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2977000000000003e-05 2024-09-11T07:08:25.165 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.165 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.442647+0000", 2024-09-11T07:08:25.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015205199999999999 2024-09-11T07:08:25.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.166 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.166 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:08:25.166 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.450708+0000", 2024-09-11T07:08:25.166 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0080612589999999994 2024-09-11T07:08:25.166 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:25.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482090+0000", 2024-09-11T07:08:25.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.031381543999999997 2024-09-11T07:08:25.167 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.167 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.167 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:25.167 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482176+0000", 2024-09-11T07:08:25.167 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6302000000000001e-05 2024-09-11T07:08:25.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:25.168 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482279+0000", 2024-09-11T07:08:25.168 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010242399999999999 2024-09-11T07:08:25.168 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.168 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.168 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.169 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:19.482357+0000", 2024-09-11T07:08:25.169 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8565000000000004e-05 2024-09-11T07:08:25.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.169 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.169 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.169 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.169 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.169 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73806 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14024704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.524827901000002, 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038245594000000001, 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73806 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.170 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582801+0000", 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3e-07 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.171 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582804+0000", 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.836e-06 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582813+0000", 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8030000000000003e-06 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582820+0000", 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9e-06 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.172 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620766+0000", 2024-09-11T07:08:25.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037946800000000003 2024-09-11T07:08:25.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.173 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.620895+0000", 2024-09-11T07:08:25.173 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012861799999999999 2024-09-11T07:08:25.173 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.173 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.173 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621046+0000", 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015100700000000001 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73807 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14417920~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.524800198999998, 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038841537000000002, 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:25.174 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73807 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582828+0000", 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.175 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582829+0000", 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3399999999999999e-07 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582857+0000", 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.779e-05 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582874+0000", 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7584999999999999e-05 2024-09-11T07:08:25.176 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582882+0000", 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7999999999999999e-06 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621135+0000", 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038253044 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.177 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621390+0000", 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000254689 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621670+0000", 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027999500000000001 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73808 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 14811136~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.524735139999997, 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039162267000000001, 2024-09-11T07:08:25.178 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73808 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.179 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582893+0000", 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582894+0000", 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8999999999999996e-07 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582897+0000", 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4240000000000002e-06 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.180 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582907+0000", 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.4299999999999995e-06 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582919+0000", 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1826e-05 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621769+0000", 2024-09-11T07:08:25.181 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.038850735999999997 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.621898+0000", 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012898099999999999 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622056+0000", 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015718000000000001 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.182 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73809 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15204352~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.524701024000002, 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039738290000000002, 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73809 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.183 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582927+0000", 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582928+0000", 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9999999999999997e-07 2024-09-11T07:08:25.184 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582932+0000", 2024-09-11T07:08:25.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.8029999999999998e-06 2024-09-11T07:08:25.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.185 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.185 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.185 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582947+0000", 2024-09-11T07:08:25.185 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5099999999999999e-05 2024-09-11T07:08:25.185 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582959+0000", 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.206e-05 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622144+0000", 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039184999999999998 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.186 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622390+0000", 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00024606600000000003 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622666+0000", 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00027566100000000002 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73810 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15597568~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:25.187 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.524652324999998, 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040289497000000001, 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73810 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.188 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582976+0000", 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582977+0000", 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0100000000000001e-06 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.189 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.582983+0000", 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6729999999999997e-06 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583000+0000", 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7237000000000001e-05 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583014+0000", 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4076999999999999e-05 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.190 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622759+0000", 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.039744806000000001 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.622998+0000", 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000239385 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623266+0000", 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026730900000000003 2024-09-11T07:08:25.191 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73811 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 15990784~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.524596305999999, 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040666513000000001, 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.192 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73811 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583032+0000", 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.193 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583033+0000", 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.037e-06 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583039+0000", 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583079+0000", 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.0438999999999997e-05 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.194 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583092+0000", 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2367e-05 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623365+0000", 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040273182999999997 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623518+0000", 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00015322099999999999 2024-09-11T07:08:25.195 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623699+0000", 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00018055299999999999 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:73812 3.8 3:16512138:::rbd_data.1161521f420b.0000000000000002:28 [sparse-read 16384000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.524523926999997, 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.041168972999999998, 2024-09-11T07:08:25.196 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 73812 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.197 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583105+0000", 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1699999999999997e-07 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583109+0000", 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1799999999999998e-06 2024-09-11T07:08:25.198 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583120+0000", 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0380000000000001e-05 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.583127+0000", 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.029e-06 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.623766+0000", 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.040639210000000002 2024-09-11T07:08:25.199 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624006+0000", 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000240466 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.624273+0000", 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00026699100000000001 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.200 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:74137 3.1 3:833ccc20:::rbd_data.1161634664ee.0000000000000009:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 59.315276259999997, 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.045679127999999999, 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 74137 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.201 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792352+0000", 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792355+0000", 2024-09-11T07:08:25.202 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.23e-06 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792368+0000", 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2449000000000001e-05 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792398+0000", 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0519999999999999e-05 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792413+0000", 2024-09-11T07:08:25.203 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4216000000000001e-05 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792538+0000", 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00012526099999999999 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.792679+0000", 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014143099999999999 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.800911+0000", 2024-09-11T07:08:25.204 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0082317989999999997 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837839+0000", 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.036927588999999997 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837869+0000", 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.0355999999999999e-05 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:25.205 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.837956+0000", 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6967999999999998e-05 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:25.838031+0000", 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5308999999999993e-05 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:114986 3.8 3:16fde53f:::rbd_data.1161a6ce22ad.0000000000000001:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 4194304 write_size 4194304,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.693737431000002, 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047341314000000002, 2024-09-11T07:08:25.206 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 114986 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.207 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413891+0000", 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413894+0000", 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2660000000000002e-06 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413906+0000", 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2157000000000001e-05 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.208 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413935+0000", 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8585000000000002e-05 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.413949+0000", 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4365999999999999e-05 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.414062+0000", 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000112342 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.209 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.414287+0000", 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00022574300000000001 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 1", 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.423201+0000", 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0089138370000000008 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.460776+0000", 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.037574278000000003 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.210 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.460916+0000", 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014091 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.461094+0000", 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000177176 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:07:52.461232+0000", 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013865399999999999 2024-09-11T07:08:25.211 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.212 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.212 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:25.212 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:25.212 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:25.214 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:25.214 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:25.210+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:25.315 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:25.310+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:25.345 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:25.345 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:25.345 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:25.345 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:25.359 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:25.415 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:25.410+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:25.481 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:25.482 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:25.482 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:25.482 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:25.482 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:25.495 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:25.541 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:25.538+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:25.616 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:25.616 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:25.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:25.616 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:25.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.616 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.617 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:25.617 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.324955655, 2024-09-11T07:08:25.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:08:25.617 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.617 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.617 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.618 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.618 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.618 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:08:25.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.618 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:25.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:25.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.621 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.324883572, 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.624 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:08:25.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.324828079, 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:08:25.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:08:25.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:08:25.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:08:25.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:08:25.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:08:25.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:08:25.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:08:25.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:08:25.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:08:25.633 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.634 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.634 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.634 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.634 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:25.635 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12295611099999, 2024-09-11T07:08:25.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:08:25.635 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.635 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.635 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.635 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.636 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.636 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:08:25.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.636 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:25.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.637 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.637 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.637 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:25.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.637 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:08:25.638 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:08:25.638 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.638 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.638 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.638 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:08:25.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:08:25.639 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.639 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.639 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.639 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:08:25.639 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:08:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:08:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:08:25.640 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.641 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.641 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:08:25.641 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:08:25.641 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.641 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.642 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12289352099999, 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.643 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.644 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.645 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.646 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.647 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12283646500001, 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.648 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:08:25.649 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.650 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.651 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.652 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:08:25.652 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:08:25.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.652 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.652 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.652 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.652 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.652 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.652 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:25.652 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12278034800001, 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.653 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.654 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:08:25.655 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:08:25.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:08:25.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.656 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.656 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.656 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:08:25.656 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:08:25.656 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.122659086, 2024-09-11T07:08:25.657 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:25.658 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:08:25.659 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.660 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.661 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12255481699999, 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.662 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.663 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.664 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.665 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.666 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.122449278, 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.667 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:08:25.668 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:08:25.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:08:25.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:08:25.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:08:25.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:08:25.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:08:25.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:08:25.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:08:25.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:08:25.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:08:25.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:08:25.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:08:25.672 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.672 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.672 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.673 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.673 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:25.673 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12238211499999, 2024-09-11T07:08:25.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:08:25.673 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.673 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.673 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.673 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.673 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.674 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.674 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:08:25.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.674 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:25.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:25.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:08:25.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:08:25.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:08:25.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:08:25.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:08:25.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:08:25.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:08:25.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:08:25.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:08:25.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:08:25.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:08:25.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:08:25.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:08:25.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:08:25.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.679 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12228290900001, 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.680 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:08:25.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12219595000001, 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.684 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:08:25.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.122135673, 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.689 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:08:25.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.121981968, 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.693 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.697 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12189479200001, 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:08:25.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:08:25.701 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12183088899999, 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.702 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:08:25.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:25.706 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12177104600001, 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:25.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:08:25.710 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.121692964, 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.711 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:08:25.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:25.715 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12163519400001, 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.716 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:25.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:08:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:08:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:25.720 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:25.720 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:25.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:25.722 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:25.718+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:25.823 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:25.818+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:25.890 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:08:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:25.896 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:25.896 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:25.913 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:25.958 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:25.954+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:26.025 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:26.022+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:26.035 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:26.035 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:26.035 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:26.050 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:26.137 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:26.134+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:26.218 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:26.218 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.905059055, 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:08:26.219 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.220 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.221 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:08:26.222 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.904978218, 2024-09-11T07:08:26.223 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:26.224 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.225 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.226 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:08:26.227 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.904934872, 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.228 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.229 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.230 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:08:26.231 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.232 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.904864747, 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:08:26.233 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.234 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:08:26.235 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.236 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.904796623, 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.237 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.238 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.239 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.240 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.241 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.90475615699999, 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.242 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.243 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.244 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.245 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.904718116, 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.246 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.247 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.248 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:08:26.249 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:26.250 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.90467914600001, 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.251 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.252 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.253 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:08:26.254 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.904638272, 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.255 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.256 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.256 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:08:26.256 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.256 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.256 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.256 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.256 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.257 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:08:26.258 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.259 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.904310499, 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.260 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.261 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.262 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:08:26.263 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.264 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.90424398899999, 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.265 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.266 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.267 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.268 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.90417626999999, 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.269 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.270 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:08:26.271 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.272 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.273 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.90413133200001, 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.274 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.275 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.276 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:08:26.277 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.90333170700001, 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.278 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.279 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.280 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:08:26.281 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.903297365, 2024-09-11T07:08:26.282 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:26.283 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:08:26.284 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:08:26.285 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.286 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.90293469, 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:26.287 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:08:26.288 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.289 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.290 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 117.96503373900001, 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.291 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.292 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.293 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109724 3.1d 3:bd9f0dd6:::rbd_data.1161dd0f3253.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:26.296 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.695158501000002, 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.063964249000000001, 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109724 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:26.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519447+0000", 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1799999999999999e-06 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523605+0000", 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041584270000000001 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523644+0000", 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8908000000000001e-05 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523661+0000", 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7198999999999999e-05 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523781+0000", 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011950799999999999 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.524055+0000", 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027451199999999998 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.548286+0000", 2024-09-11T07:08:26.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.024231249 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583267+0000", 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.034980245 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583326+0000", 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9815999999999998e-05 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583372+0000", 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6074e-05 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583409+0000", 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6130999999999997e-05 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109733 3.5 3:a2b45ebf:::rbd_data.1161dd0f3253.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 47.613557796000002, 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067924668999999993, 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109733 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601047+0000", 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.029e-06 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601058+0000", 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0974e-05 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601083+0000", 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4757999999999999e-05 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601099+0000", 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5733e-05 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601212+0000", 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113857 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601453+0000", 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240657 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.613355+0000", 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01190186 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668765+0000", 2024-09-11T07:08:26.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055410261000000002 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668796+0000", 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0833000000000001e-05 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668891+0000", 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4708000000000002e-05 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668970+0000", 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8998999999999994e-05 2024-09-11T07:08:26.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:111102 3.1d 3:b9ff0ad7:::rbd_object_map.1161dd0f3253:head [read 0~42] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 42.378727306000002, 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.014308821, 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.308 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 111102 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835877+0000", 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.564e-06 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835883+0000", 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0909999999999998e-06 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835900+0000", 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.668e-05 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835907+0000", 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2660000000000004e-06 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835963+0000", 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5933999999999997e-05 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835972+0000", 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1449999999999997e-06 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849359+0000", 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0133867839999999 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849663+0000", 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030396600000000002 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.850184+0000", 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052139099999999996 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.313 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.313 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:26.314 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:26.315 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:26.310+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:26.416 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:26.410+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:26.484 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:26.484 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:26.484 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:26.484 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:26.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:26.516 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:26.510+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:26.616 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:26.616 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:26.617 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:26.617 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:26.617 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:26.614+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:26.630 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:26.718 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:26.714+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:26.750 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:26.751 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:26.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:26.751 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:26.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.751 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.751 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:26.751 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.424815854, 2024-09-11T07:08:26.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:08:26.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:08:26.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:08:26.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:08:26.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:08:26.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.757 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.758 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.758 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:26.758 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.121876759, 2024-09-11T07:08:26.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:08:26.758 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.758 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.758 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:08:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:08:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:08:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:08:26.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:26.763 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.121813643, 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:08:26.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.768 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.12173865, 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:08:26.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.12167409400001, 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.773 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:08:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:08:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:08:26.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.12161886499999, 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.778 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:08:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:08:26.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:08:26.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.121564968, 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:08:26.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:08:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:26.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:08:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:08:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:08:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:08:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:08:26.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.121504469, 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.789 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:08:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:08:26.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:08:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:08:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:08:26.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:08:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:08:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:08:26.794 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:08:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:08:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.795 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.121448456, 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.796 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.797 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.798 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:08:26.799 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.800 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.12136910300001, 2024-09-11T07:08:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:08:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.801 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.802 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.803 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:08:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:08:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:08:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:08:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.804 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.805 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:08:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:08:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.806 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.1213128, 2024-09-11T07:08:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:08:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:08:26.807 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:26.808 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.809 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:08:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:08:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:08:26.810 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:08:26.811 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.812 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.12124036099999, 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:08:26.813 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:08:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.814 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:08:26.815 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.816 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:08:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:08:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:08:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:08:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.817 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.818 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.12118424100001, 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.819 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:08:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.820 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.821 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:08:26.822 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:08:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:08:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:08:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.823 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.12111077500001, 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.824 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.825 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:08:26.826 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.827 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.828 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 132.12103238200001, 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.829 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.830 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.831 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:08:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:08:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.832 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:08:26.833 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:26.834 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 108.211856368, 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:26.835 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:08:26.836 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:08:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:08:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:08:26.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:08:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:08:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:08:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:08:26.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.839 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.955270783000003, 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.840 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.841 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:08:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:08:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:26.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.846 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.185276772000002, 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:08:26.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:08:26.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:08:26.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.852 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.177286877, 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.853 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.854 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:08:26.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109791 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 5824422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 48.018256620999999, 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029141958999999999, 2024-09-11T07:08:26.857 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109791 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728800+0000", 2024-09-11T07:08:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.064e-06 2024-09-11T07:08:26.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744261+0000", 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015461523 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744287+0000", 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5086999999999999e-05 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744298+0000", 2024-09-11T07:08:26.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1899000000000001e-05 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744376+0000", 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7465000000000005e-05 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744514+0000", 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013820400000000001 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.745045+0000", 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053122399999999995 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.751499+0000", 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064538750000000004 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757772+0000", 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062726509999999997 2024-09-11T07:08:26.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757865+0000", 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2802999999999999e-05 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757933+0000", 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8164000000000007e-05 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:26.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:26.864 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:26.865 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:26.866 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:26.862+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:26.886 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:08:26.966 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:26.962+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:27.044 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:27.044 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:27.044 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:27.044 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:27.056 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:08:27.058 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:27.102 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:27.098+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:27.168 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:27.162+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:27.177 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:27.177 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:27.178 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:27.178 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:27.192 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:27.213 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:27.213 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:27.229 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:27.229 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:27.246 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:27.246 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:27.262 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:27.262 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:27.268 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:27.262+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:27.282 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:27.282 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:27.301 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:27.301 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:27.318 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:08:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 164.245870731, 2024-09-11T07:08:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:08:27.318 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:08:27.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:08:27.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:27.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.819700236, 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:08:27.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:08:27.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:08:27.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.81964401899999, 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.329 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:27.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:08:27.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.816596858, 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.334 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:08:27.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:08:27.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.81654375799999, 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.338 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:08:27.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:08:27.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.342 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.81644485299999, 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:08:27.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:08:27.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:08:27.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.81637698500001, 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.347 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:08:27.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:08:27.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.816320451, 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:08:27.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:08:27.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.816267991, 2024-09-11T07:08:27.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:08:27.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:08:27.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.360 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.816216363, 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:08:27.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:27.365 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.816164941, 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:08:27.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.816113847, 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:08:27.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:08:27.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.816061887, 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:08:27.374 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:08:27.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.81596237399999, 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:08:27.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:08:27.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.815903569, 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:08:27.383 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:08:27.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:08:27.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.81585241499999, 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:08:27.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:08:27.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.815796109, 2024-09-11T07:08:27.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:08:27.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:08:27.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.80899659400001, 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.397 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:08:27.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.401 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 67.076926568999994, 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:08:27.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:08:27.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:08:27.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 66.759517521999996, 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:27.408 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:27.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:08:27.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:27.411 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:08:27.412 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.413 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:27.414 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:27.415 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:27.416 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:27.416 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:27.417 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:27.410+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:27.417 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:27.418 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:27.517 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:27.510+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:27.588 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:27.588 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:27.602 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:27.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:27.642+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:27.719 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:27.714+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:27.766 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:27.766 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:27.781 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:27.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:27.822+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:27.906 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:27.906 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:27.920 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:27.914+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:27.923 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:28.021 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:28.014+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:28.090 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:28.090 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:28.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:28.153 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:28.150+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:28.223 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:28.223 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:28.223 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:28.218+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:28.237 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:28.309 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7, 0] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:08:28.310 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:08:28.310 INFO:tasks.thrashosds.thrasher:inject_pause on osd.3 2024-09-11T07:08:28.310 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T07:08:28.310 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T07:08:28.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok config set filestore_inject_stall 3 2024-09-11T07:08:28.324 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:28.318+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:28.399 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:28.399 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:28.414 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:28.443 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:28.443 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "" 2024-09-11T07:08:28.443 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:28.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:28.438+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:28.525 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:28.522+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:28.528 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:28.529 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:28.543 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:28.626 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:28.622+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:28.708 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:28.708 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:28.722 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:28.770 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:28.766+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:28.827 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:28.822+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:28.840 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:28.841 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:28.861 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:28.924 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:08:28.949 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:28.946+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:29.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:29.022+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:29.036 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:29.036 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:29.054 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:29.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:29.138+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:29.211 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:29.211 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:29.224 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:29.230 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:29.226+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:29.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:29.326+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:29.379 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:29.379 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:29.393 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:29.419 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:29.437 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:29.434+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:29.522 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:29.522 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:29.532 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:29.526+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:29.536 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:29.585 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:29.585 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:29.603 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:29.603 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:29.620 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:29.620 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:29.633 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:29.626+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:29.638 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:29.639 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:29.659 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:29.659 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:29.678 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:29.679 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:29.699 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:29.699 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:29.702 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:29.703 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:29.703 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:29.703 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:29.703 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:29.717 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:29.718 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:29.718 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:29.761 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:29.758+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:29.835 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:29.830+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:29.836 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25144 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1275904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.546530373, 2024-09-11T07:08:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053605450999999998, 2024-09-11T07:08:29.836 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25144 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.837 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286560+0000", 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286561+0000", 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.353e-06 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286567+0000", 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5199999999999997e-06 2024-09-11T07:08:29.838 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286584+0000", 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.766e-05 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286613+0000", 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.864e-05 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.339858+0000", 2024-09-11T07:08:29.839 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053244879000000002 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340058+0000", 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000199824 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340165+0000", 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000107575 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.840 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25145 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1288192~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.54645829, 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053798539999999999, 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.841 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25145 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286632+0000", 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.842 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286633+0000", 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.24e-06 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286639+0000", 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7370000000000003e-06 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286657+0000", 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8145999999999999e-05 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.843 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286671+0000", 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3672999999999999e-05 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340248+0000", 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053576989999999998 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340346+0000", 2024-09-11T07:08:29.844 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7932999999999999e-05 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340430+0000", 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4821000000000007e-05 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:25146 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 1300480~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.546402797, 2024-09-11T07:08:29.845 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053985410999999997, 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 25146 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.846 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286687+0000", 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286688+0000", 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286693+0000", 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.994e-06 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.847 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286712+0000", 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8640000000000001e-05 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.286726+0000", 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3963e-05 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340501+0000", 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053774948000000003 2024-09-11T07:08:29.848 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340585+0000", 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3480999999999996e-05 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.340673+0000", 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199e-05 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.849 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26007 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 55296~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34453082900001, 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054393628999999999, 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26007 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.850 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488559+0000", 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488561+0000", 2024-09-11T07:08:29.851 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.364e-06 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488567+0000", 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9000000000000003e-06 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488585+0000", 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8833000000000001e-05 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488600+0000", 2024-09-11T07:08:29.852 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.446e-05 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542595+0000", 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.053995221000000003 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542758+0000", 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016287699999999999 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.853 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.542953+0000", 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019497399999999999 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26008 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 67584~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34446823899999, 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054784497000000001, 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.854 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26008 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488622+0000", 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.855 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488623+0000", 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1629999999999999e-06 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488628+0000", 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3669999999999996e-06 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488646+0000", 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.808e-05 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.856 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488661+0000", 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4769e-05 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543023+0000", 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054362216999999997 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543165+0000", 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014145600000000001 2024-09-11T07:08:29.857 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543406+0000", 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024144499999999999 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26009 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 79872~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34441118300001, 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055022321999999999, 2024-09-11T07:08:29.858 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26009 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.859 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488679+0000", 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488680+0000", 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.127e-06 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488686+0000", 2024-09-11T07:08:29.860 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9429999999999997e-06 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488704+0000", 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.819e-05 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488719+0000", 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4447000000000001e-05 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.861 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543391+0000", 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054672529999999997 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543519+0000", 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012826999999999999 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543701+0000", 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018181499999999999 2024-09-11T07:08:29.862 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26010 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 92160~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34435506600001, 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055217970999999998, 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.863 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26010 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488735+0000", 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.864 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488736+0000", 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1400000000000001e-06 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488741+0000", 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.13e-06 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488760+0000", 2024-09-11T07:08:29.865 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9199e-05 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488782+0000", 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1573000000000002e-05 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543742+0000", 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.054959791000000001 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.866 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543804+0000", 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2383000000000002e-05 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014875500000000001 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26011 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 104448~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:29.867 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.344233804, 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055418588999999997, 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26011 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:29.868 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488856+0000", 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488858+0000", 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1969999999999999e-06 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.869 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488870+0000", 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.117e-05 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488902+0000", 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2768999999999997e-05 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488924+0000", 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1699999999999999e-05 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.870 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.543953+0000", 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055029221000000003 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544104+0000", 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015024799999999999 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544275+0000", 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017128400000000001 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.871 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26012 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 116736~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34412953499999, 2024-09-11T07:08:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055674412999999999, 2024-09-11T07:08:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.872 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26012 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488961+0000", 2024-09-11T07:08:29.873 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488962+0000", 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.39e-06 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.488969+0000", 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.5729999999999996e-06 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489012+0000", 2024-09-11T07:08:29.874 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3152999999999998e-05 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489043+0000", 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1189999999999998e-05 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544328+0000", 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055284946000000001 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544464+0000", 2024-09-11T07:08:29.875 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013581800000000001 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544635+0000", 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017134299999999999 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26013 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 129024~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.344023996, 2024-09-11T07:08:29.876 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055796866000000001, 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26013 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.877 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489066+0000", 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489068+0000", 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.733e-06 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489076+0000", 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6899999999999992e-06 2024-09-11T07:08:29.878 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489098+0000", 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2654e-05 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489112+0000", 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3943e-05 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544698+0000", 2024-09-11T07:08:29.879 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055585453999999999 2024-09-11T07:08:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544776+0000", 2024-09-11T07:08:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8634999999999995e-05 2024-09-11T07:08:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.880 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544863+0000", 2024-09-11T07:08:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.6756999999999996e-05 2024-09-11T07:08:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26014 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 141312~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34395683299999, 2024-09-11T07:08:29.881 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055963745000000002, 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26014 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.882 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489133+0000", 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489134+0000", 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0869999999999999e-06 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489140+0000", 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7130000000000002e-06 2024-09-11T07:08:29.883 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489191+0000", 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1168999999999997e-05 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489208+0000", 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6727000000000001e-05 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544902+0000", 2024-09-11T07:08:29.884 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055694500000000001 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.544991+0000", 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8566999999999994e-05 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545097+0000", 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000105982 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.885 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26015 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 153600~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34385762700001, 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056855242, 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26015 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.886 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489232+0000", 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489234+0000", 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.42e-06 2024-09-11T07:08:29.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489258+0000", 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4499999999999999e-05 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489283+0000", 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4182999999999999e-05 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489299+0000", 2024-09-11T07:08:29.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6093e-05 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545129+0000", 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055830435999999997 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.545911+0000", 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00078204299999999995 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546088+0000", 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00017656700000000001 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26016 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 165888~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.343770668, 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056987489000000002, 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.890 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26016 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489319+0000", 2024-09-11T07:08:29.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489321+0000", 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.13e-06 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489327+0000", 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0900000000000001e-06 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489348+0000", 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1492999999999999e-05 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489362+0000", 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546124+0000", 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056762227999999998 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546206+0000", 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1693999999999994e-05 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546307+0000", 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010107000000000001 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.894 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26017 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 178176~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.343710391, 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057130339000000002, 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26017 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489380+0000", 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489381+0000", 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6700000000000001e-06 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489387+0000", 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7230000000000001e-06 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489409+0000", 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1526e-05 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489423+0000", 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.464e-05 2024-09-11T07:08:29.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546342+0000", 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056918989000000003 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546417+0000", 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.4887000000000003e-05 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.898 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546510+0000", 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2904000000000004e-05 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26018 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 190464~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.343556686, 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057396041000000002, 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.899 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26018 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489533+0000", 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489535+0000", 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0370000000000001e-06 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489546+0000", 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0373e-05 2024-09-11T07:08:29.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489572+0000", 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.6356e-05 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489591+0000", 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8960000000000001e-05 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546546+0000", 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.056955314999999999 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546748+0000", 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000201468 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546929+0000", 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018153200000000001 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.903 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26019 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 202752~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34346951000001, 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057604130000000003, 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26019 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.904 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489621+0000", 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489622+0000", 2024-09-11T07:08:29.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.553e-06 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489629+0000", 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8499999999999996e-06 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489648+0000", 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9437e-05 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489665+0000", 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6273000000000002e-05 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.546975+0000", 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057310683000000001 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547100+0000", 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012444600000000001 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.907 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547225+0000", 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000124888 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26020 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 215040~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34340560699999, 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057812676, 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26020 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489684+0000", 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489686+0000", 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3829999999999999e-06 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489692+0000", 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7660000000000004e-06 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489711+0000", 2024-09-11T07:08:29.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9344e-05 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489726+0000", 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.509e-05 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547267+0000", 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057541348999999999 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547366+0000", 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8747999999999997e-05 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547497+0000", 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130996 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26021 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 227328~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:29.912 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34334576400001, 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059176906000000001, 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26021 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:29.913 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489744+0000", 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489746+0000", 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.376e-06 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489751+0000", 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.147e-06 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489788+0000", 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6662999999999998e-05 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489803+0000", 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5373e-05 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547546+0000", 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057742783999999998 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.547653+0000", 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010739900000000001 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.548921+0000", 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001268164 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26022 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 239616~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.343267682, 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059583794000000002, 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26022 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489822+0000", 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489824+0000", 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3599999999999999e-06 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489830+0000", 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1630000000000001e-06 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489849+0000", 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8794e-05 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489863+0000", 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4286e-05 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549204+0000", 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059341191000000001 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549314+0000", 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000110228 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549406+0000", 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1772000000000002e-05 2024-09-11T07:08:29.920 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26023 3.3 3:c4af15c7:::rbd_data.1161cd812748.0000000000000001:d [read 251904~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.34320991200001, 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059783097, 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:29.921 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26023 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.922 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489880+0000", 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489882+0000", 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.347e-06 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489887+0000", 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0900000000000004e-06 2024-09-11T07:08:29.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489905+0000", 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8465999999999999e-05 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.489928+0000", 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2983e-05 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549431+0000", 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059503294999999998 2024-09-11T07:08:29.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549507+0000", 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5354999999999999e-05 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.549663+0000", 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00015656099999999999 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.925 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:29.926 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:29.926 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:29.926 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:08:29.927 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:29.935 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:29.930+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:30.036 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:30.030+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:30.106 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:30.106 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:30.106 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:30.122 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:30.137 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:30.134+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:30.238 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:30.234+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:30.292 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:30.292 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:30.292 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:30.292 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:30.292 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:30.306 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:30.349 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:30.346+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:30.440 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:30.434+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:30.469 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:30.469 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:30.469 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:30.469 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:30.469 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.469 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.469 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15584335899999, 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.470 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.471 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:08:30.472 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:08:30.473 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.155762522, 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.474 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.475 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.476 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.477 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.478 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15571917599999, 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.479 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:08:30.480 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.481 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:08:30.482 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15564905100001, 2024-09-11T07:08:30.483 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.484 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:08:30.485 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:08:30.486 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.487 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15558092699999, 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.488 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.489 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:08:30.490 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.491 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15554046099999, 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.492 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.493 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.494 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:08:30.495 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15550242, 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:08:30.496 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.497 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.498 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.499 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:30.500 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15546345000001, 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:30.501 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.502 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.503 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:08:30.504 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15542257600001, 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.505 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.506 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:08:30.507 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.508 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.509 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.155094803, 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:08:30.510 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.511 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:08:30.512 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.513 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:30.514 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15502829299999, 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.515 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:08:30.516 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:08:30.517 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.518 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.154960574, 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:30.519 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:08:30.520 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.521 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.522 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.154915636, 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.523 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.524 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:08:30.525 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:08:30.526 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15411601100001, 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:08:30.527 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:08:30.528 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.529 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:08:30.530 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.15408166899999, 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:08:30.531 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.532 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.533 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:08:30.534 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.535 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 130.153718994, 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.536 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.537 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.538 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:08:30.539 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 122.215818043, 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.540 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.541 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:08:30.542 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.543 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:08:30.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109724 3.1d 3:bd9f0dd6:::rbd_data.1161dd0f3253.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.945942805000001, 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.063964249000000001, 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.546 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109724 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519447+0000", 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1799999999999999e-06 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523605+0000", 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041584270000000001 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523644+0000", 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8908000000000001e-05 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523661+0000", 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7198999999999999e-05 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523781+0000", 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011950799999999999 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.524055+0000", 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027451199999999998 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:30.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.548286+0000", 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.024231249 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583267+0000", 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.034980245 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583326+0000", 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9815999999999998e-05 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583372+0000", 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6074e-05 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583409+0000", 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6130999999999997e-05 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109733 3.5 3:a2b45ebf:::rbd_data.1161dd0f3253.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:30.551 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 51.864342100000002, 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067924668999999993, 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109733 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601047+0000", 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.029e-06 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601058+0000", 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0974e-05 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601083+0000", 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4757999999999999e-05 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601099+0000", 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5733e-05 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.554 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601212+0000", 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113857 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601453+0000", 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240657 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.613355+0000", 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01190186 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:30.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668765+0000", 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055410261000000002 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668796+0000", 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0833000000000001e-05 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668891+0000", 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4708000000000002e-05 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668970+0000", 2024-09-11T07:08:30.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8998999999999994e-05 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:111102 3.1d 3:b9ff0ad7:::rbd_object_map.1161dd0f3253:head [read 0~42] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 46.629511610000002, 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.014308821, 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:30.557 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 111102 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835877+0000", 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.564e-06 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835883+0000", 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0909999999999998e-06 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835900+0000", 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.668e-05 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:30.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835907+0000", 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2660000000000004e-06 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835963+0000", 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5933999999999997e-05 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835972+0000", 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1449999999999997e-06 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849359+0000", 2024-09-11T07:08:30.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0133867839999999 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849663+0000", 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030396600000000002 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.850184+0000", 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052139099999999996 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.561 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:30.562 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:30.562 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:30.563 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:30.563 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:30.562+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:30.664 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:30.658+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:30.730 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:30.731 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:30.731 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:30.731 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:30.744 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:30.785 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:30.782+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:30.866 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:30.862+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:30.901 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:30.901 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:30.902 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:30.902 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:30.917 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:30.967 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:30.962+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:31.068 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:31.062+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:31.099 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:31.099 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:31.099 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:31.099 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:31.099 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.099 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.77267615599999, 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.100 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:08:31.101 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.102 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.103 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.104 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.105 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.46973706099999, 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.106 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:08:31.107 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.108 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:08:31.109 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.46967394500001, 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:08:31.110 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.111 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:08:31.112 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.113 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.114 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.46959895200001, 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.115 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:08:31.116 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.117 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.118 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.469534396, 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.119 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.120 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:08:31.121 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:08:31.122 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.123 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.469479167, 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:08:31.124 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.125 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.126 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.127 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.46942526999999, 2024-09-11T07:08:31.128 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:31.129 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.130 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:08:31.131 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.132 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.46936477099999, 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.133 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:31.134 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.135 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.136 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.137 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.46930875800001, 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.138 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.139 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:08:31.140 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.141 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.46922940499999, 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.142 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.143 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.144 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:08:31.145 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.146 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.46917310200001, 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:08:31.147 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.148 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.149 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:08:31.150 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.46910066300001, 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.151 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.152 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.153 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.154 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:08:31.155 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.469044543, 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.156 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:31.157 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.158 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:08:31.159 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.160 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.46897107699999, 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:08:31.161 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.162 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.163 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:08:31.164 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:31.165 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 136.468892684, 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.166 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.167 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.168 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.169 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 112.55971667, 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.170 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.171 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.172 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:08:31.173 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.174 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.303131085000004, 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:08:31.175 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.176 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.177 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:08:31.178 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.179 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.180 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.533137074000003, 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.181 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.182 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:08:31.183 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:08:31.184 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:31.185 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.186 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.525147179000001, 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.187 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.188 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.189 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.190 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109791 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 5824422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 52.366116923, 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029141958999999999, 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:31.191 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109791 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:31.192 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728800+0000", 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.064e-06 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744261+0000", 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015461523 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.193 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744287+0000", 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5086999999999999e-05 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744298+0000", 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1899000000000001e-05 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744376+0000", 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7465000000000005e-05 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.194 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744514+0000", 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013820400000000001 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.745045+0000", 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053122399999999995 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.751499+0000", 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064538750000000004 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.195 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757772+0000", 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062726509999999997 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757865+0000", 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2802999999999999e-05 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757933+0000", 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8164000000000007e-05 2024-09-11T07:08:31.196 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.197 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.197 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:31.198 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:31.199 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:31.194+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:31.299 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:31.298+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:31.369 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:31.370 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:31.370 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:31.383 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:31.429 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:31.426+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:31.499 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:31.499 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:31.499 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:31.499 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:31.499 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:31.501 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:31.494+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:31.513 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:31.602 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:31.598+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:31.686 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:31.686 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:31.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:31.686 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:31.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.686 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:08:31.686 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:31.686 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 168.61349608200001, 2024-09-11T07:08:31.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:08:31.686 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:08:31.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.692 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.187325587, 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.693 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:08:31.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:31.697 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.18726937, 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:31.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:08:31.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.184222209, 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.702 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:08:31.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:08:31.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:08:31.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:08:31.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:08:31.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.184169109, 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.707 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:08:31.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.18407020399999, 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:08:31.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:08:31.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.18400233600001, 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:08:31.716 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:08:31.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:08:31.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.183945802, 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:08:31.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.183893342, 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:08:31.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:08:31.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:08:31.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.183841714, 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.730 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:31.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:08:31.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:08:31.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:08:31.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:08:31.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:08:31.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.183790292, 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:31.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.183739198, 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:31.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:08:31.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:08:31.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:08:31.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:08:31.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:08:31.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:31.744 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.183687238, 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:08:31.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:08:31.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:08:31.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.748 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.748 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:08:31.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:08:31.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:08:31.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:08:31.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:08:31.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:08:31.749 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.749 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.183587725, 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.750 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:08:31.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.754 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.18352892, 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.755 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:08:31.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.756 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:31.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:08:31.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:08:31.759 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.183477766, 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.760 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:08:31.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.18342146000001, 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:08:31.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 127.17662194499999, 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.769 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:08:31.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.773 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.444551919999995, 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.774 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:08:31.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:08:31.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.777 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:08:31.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:08:31.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:31.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.780 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 71.127142872999997, 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.781 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:08:31.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.783 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:08:31.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.786 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.787 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:31.787 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:31.787 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:31.787 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:08:31.789 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:31.782+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:31.789 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:31.889 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:31.882+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:31.917 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:31.917 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:31.917 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:31.935 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:31.954 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:08:31.955 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:31.956 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:31.973 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:31.973 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:31.990 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:31.986+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:31.991 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:31.991 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:32.026 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:32.027 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:32.063 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:32.063 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:32.091 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:32.086+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:32.099 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:32.099 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:32.104 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:32.104 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:32.120 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:32.126 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:32.127 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:32.148 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:32.149 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:32.213 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:32.210+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:32.242 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:32.243 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:32.257 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:32.302 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:32.298+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:32.393 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:32.390+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:32.430 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:32.430 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:32.444 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:32.494 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:32.490+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:32.565 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:32.565 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:32.579 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:32.629 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:32.626+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:32.687 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:32.687 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:32.696 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:32.690+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:32.700 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:32.797 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:32.790+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:32.848 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:32.848 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:32.861 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:32.898 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:32.894+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:32.938 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:08:32.999 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:32.994+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:33.038 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:33.038 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:33.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:33.100 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:33.094+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:33.178 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:33.178 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:33.191 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:33.234 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:33.230+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:33.302 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:33.298+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:33.352 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:33.353 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:33.367 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:33.403 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:33.398+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:33.458 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7, 0] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:08:33.458 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:08:33.458 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-09-11T07:08:33.459 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-09-11T07:08:33.504 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:33.502+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:33.532 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:33.532 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:33.546 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:33.605 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:33.598+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:33.661 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:33.662 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:33.675 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:33.718 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:33.714+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:33.752 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "epoch": 153, 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "fsid": "e1313abd-54a9-4e53-ab67-469f744048b1", 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "created": "2024-09-11T07:05:29.098467+0000", 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "modified": "2024-09-11T07:08:32.930559+0000", 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "last_up_change": "2024-09-11T07:05:41.051856+0000", 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "last_in_change": "2024-09-11T07:08:07.002217+0000", 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_num": 5801984, 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_set": [ 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "noscrub", 2024-09-11T07:08:33.753 INFO:teuthology.orchestra.run.smithi079.stdout: "pglog_hardlimit", 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "purged_snapdirs", 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "recovery_deletes", 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "sortbitwise" 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_version": 4, 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "full_ratio": 0.94999998807907104, 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "nearfull_ratio": 0.85000002384185791, 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_snapshot": "", 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_max": 3, 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "max_osd": 8, 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "require_min_compat_client": "luminous", 2024-09-11T07:08:33.754 INFO:teuthology.orchestra.run.smithi079.stdout: "min_compat_client": "luminous", 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "require_osd_release": "squid", 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "allow_crimson": false, 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "pools": [ 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 1, 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": ".mgr", 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:41.897005+0000", 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 1, 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool", 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:08:33.755 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:08:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:08:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:08:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:08:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:08:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:08:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:08:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:08:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 1, 2024-09-11T07:08:33.756 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 1, 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 1, 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 1, 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 1, 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "16", 2024-09-11T07:08:33.757 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:08:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:08:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:08:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:08:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:08:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 0, 2024-09-11T07:08:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 0, 2024-09-11T07:08:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:08:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:08:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:08:33.758 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:08:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:08:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:08:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:08:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:08:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:08:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:08:33.759 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:08:33.760 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "options": { 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_max": 32, 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_min": 1 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:08:33.761 INFO:teuthology.orchestra.run.smithi079.stdout: "mgr": {} 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 6.9000000953674316, 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 6.9000000953674316, 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 0.28999999165534973, 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 2, 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 2, 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 2, 2024-09-11T07:08:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "rbd", 2024-09-11T07:08:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:47.687214+0000", 2024-09-11T07:08:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:08:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:08:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:08:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:08:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:08:33.763 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 8, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 8, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 8, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 8, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 8, 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:08:33.764 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "20", 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:08:33.765 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 2, 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 20, 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:08:33.766 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:08:33.767 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:08:33.768 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.75, 2024-09-11T07:08:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.75, 2024-09-11T07:08:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 1, 2024-09-11T07:08:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.75, 2024-09-11T07:08:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.75, 2024-09-11T07:08:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:08:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:08:33.769 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_name": "pool_client.0", 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "create_time": "2024-09-11T07:05:57.298060+0000", 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "flags": 8193, 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "flags_names": "hashpspool,selfmanaged_snaps", 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "type": 1, 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 2, 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "min_size": 1, 2024-09-11T07:08:33.770 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_rule": 0, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_count": 0, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_target": 0, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_barrier": 0, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "is_stretch_pool": false, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "object_hash": 2, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_autoscale_mode": "off", 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num": 32, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num": 32, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_placement_num_target": 32, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_target": 32, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_num_pending": 32, 2024-09-11T07:08:33.771 INFO:teuthology.orchestra.run.smithi079.stdout: "last_pg_merge_meta": { 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "source_pgid": "0.0", 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "ready_epoch": 0, 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_started": 0, 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "last_epoch_clean": 0, 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "source_version": "0'0", 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "target_version": "0'0" 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "last_change": "153", 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend": "0", 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_prenautilus": "0", 2024-09-11T07:08:33.772 INFO:teuthology.orchestra.run.smithi079.stdout: "last_force_op_resend_preluminous": "0", 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "auid": 0, 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_mode": "selfmanaged", 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_seq": 49, 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "snap_epoch": 153, 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "pool_snaps": [], 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps": "[]", 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_bytes": 0, 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "quota_max_objects": 0, 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "tiers": [], 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "tier_of": -1, 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "read_tier": -1, 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "write_tier": -1, 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_mode": "none", 2024-09-11T07:08:33.773 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_bytes": 0, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "target_max_objects": 0, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_target_full_ratio_micro": 800000, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_flush_age": 0, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "cache_min_evict_age": 0, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profile": "", 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_params": { 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "none" 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_period": 0, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_count": 0, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "use_gmt_hitset": true, 2024-09-11T07:08:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: "min_read_recency_for_promote": 0, 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "min_write_recency_for_promote": 0, 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_grade_decay_rate": 0, 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "hit_set_search_last_n": 0, 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "grade_table": [], 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "stripe_width": 0, 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "expected_num_objects": 0, 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "fast_read": false, 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "options": {}, 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "application_metadata": { 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "rbd": {} 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "read_balance": { 2024-09-11T07:08:33.775 INFO:teuthology.orchestra.run.smithi079.stdout: "score_type": "Fair distribution", 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: "score_acting": 1.5299999713897705, 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: "score_stable": 1.5299999713897705, 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: "optimal_score": 1, 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_acting": 1.5299999713897705, 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: "raw_score_stable": 1.5299999713897705, 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity_weighted": 0.79660224914550781, 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity": 0.9100000262260437, 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: "average_primary_affinity_weighted": 0.80000001192092896 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:33.776 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "24d57cdb-2f3a-4a96-903d-11be7dc26a20", 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 141, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:33.777 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6824", 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6825", 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.778 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:33.779 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.779 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.779 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6826", 2024-09-11T07:08:33.779 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:33.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.779 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.779 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6827", 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6830", 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.781 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6831", 2024-09-11T07:08:33.781 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:33.781 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.781 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.781 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:33.781 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6828", 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6829", 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1708235775 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6825/1708235775", 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6827/1708235775", 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6831/1708235775", 2024-09-11T07:08:33.782 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6829/1708235775", 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "aa51dc1b-b783-4212-8736-1f666239613b", 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:33.783 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 131, 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6800", 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.784 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6801", 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6802", 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.785 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6803", 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6806", 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.786 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6807", 2024-09-11T07:08:33.787 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:33.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.787 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.787 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:33.787 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.787 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6804", 2024-09-11T07:08:33.787 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6805", 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2076268206 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6801/2076268206", 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6803/2076268206", 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6807/2076268206", 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6805/2076268206", 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:33.788 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "141a913f-7353-44a9-9dbd-70219bcee638", 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:33.789 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 131, 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6816", 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.790 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6817", 2024-09-11T07:08:33.791 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:33.791 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.791 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.791 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:33.791 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.791 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.791 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6818", 2024-09-11T07:08:33.791 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:33.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.792 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.792 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.792 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6819", 2024-09-11T07:08:33.792 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:33.792 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.792 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.792 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.792 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:33.792 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6822", 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6823", 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.793 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6820", 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6821", 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1904492349 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.794 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6817/1904492349", 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6819/1904492349", 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6823/1904492349", 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6821/1904492349", 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "32550aeb-0c8d-4ca9-afd5-3e5258e7255b", 2024-09-11T07:08:33.795 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 133, 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.796 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6808", 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6809", 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.797 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6810", 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6811", 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.798 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6814", 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6815", 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.799 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6812", 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.79:6813", 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 1327328912 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.79:6809/1327328912", 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.79:6811/1327328912", 2024-09-11T07:08:33.800 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.79:6815/1327328912", 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.79:6813/1327328912", 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc", 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 0, 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0, 2024-09-11T07:08:33.801 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 0, 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 100, 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6808", 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.802 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6809", 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6810", 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.803 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6811", 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6814", 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:33.804 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6815", 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.805 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6812", 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6813", 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 4087452871 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6809/4087452871", 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6811/4087452871", 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6815/4087452871", 2024-09-11T07:08:33.806 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6813/4087452871", 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "42c83053-328e-4c9b-bdaf-09e1a4cc8b7d", 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:33.807 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 108, 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6824", 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.808 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6825", 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6826", 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:33.809 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6827", 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.810 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6830", 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6831", 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.811 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6828", 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6829", 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2133006853 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6825/2133006853", 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6827/2133006853", 2024-09-11T07:08:33.812 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6831/2133006853", 2024-09-11T07:08:33.813 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6829/2133006853", 2024-09-11T07:08:33.813 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:33.813 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:33.813 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:33.813 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.813 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.813 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.813 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:08:33.813 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "0ab29b1f-3012-4528-8f47-2cac908122c9", 2024-09-11T07:08:33.813 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 0.9810333251953125, 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 0.3728179931640625, 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 131, 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.814 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6816", 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6817", 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.815 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6818", 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6819", 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.816 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6822", 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6823", 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6820", 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6821", 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2083734892 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6817/2083734892", 2024-09-11T07:08:33.818 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6819/2083734892", 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6823/2083734892", 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6821/2083734892", 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "uuid": "d9c7d12b-be93-41c9-a246-773faa65ecaf", 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "up": 1, 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "in": 1, 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "weight": 1, 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_affinity": 1, 2024-09-11T07:08:33.819 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_begin": 0, 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: "last_clean_end": 0, 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: "up_from": 13, 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: "up_thru": 132, 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: "down_at": 0, 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: "lost_at": 0, 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addrs": { 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6800", 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:33.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6801", 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addrs": { 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6802", 2024-09-11T07:08:33.821 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6803", 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addrs": { 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6806", 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:33.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6807", 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addrs": { 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: "addrvec": [ 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v2", 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6804", 2024-09-11T07:08:33.823 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "v1", 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: "addr": "172.21.15.110:6805", 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: "nonce": 2322042784 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: "public_addr": "172.21.15.110:6801/2322042784", 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: "cluster_addr": "172.21.15.110:6803/2322042784", 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_back_addr": "172.21.15.110:6807/2322042784", 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: "heartbeat_front_addr": "172.21.15.110:6805/2322042784", 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: "state": [ 2024-09-11T07:08:33.824 INFO:teuthology.orchestra.run.smithi079.stdout: "exists", 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: "up" 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: "osd_xinfo": [ 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 0, 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:33.825 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.653648+0000", 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 1, 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.846269+0000", 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 2, 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.970884+0000", 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 3, 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:33.827 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:37.985630+0000", 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 4, 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 65536, 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.236412+0000", 2024-09-11T07:08:33.828 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 5, 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.336953+0000", 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 6, 2024-09-11T07:08:33.829 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.306806+0000", 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "osd": 7, 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "down_stamp": "0.000000", 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_probability": 0, 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "laggy_interval": 0, 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "features": 4540701547738038271, 2024-09-11T07:08:33.830 INFO:teuthology.orchestra.run.smithi079.stdout: "old_weight": 0, 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: "last_purged_snaps_scrub": "2024-09-11T07:05:38.104744+0000", 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: "dead_epoch": 0 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap": [ 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: "pgid": "2.0", 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: "osds": [ 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: 0, 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: 6 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:33.831 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_items": [], 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_upmap_primaries": [], 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "pg_temp": [], 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "primary_temp": [], 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "blocklist": {}, 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "range_blocklist": {}, 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "erasure_code_profiles": { 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "default": { 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "crush-failure-domain": "osd", 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "k": "2", 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "m": "1", 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "plugin": "jerasure", 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: "technique": "reed_sol_van" 2024-09-11T07:08:33.832 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: "removed_snaps_queue": [ 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 18, 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 7 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: "new_removed_snaps": [ 2024-09-11T07:08:33.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "pool": 3, 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "snaps": [ 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "begin": 18, 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "length": 1 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "new_purged_snaps": [], 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "crush_node_flags": {}, 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "device_class_flags": {}, 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode": { 2024-09-11T07:08:33.834 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_enabled": false, 2024-09-11T07:08:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_bucket_count": 0, 2024-09-11T07:08:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: "degraded_stretch_mode": 0, 2024-09-11T07:08:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: "recovering_stretch_mode": 0, 2024-09-11T07:08:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: "stretch_mode_bucket": 0 2024-09-11T07:08:33.835 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:33.835 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:33.837 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:33.837 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:33.838 INFO:tasks.thrashosds.thrasher:j is {'epoch': 153, 'fsid': 'e1313abd-54a9-4e53-ab67-469f744048b1', 'created': '2024-09-11T07:05:29.098467+0000', 'modified': '2024-09-11T07:08:32.930559+0000', 'last_up_change': '2024-09-11T07:05:41.051856+0000', 'last_in_change': '2024-09-11T07:08:07.002217+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 3, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-11T07:05:41.897005+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.900000095367432, 'score_stable': 6.900000095367432, 'optimal_score': 0.28999999165534973, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-11T07:05:47.687214+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}, {'pool': 3, 'pool_name': 'pool_client.0', 'create_time': '2024-09-11T07:05:57.298060+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '153', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 49, 'snap_epoch': 153, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5299999713897705, 'score_stable': 1.5299999713897705, 'optimal_score': 1, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 0.7966022491455078, 'average_primary_affinity': 0.9100000262260437, 'average_primary_affinity_weighted': 0.800000011920929}}], 'osds': [{'osd': 0, 'uuid': '24d57cdb-2f3a-4a96-903d-11be7dc26a20', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 141, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6824', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6825', 'nonce': 1708235775}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6826', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6827', 'nonce': 1708235775}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6830', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6831', 'nonce': 1708235775}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6828', 'nonce': 1708235775}, {'type': 'v1', 'addr': '172.21.15.79:6829', 'nonce': 1708235775}]}, 'public_addr': '172.21.15.79:6825/1708235775', 'cluster_addr': '172.21.15.79:6827/1708235775', 'heartbeat_back_addr': '172.21.15.79:6831/1708235775', 'heartbeat_front_addr': '172.21.15.79:6829/1708235775', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'aa51dc1b-b783-4212-8736-1f666239613b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6800', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6801', 'nonce': 2076268206}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6802', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6803', 'nonce': 2076268206}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6806', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6807', 'nonce': 2076268206}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6804', 'nonce': 2076268206}, {'type': 'v1', 'addr': '172.21.15.79:6805', 'nonce': 2076268206}]}, 'public_addr': '172.21.15.79:6801/2076268206', 'cluster_addr': '172.21.15.79:6803/2076268206', 'heartbeat_back_addr': '172.21.15.79:6807/2076268206', 'heartbeat_front_addr': '172.21.15.79:6805/2076268206', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '141a913f-7353-44a9-9dbd-70219bcee638', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6816', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6817', 'nonce': 1904492349}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6818', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6819', 'nonce': 1904492349}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6822', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6823', 'nonce': 1904492349}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6820', 'nonce': 1904492349}, {'type': 'v1', 'addr': '172.21.15.79:6821', 'nonce': 1904492349}]}, 'public_addr': '172.21.15.79:6817/1904492349', 'cluster_addr': '172.21.15.79:6819/1904492349', 'heartbeat_back_addr': '172.21.15.79:6823/1904492349', 'heartbeat_front_addr': '172.21.15.79:6821/1904492349', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '32550aeb-0c8d-4ca9-afd5-3e5258e7255b', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 133, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6808', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6809', 'nonce': 1327328912}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6810', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6811', 'nonce': 1327328912}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6814', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6815', 'nonce': 1327328912}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.79:6812', 'nonce': 1327328912}, {'type': 'v1', 'addr': '172.21.15.79:6813', 'nonce': 1327328912}]}, 'public_addr': '172.21.15.79:6809/1327328912', 'cluster_addr': '172.21.15.79:6811/1327328912', 'heartbeat_back_addr': '172.21.15.79:6815/1327328912', 'heartbeat_front_addr': '172.21.15.79:6813/1327328912', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 0, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 100, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6808', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6809', 'nonce': 4087452871}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6810', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6811', 'nonce': 4087452871}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6814', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6815', 'nonce': 4087452871}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6812', 'nonce': 4087452871}, {'type': 'v1', 'addr': '172.21.15.110:6813', 'nonce': 4087452871}]}, 'public_addr': '172.21.15.110:6809/4087452871', 'cluster_addr': '172.21.15.110:6811/4087452871', 'heartbeat_back_addr': '172.21.15.110:6815/4087452871', 'heartbeat_front_addr': '172.21.15.110:6813/4087452871', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': '42c83053-328e-4c9b-bdaf-09e1a4cc8b7d', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 108, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6824', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6825', 'nonce': 2133006853}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6826', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6827', 'nonce': 2133006853}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6830', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6831', 'nonce': 2133006853}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6828', 'nonce': 2133006853}, {'type': 'v1', 'addr': '172.21.15.110:6829', 'nonce': 2133006853}]}, 'public_addr': '172.21.15.110:6825/2133006853', 'cluster_addr': '172.21.15.110:6827/2133006853', 'heartbeat_back_addr': '172.21.15.110:6831/2133006853', 'heartbeat_front_addr': '172.21.15.110:6829/2133006853', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '0ab29b1f-3012-4528-8f47-2cac908122c9', 'up': 1, 'in': 1, 'weight': 0.9810333251953125, 'primary_affinity': 0.3728179931640625, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 131, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6816', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6817', 'nonce': 2083734892}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6818', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6819', 'nonce': 2083734892}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6822', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6823', 'nonce': 2083734892}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6820', 'nonce': 2083734892}, {'type': 'v1', 'addr': '172.21.15.110:6821', 'nonce': 2083734892}]}, 'public_addr': '172.21.15.110:6817/2083734892', 'cluster_addr': '172.21.15.110:6819/2083734892', 'heartbeat_back_addr': '172.21.15.110:6823/2083734892', 'heartbeat_front_addr': '172.21.15.110:6821/2083734892', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'd9c7d12b-be93-41c9-a246-773faa65ecaf', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 132, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6800', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6801', 'nonce': 2322042784}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6802', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6803', 'nonce': 2322042784}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6806', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6807', 'nonce': 2322042784}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6804', 'nonce': 2322042784}, {'type': 'v1', 'addr': '172.21.15.110:6805', 'nonce': 2322042784}]}, 'public_addr': '172.21.15.110:6801/2322042784', 'cluster_addr': '172.21.15.110:6803/2322042784', 'heartbeat_back_addr': '172.21.15.110:6807/2322042784', 'heartbeat_front_addr': '172.21.15.110:6805/2322042784', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.653648+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.846269+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.970884+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:37.985630+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.236412+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.336953+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.306806+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-09-11T07:05:38.104744+0000', 'dead_epoch': 0}], 'pg_upmap': [{'pgid': '2.0', 'osds': [0, 6]}], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [{'pool': 3, 'snaps': [{'begin': 18, 'length': 7}]}], 'new_removed_snaps': [{'pool': 3, 'snaps': [{'begin': 18, 'length': 1}]}], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-09-11T07:08:33.838 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-09-11T07:08:33.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:33.839 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:33.830+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:33.937 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:33.934+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:34.007 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:34.008 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:34.022 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:34.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:34.034+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:34.138 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:34.134+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:34.148 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:34.148 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:34.163 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:34.169 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:34.249 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:34.246+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:34.324 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:34.324 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:34.333 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:34.333 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:34.340 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:34.334+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:34.341 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:34.341 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:34.345 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:34.357 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:34.358 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:34.375 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:34.376 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:34.396 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:34.396 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:34.415 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:34.415 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:34.434 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:34.435 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:34.440 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:34.434+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:34.452 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:34.453 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:34.515 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:34.515 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:34.515 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:34.530 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:34.573 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:34.570+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:34.641 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:34.638+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:34.698 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19019 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1564672~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.698 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.384536664, 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061394644999999998, 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19019 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309544+0000", 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309545+0000", 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0240000000000001e-06 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309550+0000", 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9060000000000001e-06 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309586+0000", 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5908000000000002e-05 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309597+0000", 2024-09-11T07:08:34.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0909e-05 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370799+0000", 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061201993000000003 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370869+0000", 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.004e-05 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370938+0000", 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.9864999999999996e-05 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19020 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1597440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38445582700001, 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061480545999999997, 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19020 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309625+0000", 2024-09-11T07:08:34.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309626+0000", 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0300000000000001e-06 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309630+0000", 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7299999999999996e-06 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309644+0000", 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309654+0000", 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6940000000000007e-06 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.370972+0000", 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061318594999999997 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371043+0000", 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1097e-05 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371105+0000", 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.177e-05 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19021 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1634304~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.707 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.384412481, 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061622525999999997, 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19021 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309668+0000", 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309669+0000", 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8199999999999998e-07 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309680+0000", 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1324e-05 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309692+0000", 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1816e-05 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309701+0000", 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4280000000000002e-06 2024-09-11T07:08:34.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371139+0000", 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061437741999999997 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371227+0000", 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8022999999999994e-05 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371290+0000", 2024-09-11T07:08:34.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3311000000000004e-05 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19023 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1667072~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38434235599999, 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061703411999999999, 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19023 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309738+0000", 2024-09-11T07:08:34.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309739+0000", 2024-09-11T07:08:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0899999999999999e-06 2024-09-11T07:08:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309744+0000", 2024-09-11T07:08:34.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6399999999999996e-06 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309767+0000", 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3278e-05 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309789+0000", 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1882000000000002e-05 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371318+0000", 2024-09-11T07:08:34.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061528815000000001 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371377+0000", 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9426000000000003e-05 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371441+0000", 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4281000000000003e-05 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19025 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1736704~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.384274232, 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061801782, 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19025 2024-09-11T07:08:34.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309806+0000", 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309807+0000", 2024-09-11T07:08:34.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0720000000000001e-06 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309812+0000", 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7940000000000002e-06 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309825+0000", 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2524000000000001e-05 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309834+0000", 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5419999999999994e-06 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371470+0000", 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061636294000000001 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371537+0000", 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.6270000000000001e-05 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371608+0000", 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.1285999999999995e-05 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19027 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1769472~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38423376599999, 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061896829, 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.721 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19027 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309847+0000", 2024-09-11T07:08:34.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309848+0000", 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.04e-06 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309852+0000", 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.2209999999999999e-06 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309864+0000", 2024-09-11T07:08:34.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1634000000000001e-05 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309872+0000", 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7280000000000001e-06 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371643+0000", 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061770298000000001 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371696+0000", 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3850000000000001e-05 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371743+0000", 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7058000000000002e-05 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19028 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1806336~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38419572500001, 2024-09-11T07:08:34.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062016996999999997, 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19028 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309885+0000", 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5799999999999998e-07 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309889+0000", 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.63e-06 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309901+0000", 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2072000000000001e-05 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309910+0000", 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0659999999999993e-06 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371775+0000", 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061864809 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371818+0000", 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3349000000000001e-05 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371902+0000", 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3312999999999993e-05 2024-09-11T07:08:34.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19029 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1839104~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38415675499999, 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062195168000000002, 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19029 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309924+0000", 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8400000000000003e-07 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309928+0000", 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.602e-06 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309940+0000", 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1778e-05 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309950+0000", 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0226e-05 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.371938+0000", 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061987722000000002 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372028+0000", 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0051999999999998e-05 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372119+0000", 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1003999999999998e-05 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19030 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1875968~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.734 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38411588100001, 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326412999999997, 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19030 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309965+0000", 2024-09-11T07:08:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309966+0000", 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.879999999999999e-07 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.309970+0000", 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.9659999999999998e-06 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310258+0000", 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028814299999999998 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310271+0000", 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3422e-05 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372139+0000", 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061868316 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372212+0000", 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3102999999999994e-05 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372291+0000", 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8474999999999997e-05 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19119 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1908736~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:34.739 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.383788108, 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062231197000000002, 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19119 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:34.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310292+0000", 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310293+0000", 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.144e-06 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310312+0000", 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703999999999999e-05 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310328+0000", 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5336e-05 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310338+0000", 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0567999999999999e-05 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372370+0000", 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062031831000000003 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372448+0000", 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7997999999999994e-05 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372524+0000", 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5616000000000002e-05 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19120 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1945600~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38372159799999, 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062381829999999999, 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19120 2024-09-11T07:08:34.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310359+0000", 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310360+0000", 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0699999999999999e-06 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310365+0000", 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7609999999999998e-06 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310380+0000", 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5344000000000001e-05 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310390+0000", 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6639999999999993e-06 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372568+0000", 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062178740000000003 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372661+0000", 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2596000000000006e-05 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372741+0000", 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9654999999999995e-05 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19121 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1978368~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38365387900001, 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062542885000000006, 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19121 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310427+0000", 2024-09-11T07:08:34.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310428+0000", 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1119999999999999e-06 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310432+0000", 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.69e-06 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310446+0000", 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3932e-05 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310456+0000", 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0084e-05 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372783+0000", 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062326452999999997 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372871+0000", 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.8335e-05 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.372969+0000", 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.8278999999999999e-05 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.752 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19122 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2015232~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38360894100001, 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062714986, 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19122 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.310471+0000", 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311214+0000", 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00074259399999999996 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311220+0000", 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9359999999999996e-06 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311235+0000", 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311254+0000", 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8984e-05 2024-09-11T07:08:34.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373081+0000", 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061826430000000002 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373143+0000", 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.2150000000000006e-05 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373186+0000", 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.3730000000000003e-05 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19123 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2048000~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38280931599999, 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062070795999999998, 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19123 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311271+0000", 2024-09-11T07:08:34.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311272+0000", 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2799999999999995e-07 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311275+0000", 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.728e-06 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311282+0000", 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7319999999999998e-06 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311297+0000", 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5162e-05 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373215+0000", 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061917840000000002 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373269+0000", 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3856000000000001e-05 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373342+0000", 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2750000000000007e-05 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19124 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 2084864~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.382774974, 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062199509, 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19124 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.762 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311305+0000", 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311553+0000", 2024-09-11T07:08:34.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024752999999999998 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311584+0000", 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0772000000000003e-05 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311611+0000", 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7256000000000001e-05 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311632+0000", 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0543999999999998e-05 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373378+0000", 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061746308 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373448+0000", 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0395999999999995e-05 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373505+0000", 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6703000000000002e-05 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:19168 3.c 3:33c7e8b8:::rbd_data.11612823e096.0000000000000001:9 [read 1900544~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e38)", 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 134.38241229900001, 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062038985999999997, 2024-09-11T07:08:34.766 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 19168 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.311668+0000", 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312838+0000", 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.001170267 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312847+0000", 2024-09-11T07:08:34.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4800000000000001e-06 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312867+0000", 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9817999999999999e-05 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.312880+0000", 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.341e-05 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.769 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373542+0000", 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060661495000000003 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373629+0000", 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.7566999999999997e-05 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:20.373707+0000", 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7948999999999995e-05 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.770 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:33491 3.16 3:6f98b1e7:::rbd_data.116176c25662.0000000000000024:head [set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 126.44451134800001, 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061851832000000002, 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 33491 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.771 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249569+0000", 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.772 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249571+0000", 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2299999999999998e-06 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249585+0000", 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3229e-05 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249614+0000", 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9791999999999999e-05 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.773 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249631+0000", 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6521999999999999e-05 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249757+0000", 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012653299999999999 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.249884+0000", 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.774 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 7", 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.260082+0000", 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010197474999999999 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311224+0000", 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.051142281999999997 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311252+0000", 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8022e-05 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.775 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311344+0000", 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1784000000000001e-05 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:28.311421+0000", 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7089999999999995e-05 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109724 3.1d 3:bd9f0dd6:::rbd_data.1161dd0f3253.0000000000000012:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:34.776 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.174636110000002, 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.063964249000000001, 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109724 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.777 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519444+0000", 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.519447+0000", 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1799999999999999e-06 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.778 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523605+0000", 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0041584270000000001 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523644+0000", 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.8908000000000001e-05 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523661+0000", 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7198999999999999e-05 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.779 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.523781+0000", 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011950799999999999 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.524055+0000", 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00027451199999999998 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.548286+0000", 2024-09-11T07:08:34.780 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.024231249 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583267+0000", 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.034980245 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583326+0000", 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.9815999999999998e-05 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.781 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583372+0000", 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.6074e-05 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.583409+0000", 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.6130999999999997e-05 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.782 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109733 3.5 3:a2b45ebf:::rbd_data.1161dd0f3253.0000000000000006:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.093035405000002, 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.067924668999999993, 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109733 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.783 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601045+0000", 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601047+0000", 2024-09-11T07:08:34.784 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.029e-06 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601058+0000", 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0974e-05 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601083+0000", 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4757999999999999e-05 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.785 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601099+0000", 2024-09-11T07:08:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5733e-05 2024-09-11T07:08:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601212+0000", 2024-09-11T07:08:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113857 2024-09-11T07:08:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.786 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.601453+0000", 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000240657 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 3", 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.613355+0000", 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01190186 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668765+0000", 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.055410261000000002 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.787 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668796+0000", 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.0833000000000001e-05 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668891+0000", 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4708000000000002e-05 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.668970+0000", 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8998999999999994e-05 2024-09-11T07:08:34.788 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:111102 3.1d 3:b9ff0ad7:::rbd_object_map.1161dd0f3253:head [read 0~42] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e107)", 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 50.858204915000002, 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.014308821, 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:34.789 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 111102 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835876+0000", 2024-09-11T07:08:34.790 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835877+0000", 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.564e-06 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835883+0000", 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0909999999999998e-06 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.791 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835900+0000", 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.668e-05 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835907+0000", 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2660000000000004e-06 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835963+0000", 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5933999999999997e-05 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.792 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:43.835972+0000", 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1449999999999997e-06 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849359+0000", 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0133867839999999 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.849663+0000", 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030396600000000002 2024-09-11T07:08:34.793 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:44.850184+0000", 2024-09-11T07:08:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00052139099999999996 2024-09-11T07:08:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:34.794 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:34.794 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:34.796 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:34.796 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:34.790+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:34.897 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:34.894+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:34.922 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:34.922 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:34.923 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:34.923 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:34.937 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:34.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:08:35.025 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:35.022+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:35.101 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:35.094+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:35.109 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:35.110 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:35.110 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:35.110 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:35.110 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:35.124 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:35.199 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:35.194+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:35.292 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:35.292 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:35.292 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:35.292 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.96621924799999, 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.293 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:08:35.294 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.295 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:08:35.296 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.297 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:08:35.298 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.66328015299999, 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.299 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:35.300 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.301 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.302 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.303 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.66321703700001, 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.304 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.305 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.306 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.66314204400001, 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.311 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.663077488, 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:08:35.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.313 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:08:35.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:08:35.316 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.316 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.316 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.316 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.317 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:35.317 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.663022259, 2024-09-11T07:08:35.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:08:35.317 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.317 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.317 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.317 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.317 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.317 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.317 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:08:35.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.321 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.66296836199999, 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.322 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.325 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.66290786299999, 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.326 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.327 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:08:35.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.66285185000001, 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.330 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:08:35.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.334 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.66277249699999, 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:08:35.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:08:35.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.66271619400001, 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.339 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:08:35.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:08:35.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:08:35.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.662643755, 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.345 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:35.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:08:35.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.349 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.66258763499999, 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.350 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:35.354 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.66251416899999, 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:35.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.356 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:08:35.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:08:35.358 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.662435776, 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.359 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.360 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:08:35.361 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 116.753259762, 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:35.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:08:35.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:35.368 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.496674177000003, 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.369 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:08:35.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:35.374 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.726680165999994, 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:35.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.379 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 64.718690271, 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.380 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:35.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:08:35.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:08:35.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109791 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 5824422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 56.559660014999999, 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029141958999999999, 2024-09-11T07:08:35.384 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109791 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728800+0000", 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.064e-06 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744261+0000", 2024-09-11T07:08:35.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015461523 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744287+0000", 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5086999999999999e-05 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744298+0000", 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1899000000000001e-05 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744376+0000", 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7465000000000005e-05 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744514+0000", 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013820400000000001 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.745045+0000", 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053122399999999995 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.751499+0000", 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064538750000000004 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757772+0000", 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062726509999999997 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757865+0000", 2024-09-11T07:08:35.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2802999999999999e-05 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757933+0000", 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8164000000000007e-05 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.390 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:35.392 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:35.392 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:35.386+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:35.492 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:35.486+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:35.559 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:35.560 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:35.560 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:35.560 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:35.575 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:35.593 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:35.590+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:35.694 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:35.690+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:35.744 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:35.744 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:35.745 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:35.745 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:35.745 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:35.759 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:35.805 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:35.802+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:35.885 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:35.885 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:35.885 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:35.885 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:35.885 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.885 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 172.81280882600001, 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.886 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:08:35.887 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.888 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:08:35.889 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:08:35.890 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:08:35.890 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.890 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.890 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.890 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.891 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.892 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.386638331, 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.893 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.894 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.894 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.894 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:08:35.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.894 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.894 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.894 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.894 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:35.894 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.894 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:08:35.895 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.896 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.897 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38658211399999, 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:08:35.898 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.899 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:08:35.900 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:08:35.901 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38353495300001, 2024-09-11T07:08:35.902 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.903 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.904 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.905 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.906 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38348185300001, 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:08:35.907 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.908 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.908 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.908 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.908 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:08:35.908 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.908 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.908 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.908 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.909 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.910 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:08:35.911 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38338294799999, 2024-09-11T07:08:35.912 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.913 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:08:35.914 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.915 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38331507999999, 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:08:35.917 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:08:35.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38325854600001, 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:08:35.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:08:35.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.383206086, 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:08:35.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:35.931 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38315445800001, 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:08:35.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:08:35.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:35.936 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38310303599999, 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.937 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:08:35.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38305194200001, 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.941 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.942 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:08:35.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:08:35.945 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.382999982, 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.946 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:35.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:08:35.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.950 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38290046899999, 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:08:35.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.952 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:08:35.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:08:35.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:35.955 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38284166400001, 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.959 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.38279051000001, 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.960 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.962 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:08:35.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:08:35.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:08:35.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:08:35.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:08:35.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:08:35.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:08:35.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:08:35.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:08:35.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:08:35.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.382734204, 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:08:35.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:08:35.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:35.972 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 131.37593468899999, 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:08:35.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:08:35.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.643864664000006, 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:35.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:35.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:08:35.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:08:35.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 75.326455616999993, 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:35.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:35.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:08:35.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:08:35.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:35.987 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:35.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:35.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:35.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:08:35.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:08:35.989 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.989 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.989 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.989 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:35.989 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:35.989 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:08:35.991 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:35.986+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:35.991 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:36.092 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:36.086+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:36.128 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:36.128 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:36.128 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:36.128 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:36.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:36.193 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:36.186+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:36.293 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:36.290+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:36.314 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:36.314 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:36.314 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:36.329 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:36.394 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:36.390+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:36.454 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:36.454 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:36.454 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:36.454 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:36.454 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.454 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.77918570099999, 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.455 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:08:36.456 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.457 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.458 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.77845081999999, 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.459 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.460 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:08:36.461 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:08:36.462 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.463 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.77588485000001, 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:08:36.464 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.465 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.466 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:08:36.467 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:36.468 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.775865235, 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.469 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:08:36.470 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.471 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:08:36.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:08:36.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.472 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.472 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:08:36.472 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:08:36.472 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.472 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.473 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:08:36.473 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:08:36.473 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.473 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.473 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.77584232999999, 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.474 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.475 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:08:36.476 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:08:36.477 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.478 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.479 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.479 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:36.479 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.77546356900001, 2024-09-11T07:08:36.479 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:08:36.479 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.479 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.479 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.479 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.480 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:08:36.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.480 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.480 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.480 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:36.480 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.480 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.480 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.481 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:36.481 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.481 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.481 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.481 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:08:36.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:08:36.482 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.482 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.482 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.482 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:08:36.482 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:08:36.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.483 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.483 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:08:36.483 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:08:36.483 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.483 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:08:36.484 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:08:36.484 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.484 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.484 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.484 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:08:36.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:08:36.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.485 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.485 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:08:36.485 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:08:36.485 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.485 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.486 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.486 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:08:36.486 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:08:36.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.486 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.486 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.486 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.487 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.487 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.487 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:36.487 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.775432067, 2024-09-11T07:08:36.487 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:08:36.487 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.488 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.488 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.488 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.488 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.489 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:08:36.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:08:36.490 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.490 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.490 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.490 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:08:36.490 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:08:36.491 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.492 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.774914792, 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.493 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.494 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.495 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:08:36.496 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.497 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.77489066300001, 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.498 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:36.499 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.500 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:08:36.501 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.77487733699999, 2024-09-11T07:08:36.502 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:36.503 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.504 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.505 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:08:36.506 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.77445740900001, 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:08:36.507 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.508 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:08:36.509 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.510 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.511 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.512 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.512 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.512 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.512 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.512 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:36.512 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.77443, 2024-09-11T07:08:36.512 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:08:36.512 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.512 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.512 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.513 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:08:36.514 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:08:36.515 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:08:36.515 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.515 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.515 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.515 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:08:36.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:08:36.516 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.516 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.516 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.516 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:08:36.516 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:08:36.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.517 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.517 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.517 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:08:36.517 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:08:36.517 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.518 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.518 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.518 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:08:36.518 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:08:36.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.518 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.518 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.519 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.519 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.519 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:36.519 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:36.519 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 145.76855086800001, 2024-09-11T07:08:36.520 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:08:36.520 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.520 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.520 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:36.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.520 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.521 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.521 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:08:36.521 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.521 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.522 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.522 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.522 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:36.522 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.522 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.523 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.523 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:36.523 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.523 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.523 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.524 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:36.524 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:08:36.524 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.524 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.524 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.525 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:08:36.525 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:08:36.525 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.525 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.525 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.526 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:08:36.526 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:08:36.526 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.526 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.526 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:08:36.527 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:08:36.527 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.527 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.527 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.527 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:08:36.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:08:36.528 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.528 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.528 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.528 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:08:36.528 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:08:36.529 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.529 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.529 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.529 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:08:36.529 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:08:36.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.530 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.530 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.530 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.530 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.530 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:08:36.530 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:36.531 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 110.010673535, 2024-09-11T07:08:36.531 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:08:36.531 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.531 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.531 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:36.531 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.532 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.532 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:08:36.532 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.532 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.532 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:36.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.533 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.533 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.533 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:36.533 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.533 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:08:36.534 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.535 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.536 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:08:36.537 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:36.538 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.539 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 110.01049972200001, 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:08:36.540 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.541 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.542 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:08:36.543 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.544 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.545 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:08:36.546 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118076 3.1b 3.403f121b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:07.010262+0000", 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.440166279, 2024-09-11T07:08:36.547 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.019655347, 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118076 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010262+0000", 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.548 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010262+0000", 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010266+0000", 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3900000000000002e-06 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.549 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010282+0000", 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6008e-05 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010316+0000", 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4051000000000003e-05 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010333+0000", 2024-09-11T07:08:36.550 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.677e-05 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022541+0000", 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012208627999999999 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022552+0000", 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1236999999999999e-05 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.551 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.029891+0000", 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0073384359999999 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.029918+0000", 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6826999999999999e-05 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.552 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118077 3.1b 3.403f121b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.440049911999999, 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0196433760000001, 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118077 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.553 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.554 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.61e-07 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010385+0000", 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3460000000000001e-06 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010395+0000", 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6909999999999992e-06 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.555 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010401+0000", 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022589+0000", 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012188723 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022595+0000", 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9240000000000004e-06 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.029994+0000", 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.007398268 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.030022+0000", 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8492000000000001e-05 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.557 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118078 3.1b 3.403f121b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:07.365636+0000", 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 29.084792237999999, 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.66451633499999996, 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118078 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.558 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365636+0000", 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365636+0000", 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.559 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365640+0000", 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7069999999999998e-06 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365657+0000", 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6733000000000001e-05 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365697+0000", 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9842000000000002e-05 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.560 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365720+0000", 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3693000000000002e-05 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365918+0000", 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019730400000000001 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365935+0000", 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7422e-05 2024-09-11T07:08:36.561 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.030136+0000", 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.66420112099999995 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.030153+0000", 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6512999999999999e-05 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.562 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118458 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_add in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:12.168315+0000", 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.282114004, 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.93473760699999997, 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118458 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.563 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168315+0000", 2024-09-11T07:08:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168315+0000", 2024-09-11T07:08:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.564 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168316+0000", 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5999999999999991e-07 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168321+0000", 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3360000000000002e-06 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168332+0000", 2024-09-11T07:08:36.565 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1009000000000001e-05 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168338+0000", 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.84e-06 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168390+0000", 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2210000000000003e-05 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.566 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168397+0000", 2024-09-11T07:08:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0029999999999997e-06 2024-09-11T07:08:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.098752+0000", 2024-09-11T07:08:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.93035478800000004 2024-09-11T07:08:36.567 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.099116+0000", 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036387600000000001 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.099603+0000", 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048711099999999998 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.568 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.101758+0000", 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021549260000000002 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.102794+0000", 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001036702 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:36.569 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.102943+0000", 2024-09-11T07:08:36.570 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014871599999999999 2024-09-11T07:08:36.570 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.572 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.572 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.572 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.103052+0000", 2024-09-11T07:08:36.572 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010912999999999999 2024-09-11T07:08:36.572 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.572 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:119510 3.17 3:ed1c1937:::journal.11617431ac27:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e141)", 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:21.025014+0000", 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 15.425414718000001, 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.83167153699999996, 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:36.573 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 119510 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025014+0000", 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025014+0000", 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:36.574 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025016+0000", 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2000000000000001e-06 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025026+0000", 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.03e-05 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025056+0000", 2024-09-11T07:08:36.575 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9382000000000001e-05 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025078+0000", 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2076e-05 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025179+0000", 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100757 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.576 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025188+0000", 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7340000000000003e-06 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.856537+0000", 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.83134908100000005 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.856685+0000", 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014800699999999999 2024-09-11T07:08:36.577 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.578 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:36.578 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:36.578 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:36.578 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:08:36.580 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:36.580 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:36.574+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:36.680 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:36.674+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:36.744 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:36.744 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:36.744 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:36.760 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:36.766 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:36.766 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:36.783 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:36.783 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:36.783 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:36.778+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:36.799 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:36.799 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:36.816 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:36.816 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:36.837 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:36.837 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:36.857 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:36.858 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:36.882 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:36.878+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:36.892 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:36.892 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:36.893 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:36.893 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:36.909 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:36.913 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:36.913 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:36.983 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:36.978+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:37.041 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:37.041 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:37.058 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:37.101 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:37.098+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:37.185 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:37.182+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:37.188 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:37.188 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:37.202 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:37.289 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:37.286+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:37.366 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:37.366 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:37.381 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:37.426 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:37.422+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:37.488 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:37.482+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:37.550 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:37.551 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:37.566 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:37.609 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:37.606+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:37.690 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:37.686+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:37.691 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:37.691 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:37.705 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:37.791 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:37.786+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:37.878 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:37.890 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:37.892 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:37.886+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:37.893 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:37.992 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:37.986+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:38.001 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:08:38.021 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:38.021 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:38.040 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:38.092 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:38.086+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:38.181 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:38.193 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:38.190+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:38.195 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:38.294 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:38.290+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:38.358 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:38.359 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:38.373 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:38.417 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:38.414+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:38.496 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:38.490+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:38.542 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:38.542 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:38.557 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:38.597 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:38.594+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:38.698 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:38.694+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:38.728 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:38.728 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:38.742 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:38.799 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:38.794+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:38.836 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:08:38.839 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7, 0] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:08:38.839 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:08:38.839 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-09-11T07:08:38.839 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 1.000000 2024-09-11T07:08:38.840 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-11T07:08:38.900 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:38.894+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:38.924 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:38.924 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:38.932 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:38.941 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:39.036 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:39.030+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:39.080 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:39.081 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:39.097 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:39.097 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:39.102 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:39.098+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:39.114 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:39.114 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:39.120 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:39.120 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:39.130 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:39.130 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:39.134 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:39.151 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:39.151 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:39.171 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:39.171 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:39.190 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:39.190 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:39.208 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:39.208 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:39.221 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:39.218+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:39.303 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:39.298+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:39.308 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:39.308 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:39.308 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:39.309 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:39.323 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:39.409 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:39.406+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:39.483 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:39.483 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:39.483 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:39.483 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:39.483 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:39.497 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:39.505 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:39.502+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:39.607 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:39.602+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:39.668 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:39.668 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:39.668 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:39.668 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:39.668 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.668 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.668 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:39.668 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.34153237000001, 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.669 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.670 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.671 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.672 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:08:39.673 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.03859327500001, 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.674 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.675 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.676 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:08:39.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:08:39.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:08:39.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:08:39.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:08:39.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:08:39.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:08:39.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.679 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.679 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.679 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.038530159, 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:08:39.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:08:39.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:08:39.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:08:39.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.684 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.03845516600001, 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:39.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:39.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:08:39.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.03839060999999, 2024-09-11T07:08:39.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:08:39.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:08:39.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.693 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.038335381, 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:08:39.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:08:39.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.03828148400001, 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.698 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.700 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:39.702 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.03822098500001, 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:39.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.704 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:08:39.706 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.038164972, 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.707 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.708 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.03808561899999, 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.711 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.712 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.715 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.03802931600001, 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:08:39.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:08:39.719 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.720 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.720 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.720 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.720 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:39.720 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.037956877, 2024-09-11T07:08:39.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:08:39.720 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.720 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.722 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.724 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.03790075699999, 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.726 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:08:39.728 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.03782729100001, 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.729 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.730 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:08:39.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 145.03774889799999, 2024-09-11T07:08:39.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.737 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 121.12857288399999, 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.739 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.871987298999997, 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:08:39.742 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:08:39.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:08:39.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:08:39.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.101993288000003, 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:08:39.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:08:39.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 69.094003392999994, 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:08:39.754 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:08:39.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.758 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109791 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 5824422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 60.934973137, 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029141958999999999, 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:39.759 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109791 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:39.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728800+0000", 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.064e-06 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744261+0000", 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015461523 2024-09-11T07:08:39.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744287+0000", 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5086999999999999e-05 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744298+0000", 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1899000000000001e-05 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744376+0000", 2024-09-11T07:08:39.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7465000000000005e-05 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744514+0000", 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013820400000000001 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.745045+0000", 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053122399999999995 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.751499+0000", 2024-09-11T07:08:39.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064538750000000004 2024-09-11T07:08:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757772+0000", 2024-09-11T07:08:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062726509999999997 2024-09-11T07:08:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:39.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757865+0000", 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2802999999999999e-05 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757933+0000", 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8164000000000007e-05 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:39.765 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:39.767 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:39.767 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:39.762+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:39.867 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:39.862+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:39.935 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:39.935 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:39.935 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:39.949 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:39.993 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:39.990+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:40.005 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-11T07:08:40.069 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:40.062+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:40.124 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:40.124 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:40.124 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:40.125 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:40.125 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:40.140 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:40.181 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:40.178+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:40.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:40.266+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:40.306 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:40.306 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:40.306 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:40.306 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:40.306 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.306 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 177.23368491100001, 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.307 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.308 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.309 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.310 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:08:40.311 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.312 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.807514416, 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.313 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:40.314 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:08:40.315 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.316 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.807458199, 2024-09-11T07:08:40.317 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.318 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.319 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.320 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:08:40.321 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.80441103800001, 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.322 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:08:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.323 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.324 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.325 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.326 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.80435793800001, 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.327 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.328 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:08:40.329 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:08:40.330 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.331 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.80425903299999, 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.332 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:08:40.333 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.334 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:08:40.335 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.80419116499999, 2024-09-11T07:08:40.336 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.337 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:08:40.338 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.339 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.340 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.80413463100001, 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.341 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.342 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.343 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:08:40.344 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.345 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.804082171, 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.346 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:08:40.347 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.348 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.349 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.80403054300001, 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:08:40.350 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.351 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:08:40.352 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.353 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:08:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:08:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:08:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:08:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.354 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:08:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:08:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:40.355 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.803979121, 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.356 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:40.357 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:08:40.358 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.359 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:08:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:08:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.80392802700001, 2024-09-11T07:08:40.360 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:08:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.361 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:08:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.362 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.363 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:08:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.364 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:08:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:08:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:08:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:08:40.365 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:08:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:08:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.366 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:08:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:08:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.367 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:08:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:08:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:08:40.368 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:08:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:40.369 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.803876067, 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.370 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.371 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.372 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:08:40.373 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.803776554, 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.374 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.375 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:08:40.376 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.377 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.378 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.80371774899999, 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.379 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.380 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.381 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:08:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:08:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:08:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:08:40.382 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.383 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.80366659500001, 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:08:40.384 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.385 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.386 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:08:40.387 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.388 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.80361028900001, 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:08:40.389 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.390 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:08:40.391 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.392 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.393 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 135.79681077399999, 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:40.394 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.395 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.396 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.397 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:40.398 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 80.064740748999995, 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.399 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:08:40.400 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.401 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:08:40.402 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.403 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:08:40.404 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 79.747331701999997, 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:40.405 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:40.406 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:40.407 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:40.408 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.409 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:08:40.410 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:40.411 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:40.411 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:40.412 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:40.413 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:40.410+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:40.513 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:40.510+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:40.544 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:40.544 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:40.544 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:40.558 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:40.614 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:40.610+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:40.680 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:40.680 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:40.681 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:40.681 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:40.681 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:40.694 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:40.715 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:40.710+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:40.816 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.141532265, 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.817 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.818 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.819 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.820 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.821 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.140797384, 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.822 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.823 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:08:40.824 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.825 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:08:40.826 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.13823141399999, 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.827 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.828 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:08:40.829 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.830 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.831 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.138211799, 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.832 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.833 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.834 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:08:40.835 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.836 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.138188894, 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:08:40.837 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.838 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:08:40.839 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.840 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.841 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.13781013299999, 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.842 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.843 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.844 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.845 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.846 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.137778631, 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.847 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:08:40.848 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.849 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.850 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:08:40.851 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:08:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:08:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:08:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.852 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:08:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:08:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:08:40.853 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:08:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:08:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:08:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.854 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.13726135600001, 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.855 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:08:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.856 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:08:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:08:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.857 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:08:40.858 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.859 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.13723722700001, 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.860 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.861 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:08:40.862 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.863 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.864 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.137223901, 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.865 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.866 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:08:40.867 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.868 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:08:40.869 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:40.870 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.13680397300001, 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:40.871 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.872 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:08:40.873 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:08:40.874 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:08:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.136776564, 2024-09-11T07:08:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:08:40.875 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.876 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:08:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:08:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.877 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:08:40.878 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:08:40.879 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 150.13089743200001, 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.881 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.882 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:08:40.883 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:08:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:08:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:08:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:08:40.884 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:08:40.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.885 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.885 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.885 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.885 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.885 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:08:40.885 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:40.885 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 114.373020099, 2024-09-11T07:08:40.885 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:40.886 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:08:40.887 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:08:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:08:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:08:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.888 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:08:40.889 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.890 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.891 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:40.892 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.893 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 114.372846286, 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.894 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:08:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:08:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:08:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:08:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.896 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:08:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:08:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:08:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:08:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.897 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.898 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:08:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:08:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:08:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:08:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.899 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:08:40.900 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.901 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118076 3.1b 3.403f121b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:07.010262+0000", 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.802512843000002, 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.019655347, 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.902 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118076 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010262+0000", 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.903 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010262+0000", 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010266+0000", 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3900000000000002e-06 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010282+0000", 2024-09-11T07:08:40.904 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6008e-05 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010316+0000", 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4051000000000003e-05 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010333+0000", 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.677e-05 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.905 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022541+0000", 2024-09-11T07:08:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012208627999999999 2024-09-11T07:08:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022552+0000", 2024-09-11T07:08:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1236999999999999e-05 2024-09-11T07:08:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.906 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.029891+0000", 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0073384359999999 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.029918+0000", 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6826999999999999e-05 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.907 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118077 3.1b 3.403f121b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.802396475999998, 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0196433760000001, 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.908 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118077 2024-09-11T07:08:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.909 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.61e-07 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010385+0000", 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3460000000000001e-06 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.910 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010395+0000", 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6909999999999992e-06 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010401+0000", 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.911 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022589+0000", 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012188723 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022595+0000", 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9240000000000004e-06 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.029994+0000", 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.007398268 2024-09-11T07:08:40.912 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.030022+0000", 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8492000000000001e-05 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118078 3.1b 3.403f121b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:07.365636+0000", 2024-09-11T07:08:40.913 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 33.447138801999998, 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.66451633499999996, 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118078 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365636+0000", 2024-09-11T07:08:40.914 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365636+0000", 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365640+0000", 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7069999999999998e-06 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.915 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365657+0000", 2024-09-11T07:08:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6733000000000001e-05 2024-09-11T07:08:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365697+0000", 2024-09-11T07:08:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9842000000000002e-05 2024-09-11T07:08:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.916 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365720+0000", 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3693000000000002e-05 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365918+0000", 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019730400000000001 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:40.917 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365935+0000", 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7422e-05 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.030136+0000", 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.66420112099999995 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.030153+0000", 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6512999999999999e-05 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.918 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118458 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_add in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:12.168315+0000", 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 28.644460568, 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.93473760699999997, 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.919 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118458 2024-09-11T07:08:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168315+0000", 2024-09-11T07:08:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.920 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168315+0000", 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168316+0000", 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5999999999999991e-07 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.921 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168321+0000", 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3360000000000002e-06 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168332+0000", 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1009000000000001e-05 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168338+0000", 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.84e-06 2024-09-11T07:08:40.922 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168390+0000", 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2210000000000003e-05 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168397+0000", 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0029999999999997e-06 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.098752+0000", 2024-09-11T07:08:40.923 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.93035478800000004 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.099116+0000", 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036387600000000001 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.099603+0000", 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048711099999999998 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.924 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.101758+0000", 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021549260000000002 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.102794+0000", 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001036702 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:40.925 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.102943+0000", 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014871599999999999 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.103052+0000", 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010912999999999999 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.926 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:119510 3.17 3:ed1c1937:::journal.11617431ac27:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e141)", 2024-09-11T07:08:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:21.025014+0000", 2024-09-11T07:08:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 19.787761281999998, 2024-09-11T07:08:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.83167153699999996, 2024-09-11T07:08:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 119510 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025014+0000", 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025014+0000", 2024-09-11T07:08:40.928 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025016+0000", 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2000000000000001e-06 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025026+0000", 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.03e-05 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:40.929 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025056+0000", 2024-09-11T07:08:40.930 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9382000000000001e-05 2024-09-11T07:08:40.932 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.932 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.932 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:40.932 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025078+0000", 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2076e-05 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025179+0000", 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100757 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025188+0000", 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7340000000000003e-06 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.933 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.856537+0000", 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.83134908100000005 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.856685+0000", 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014800699999999999 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:40.934 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:40.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:40.810+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:40.936 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:40.936 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:08:40.978 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:40.974+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:41.038 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:41.034+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:41.125 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:41.125 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:41.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:41.125 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:123451 3.a 3:525e9568:::rbd_object_map.1161f241e2ef:head [call lock.lock in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e161)", 2024-09-11T07:08:41.125 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:41.123967+0000", 2024-09-11T07:08:41.125 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 0.00062657000000000001, 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00064856500000000004, 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "waiting for sub ops", 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 123451 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:41.123967+0000", 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:41.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:41.123967+0000", 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:41.123969+0000", 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9879999999999999e-06 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:41.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:41.123976+0000", 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4359999999999996e-06 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:41.123992+0000", 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.5868000000000001e-05 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:41.124000+0000", 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1600000000000001e-06 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:41.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:41.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:41.124054+0000", 2024-09-11T07:08:41.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4419999999999997e-05 2024-09-11T07:08:41.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:41.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:41.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:41.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:41.124113+0000", 2024-09-11T07:08:41.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9104000000000002e-05 2024-09-11T07:08:41.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:41.124221+0000", 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010787 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 1 2024-09-11T07:08:41.130 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:41.140 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:41.134+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:41.147 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:41.227 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:08:41.241 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:41.234+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:41.303 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:41.304 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:41.304 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:41.318 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:41.361 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:41.358+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:41.370 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:41.370 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:41.387 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:41.387 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:41.404 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:41.405 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:41.420 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:41.421 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:41.428 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:41.428 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:41.441 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:41.441 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:41.442 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:41.442 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:41.438+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:41.461 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:41.461 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:41.481 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:41.481 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:41.501 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:41.501 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:41.543 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:41.538+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:41.555 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:41.555 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:41.567 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:41.657 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:41.654+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:41.727 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:41.727 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:41.739 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:41.782 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:41.778+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:41.846 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:41.842+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:41.900 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:41.900 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:41.913 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:41.957 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:41.954+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:42.028 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:08:42.035 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:42.035 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:42.048 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:42.042+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:42.052 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:42.149 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:42.146+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:42.225 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:42.225 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:42.239 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:42.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:42.278+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:42.350 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:42.346+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:42.399 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:42.399 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:42.413 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:42.458 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:42.454+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:42.546 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:42.546 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:42.552 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:42.546+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:42.560 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:42.653 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:42.650+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:42.731 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:42.731 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:42.745 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:42.785 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:42.782+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:42.855 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:42.850+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:42.910 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:42.910 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:42.924 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:42.965 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:42.962+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:43.057 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:43.050+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:43.091 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:43.091 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:43.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:43.158 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:43.153+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:43.224 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:43.224 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:43.239 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:43.259 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:43.254+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:43.360 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:43.358+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:43.410 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:43.410 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:43.424 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:43.460 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:43.458+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:43.517 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:43.548 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:43.548 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:43.560 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:43.553+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:43.562 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:43.661 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:43.657+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:43.670 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:43.670 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:43.686 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:43.687 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:43.703 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:43.703 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:43.719 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:43.720 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:43.736 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:43.736 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:43.739 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:43.740 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:43.749 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:43.758 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:43.758 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:43.779 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:43.779 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:43.789 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:43.785+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:43.798 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:43.798 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:43.863 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:43.857+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:43.914 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:43.914 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:9280 3.10 3:0c9c6f38:::rbd_data.11612823e096.000000000000002b:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 2097152 write_size 2097152,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.58793770099999, 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049907682000000002, 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.915 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.916 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 9280 2024-09-11T07:08:43.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.916 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.916 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.916 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.916 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:43.916 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.916 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322232+0000", 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322235+0000", 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.18e-06 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.917 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322250+0000", 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5248999999999999e-05 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322284+0000", 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.3739999999999999e-05 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.918 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322303+0000", 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.9513000000000001e-05 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322491+0000", 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000187889 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.322735+0000", 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00024393799999999999 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.919 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.332797+0000", 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.010061956 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.371946+0000", 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.039148864999999998 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372019+0000", 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.2939000000000001e-05 2024-09-11T07:08:43.920 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372088+0000", 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8746999999999998e-05 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.372139+0000", 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1666000000000003e-05 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.921 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10006 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 311296~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28499860599999, 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012454784, 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.922 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10006 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625171+0000", 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.923 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625172+0000", 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625178+0000", 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.054e-06 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625198+0000", 2024-09-11T07:08:43.924 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0225999999999999e-05 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625214+0000", 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5913000000000002e-05 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637134+0000", 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011920128 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.925 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637324+0000", 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000189829 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637626+0000", 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00030151800000000002 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.926 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10008 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 573440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.927 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:43.927 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28493549000001, 2024-09-11T07:08:43.927 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012890726999999999, 2024-09-11T07:08:43.927 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.927 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.927 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.927 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.928 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.928 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10008 2024-09-11T07:08:43.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.928 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.928 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.928 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.928 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:43.928 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.928 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625234+0000", 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625235+0000", 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625257+0000", 2024-09-11T07:08:43.929 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1577e-05 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625275+0000", 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8703e-05 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625290+0000", 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4466e-05 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.930 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637708+0000", 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012417727999999999 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.637933+0000", 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022578799999999999 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638125+0000", 2024-09-11T07:08:43.931 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019126500000000001 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10010 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 573440~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28486049700001, 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013392622999999999, 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.932 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10010 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625309+0000", 2024-09-11T07:08:43.933 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625310+0000", 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.173e-06 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625316+0000", 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1229999999999997e-06 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.934 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625333+0000", 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7122999999999999e-05 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625347+0000", 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3784000000000001e-05 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638237+0000", 2024-09-11T07:08:43.935 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012889884000000001 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638465+0000", 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022787799999999999 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638701+0000", 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000236658 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.936 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10011 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 442368~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.284795941, 2024-09-11T07:08:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013950449, 2024-09-11T07:08:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.937 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10011 2024-09-11T07:08:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.938 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625373+0000", 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625375+0000", 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2669999999999999e-06 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.939 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625381+0000", 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0730000000000001e-06 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625398+0000", 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6990000000000002e-05 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625410+0000", 2024-09-11T07:08:43.940 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2466000000000001e-05 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.638785+0000", 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013375224 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639043+0000", 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025804799999999998 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.941 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639324+0000", 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00028038100000000001 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10043 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 114688~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.284740712, 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014368038, 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.942 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10043 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625429+0000", 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.943 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625430+0000", 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.124e-06 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625435+0000", 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.66e-06 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625453+0000", 2024-09-11T07:08:43.944 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7353000000000001e-05 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625465+0000", 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.225e-05 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639436+0000", 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013970701 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.945 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639598+0000", 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000161948 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639797+0000", 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019900199999999999 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10045 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 245760~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.946 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28468681499999, 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014661876000000001, 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10045 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:43.947 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625483+0000", 2024-09-11T07:08:43.948 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.948 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.948 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.948 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.948 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625484+0000", 2024-09-11T07:08:43.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:43.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.949 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625492+0000", 2024-09-11T07:08:43.949 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4160000000000004e-06 2024-09-11T07:08:43.949 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.949 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.949 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625511+0000", 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8340000000000001e-05 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625524+0000", 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3859999999999999e-05 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639859+0000", 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014334247 2024-09-11T07:08:43.950 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.639999+0000", 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013991000000000001 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640144+0000", 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014590299999999999 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.951 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10047 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 376832~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28462631599999, 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015174683, 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10047 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.952 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625543+0000", 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.953 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625544+0000", 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7000000000000003e-07 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625550+0000", 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8799999999999996e-06 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625568+0000", 2024-09-11T07:08:43.954 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7703e-05 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625581+0000", 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.363e-05 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640257+0000", 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014675644 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.955 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640495+0000", 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00023845800000000001 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640718+0000", 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00022239800000000001 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10049 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 507904~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:43.956 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28457030300001, 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015590583, 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10049 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.957 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625599+0000", 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625600+0000", 2024-09-11T07:08:43.958 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.4e-07 2024-09-11T07:08:43.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.959 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.959 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.959 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625606+0000", 2024-09-11T07:08:43.959 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.4570000000000002e-06 2024-09-11T07:08:43.959 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625624+0000", 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.736e-05 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625637+0000", 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3193000000000001e-05 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.960 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640799+0000", 2024-09-11T07:08:43.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015161973 2024-09-11T07:08:43.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.961 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.640996+0000", 2024-09-11T07:08:43.961 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000196558 2024-09-11T07:08:43.961 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.961 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.961 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641190+0000", 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019410200000000001 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10051 3.a 3:5211d376:::rbd_data.11614fc4d54f.000000000000000b:6 [read 638976~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28449094999999, 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015997633000000001, 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.962 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10051 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.963 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625678+0000", 2024-09-11T07:08:43.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.964 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.964 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625680+0000", 2024-09-11T07:08:43.964 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1999999999999999e-06 2024-09-11T07:08:43.964 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.964 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625686+0000", 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.3729999999999998e-06 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625703+0000", 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7156999999999999e-05 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.965 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625716+0000", 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3019e-05 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641274+0000", 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015558216999999999 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641474+0000", 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019973500000000001 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.966 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641676+0000", 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020193199999999999 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10053 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 114688~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28443464700001, 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016389154999999999, 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.967 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10053 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.968 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625735+0000", 2024-09-11T07:08:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.969 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625736+0000", 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.046e-06 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625741+0000", 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.5539999999999997e-06 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625758+0000", 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6906e-05 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.970 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625788+0000", 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9893999999999999e-05 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641768+0000", 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.01598022 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.641926+0000", 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000157699 2024-09-11T07:08:43.971 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642124+0000", 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019783600000000001 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10055 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 245760~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.972 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.284362208, 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016888925999999999, 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10055 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.973 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625807+0000", 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625808+0000", 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.31e-06 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.974 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625815+0000", 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.28e-06 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625833+0000", 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7859999999999998e-05 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625846+0000", 2024-09-11T07:08:43.975 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3706000000000001e-05 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642242+0000", 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016395234000000002 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642437+0000", 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019517499999999999 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.976 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642696+0000", 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000259361 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10057 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 376832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28430608799999, 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017341797999999999, 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.977 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10057 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625863+0000", 2024-09-11T07:08:43.978 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625864+0000", 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.08e-06 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625881+0000", 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6863000000000001e-05 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.979 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625899+0000", 2024-09-11T07:08:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8176999999999999e-05 2024-09-11T07:08:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625913+0000", 2024-09-11T07:08:43.980 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3560000000000001e-05 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642825+0000", 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.016912251999999999 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.642988+0000", 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00016312400000000001 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.981 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643205+0000", 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00021674199999999999 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10059 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 507904~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28423262199999, 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017849601999999999, 2024-09-11T07:08:43.982 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10059 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.983 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625937+0000", 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625938+0000", 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3e-06 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625963+0000", 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4995999999999999e-05 2024-09-11T07:08:43.984 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625982+0000", 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8470000000000001e-05 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.625996+0000", 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4083000000000001e-05 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.985 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643319+0000", 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.017323576 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643526+0000", 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00020690199999999999 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.643786+0000", 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00026027500000000002 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.986 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:10061 3.a 3:50a433a7:::rbd_data.11614fc4d54f.000000000000000e:6 [read 638976~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e33)", 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 149.28415422899999, 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018465114000000001, 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 10061 2024-09-11T07:08:43.987 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626015+0000", 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.988 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626016+0000", 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2559999999999999e-06 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626022+0000", 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7869999999999998e-06 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626039+0000", 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7107000000000001e-05 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.989 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.626055+0000", 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5659e-05 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644149+0000", 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.018093796999999998 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644297+0000", 2024-09-11T07:08:43.990 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014829399999999999 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:14.644480+0000", 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018321400000000001 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.991 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_repop(client.4449.0:38457 3.1e e54/21 3:7dfe5400:::rbd_data.11612bf90fc2.0000000000000005:head v 54'77, mlcod=53'75)", 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 125.374978215, 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013149246, 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.992 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535191+0000", 2024-09-11T07:08:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:43.993 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.535193+0000", 2024-09-11T07:08:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5829999999999999e-06 2024-09-11T07:08:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542316+0000", 2024-09-11T07:08:43.994 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0071230349999999998 2024-09-11T07:08:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542336+0000", 2024-09-11T07:08:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.0554e-05 2024-09-11T07:08:43.995 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542345+0000", 2024-09-11T07:08:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1249999999999999e-06 2024-09-11T07:08:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.996 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542422+0000", 2024-09-11T07:08:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6470000000000005e-05 2024-09-11T07:08:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.997 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.542446+0000", 2024-09-11T07:08:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4289000000000001e-05 2024-09-11T07:08:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:43.998 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548236+0000", 2024-09-11T07:08:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00579014 2024-09-11T07:08:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:38.548340+0000", 2024-09-11T07:08:43.999 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010404999999999999 2024-09-11T07:08:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.000 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:74136 3.10 3:0f8bea8f:::rbd_data.1161634664ee.0000000000000008:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e92)", 2024-09-11T07:08:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 78.118392630000002, 2024-09-11T07:08:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015285773000000001, 2024-09-11T07:08:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.001 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 74136 2024-09-11T07:08:44.002 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.003 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791777+0000", 2024-09-11T07:08:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.004 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791778+0000", 2024-09-11T07:08:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.116e-06 2024-09-11T07:08:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.005 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791784+0000", 2024-09-11T07:08:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.1979999999999998e-06 2024-09-11T07:08:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.006 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791800+0000", 2024-09-11T07:08:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5741999999999999e-05 2024-09-11T07:08:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.007 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791811+0000", 2024-09-11T07:08:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.0730999999999999e-05 2024-09-11T07:08:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791856+0000", 2024-09-11T07:08:44.008 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.5351e-05 2024-09-11T07:08:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.791910+0000", 2024-09-11T07:08:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.4184000000000002e-05 2024-09-11T07:08:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.009 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 5", 2024-09-11T07:08:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.793910+0000", 2024-09-11T07:08:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0019997629999999999 2024-09-11T07:08:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:44.010 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806813+0000", 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012902986 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806896+0000", 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3571000000000003e-05 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.806989+0000", 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2431999999999999e-05 2024-09-11T07:08:44.011 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:25.807063+0000", 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.3699e-05 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:81870 3.a 3:51ac9b86:::rbd_data.1161250241b0.000000000000011e:head [delete] snapc 2b=[2b] ondisk+write+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.348398618999994, 2024-09-11T07:08:44.012 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.012548804, 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 81870 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.013 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561771+0000", 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.7599999999999997e-07 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.014 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561774+0000", 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.7470000000000001e-06 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561781+0000", 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.289e-06 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.561788+0000", 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0650000000000004e-06 2024-09-11T07:08:44.015 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566649+0000", 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0048613340000000001 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566725+0000", 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5821000000000005e-05 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.016 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.566945+0000", 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000220328 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.570403+0000", 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0034582620000000001 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574209+0000", 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0038052870000000001 2024-09-11T07:08:44.017 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574284+0000", 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.5023000000000003e-05 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.574320+0000", 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.5972000000000001e-05 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.018 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:82039 3.a 3:568c4585:::rbd_data.11619bb463c4.0000000000000000:2a [read 8765440~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e96)", 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 73.340408724, 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.014278337, 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 82039 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.019 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569761+0000", 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.2499999999999995e-07 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.020 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569764+0000", 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.1499999999999999e-06 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569772+0000", 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.6699999999999994e-06 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.569778+0000", 2024-09-11T07:08:44.021 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.6720000000000001e-06 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578490+0000", 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0087125410000000007 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.578575+0000", 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.4425999999999994e-05 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.022 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:30.584039+0000", 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0054643529999999999 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:109791 3.9 3:95a9296c:::rbd_data.1161dd0f3253.000000000000000a:head [call rbd.sparse_copyup in=16b,set-alloc-hint object_size 8388608 write_size 8388608,truncate 5824422] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 65.181378468000005, 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.029141958999999999, 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.023 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 109791 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.024 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728791+0000", 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.728800+0000", 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.064e-06 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744261+0000", 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.015461523 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.025 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744287+0000", 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.5086999999999999e-05 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744298+0000", 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1899000000000001e-05 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744376+0000", 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7465000000000005e-05 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.026 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.744514+0000", 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013820400000000001 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.745045+0000", 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00053122399999999995 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.751499+0000", 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0064538750000000004 2024-09-11T07:08:44.027 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757772+0000", 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0062726509999999997 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757865+0000", 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.2802999999999999e-05 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:38.757933+0000", 2024-09-11T07:08:44.028 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.8164000000000007e-05 2024-09-11T07:08:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.029 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.029 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:44.031 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:44.031 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:44.025+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:44.054 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-09-11T07:08:44.131 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:44.125+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:44.219 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:44.220 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:44.220 INFO:teuthology.orchestra.run.smithi110.stdout: "num_ops": 0 2024-09-11T07:08:44.220 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:44.232 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:44.226+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:44.235 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:44.333 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:44.330+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:44.403 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:44.403 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:44.403 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:44.417 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:44.461 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:44.457+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:44.535 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:44.529+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 181.470958959, 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.543 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.544 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:08:44.545 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:44.546 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.547 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:08:44.548 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.549 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.04478846399999, 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:08:44.550 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.551 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.552 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.553 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.04473224700001, 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.554 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.555 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:08:44.556 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.557 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:44.558 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.041685086, 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.559 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.560 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.561 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.562 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.041631986, 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:08:44.563 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.564 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.565 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.566 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.04153308100001, 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.567 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.568 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.569 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:08:44.570 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.571 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.04146521300001, 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.572 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.573 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:08:44.574 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:08:44.575 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.041408679, 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:44.577 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:08:44.578 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.579 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.580 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.04135621899999, 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.581 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.582 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.583 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:08:44.584 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.041304591, 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.585 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.586 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.587 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:08:44.588 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.04125316899999, 2024-09-11T07:08:44.589 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.590 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:08:44.591 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.592 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.593 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.041202075, 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:08:44.594 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:44.595 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:08:44.596 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.597 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.04115011499999, 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:08:44.598 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.599 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:08:44.600 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.601 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:08:44.602 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.04105060200001, 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.603 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:44.604 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.605 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.606 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.607 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.040991797, 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.608 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.609 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.610 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.611 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.040940643, 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.612 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.613 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:08:44.614 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:08:44.615 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.04088433699999, 2024-09-11T07:08:44.616 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.617 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:08:44.618 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:08:44.619 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.620 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 140.03408482200001, 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:08:44.621 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.622 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.623 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:08:44.624 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 84.302014796999998, 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:08:44.625 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.626 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:08:44.627 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.628 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:44.629 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.630 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 83.98460575, 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:44.631 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:44.632 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.633 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:08:44.634 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:08:44.635 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:44.636 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:08:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:08:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:44.637 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:44.637 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:44.638 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-09-11T07:08:44.639 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:44.634+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:44.740 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:44.737+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:44.769 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:44.770 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:44.770 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:44.770 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:44.784 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-09-11T07:08:44.841 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:44.837+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:44.906 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:44.906 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:44.906 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:44.906 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:44.906 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:44.920 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-09-11T07:08:44.942 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:44.937+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:45.036 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is set 2024-09-11T07:08:45.040 INFO:tasks.thrashosds.thrasher:in_osds: [1, 2, 3, 5, 6, 7, 0] out_osds: [4] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-09-11T07:08:45.040 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-09-11T07:08:45.040 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-09-11T07:08:45.041 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-09-11T07:08:45.041 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-09-11T07:08:45.041 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6984 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 6979584~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.36721017799999, 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049590166999999997, 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.043 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6984 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.044 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671243+0000", 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671832+0000", 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00058936899999999996 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671837+0000", 2024-09-11T07:08:45.045 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6160000000000004e-06 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671849+0000", 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2191000000000001e-05 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671856+0000", 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7859999999999999e-06 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.046 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720668+0000", 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048811755999999998 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720751+0000", 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3045000000000002e-05 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.720833+0000", 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2404000000000006e-05 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.047 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:6988 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 7962624~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.36647529699999, 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049544367999999998, 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.048 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 6988 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.671978+0000", 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.049 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672897+0000", 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00091962200000000004 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672902+0000", 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0300000000000001e-06 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672916+0000", 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3047999999999999e-05 2024-09-11T07:08:45.050 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.672923+0000", 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8490000000000006e-06 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721384+0000", 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048460955999999999 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721450+0000", 2024-09-11T07:08:45.051 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5646000000000001e-05 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.721522+0000", 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2217000000000003e-05 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7095 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2310144~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:45.052 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.36390932699999, 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049517756000000003, 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7095 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.053 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674544+0000", 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.1399999999999997e-07 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.054 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674547+0000", 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7640000000000001e-06 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674555+0000", 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0020000000000006e-06 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674559+0000", 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.6270000000000002e-06 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.055 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723902+0000", 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049343843999999998 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.723974+0000", 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1790000000000002e-05 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724062+0000", 2024-09-11T07:08:45.056 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7315e-05 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7096 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2424832~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.363889712, 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049692964999999999, 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.057 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7096 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.058 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674563+0000", 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674564+0000", 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6399999999999998e-07 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.059 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674565+0000", 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6959999999999999e-06 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674571+0000", 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2240000000000003e-06 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674576+0000", 2024-09-11T07:08:45.060 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1959999999999999e-06 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724092+0000", 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049515939000000002 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724165+0000", 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2996000000000004e-05 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.061 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724256+0000", 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1650000000000005e-05 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7097 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3063808~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.36386680699999, 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049849982000000001, 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.062 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7097 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674586+0000", 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.063 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674655+0000", 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9014e-05 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674659+0000", 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7249999999999999e-06 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674672+0000", 2024-09-11T07:08:45.064 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2809000000000001e-05 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674686+0000", 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.4100000000000001e-05 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724287+0000", 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049600697999999999 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.065 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724353+0000", 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6420000000000004e-05 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724436+0000", 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3215999999999997e-05 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.066 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7098 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3178496~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.36348804599999, 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049656450999999997, 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7098 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.067 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674965+0000", 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674966+0000", 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3600000000000003e-07 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.068 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674970+0000", 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.856e-06 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674978+0000", 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5769999999999994e-06 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674985+0000", 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8040000000000004e-06 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.069 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724467+0000", 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049482107999999997 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724533+0000", 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6044999999999995e-05 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724622+0000", 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8424999999999994e-05 2024-09-11T07:08:45.070 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7099 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3293184~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.363456544, 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049814599000000001, 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.071 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7099 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.674997+0000", 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.072 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675474+0000", 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000477221 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675479+0000", 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.694e-06 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675491+0000", 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1936000000000001e-05 2024-09-11T07:08:45.073 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675499+0000", 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7279999999999995e-06 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724652+0000", 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049152791000000001 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724722+0000", 2024-09-11T07:08:45.074 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9746999999999995e-05 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724811+0000", 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9481999999999995e-05 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7100 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 3407872~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.36293926900001, 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049490406000000001, 2024-09-11T07:08:45.075 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7100 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.076 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675514+0000", 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675515+0000", 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.75e-07 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675517+0000", 2024-09-11T07:08:45.077 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9340000000000002e-06 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675525+0000", 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4279999999999999e-06 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675531+0000", 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8200000000000002e-06 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.078 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724843+0000", 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049312701 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.724917+0000", 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3184999999999998e-05 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725004+0000", 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7663000000000004e-05 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.079 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7101 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4046848~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.36291514000001, 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049636155000000001, 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7101 2024-09-11T07:08:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.081 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675538+0000", 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.1399999999999998e-07 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675540+0000", 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.9530000000000002e-06 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675545+0000", 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.3030000000000001e-06 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.082 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675547+0000", 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8480000000000001e-06 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725034+0000", 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049486737000000003 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725106+0000", 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1478999999999998e-05 2024-09-11T07:08:45.083 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725174+0000", 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8521000000000003e-05 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7102 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4161536~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.362901814, 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049799610000000001, 2024-09-11T07:08:45.084 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7102 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.085 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675551+0000", 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675872+0000", 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000320484 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675923+0000", 2024-09-11T07:08:45.086 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1406999999999998e-05 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675934+0000", 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0845999999999999e-05 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675943+0000", 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.5890000000000003e-06 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.087 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725206+0000", 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049262940999999998 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725277+0000", 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1575999999999994e-05 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725351+0000", 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3767e-05 2024-09-11T07:08:45.088 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7103 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4276224~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.36248188600001, 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049552005000000003, 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.089 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7103 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675971+0000", 2024-09-11T07:08:45.090 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675972+0000", 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0100000000000004e-07 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675975+0000", 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.501e-06 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.091 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675984+0000", 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3520000000000007e-06 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675990+0000", 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1720000000000004e-06 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725382+0000", 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049391676000000002 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.092 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725458+0000", 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.6044999999999994e-05 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725523+0000", 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5557999999999998e-05 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.093 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7104 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 4390912~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.362454477, 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.049691791999999999, 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7104 2024-09-11T07:08:45.094 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.675999+0000", 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.095 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676614+0000", 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00061524099999999999 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676619+0000", 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6030000000000004e-06 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676632+0000", 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.2951e-05 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.096 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.676640+0000", 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9279999999999993e-06 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725552+0000", 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.048911340999999997 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725623+0000", 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.1546999999999998e-05 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.097 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.725690+0000", 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7181000000000006e-05 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:7221 3.12 3:4830328f:::rbd_data.1161d159867d.0000000000000000:5 [read 2211840~16384] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30)", 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:45.098 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 154.35657534500001, 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.051451182999999998, 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 7221 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.099 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681878+0000", 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.5499999999999998e-07 2024-09-11T07:08:45.100 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681881+0000", 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5210000000000001e-06 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681887+0000", 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5899999999999996e-06 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.681892+0000", 2024-09-11T07:08:45.101 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9110000000000001e-06 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729702+0000", 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.047809873000000003 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.729766+0000", 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4022000000000005e-05 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.102 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:10.733329+0000", 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0035628109999999999 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45397 3.17 3:e8915edd:::rbd_data.11612691d6cf.000000000000006d:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 118.598698012, 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7320030819999999, 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:45.103 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45397 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.104 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439755+0000", 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439756+0000", 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.9899999999999999e-07 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439765+0000", 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2220000000000008e-06 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.105 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439775+0000", 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.2879999999999998e-06 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439780+0000", 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7919999999999998e-06 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439836+0000", 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5720999999999997e-05 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.106 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439846+0000", 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.9450000000000005e-06 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145490+0000", 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70564385100000004 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145519+0000", 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9679000000000002e-05 2024-09-11T07:08:45.107 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169163+0000", 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.023643611 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169348+0000", 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000184496 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:45.108 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.169481+0000", 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013351300000000001 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171176+0000", 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001695357 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171532+0000", 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00035505699999999999 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.109 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171620+0000", 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.8250000000000004e-05 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171758+0000", 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00013840099999999999 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:45398 3.17 3:ee660cd5:::rbd_data.11612691d6cf.000000000000006e:head [set-alloc-hint object_size 1048576 write_size 1048576,write 974848~8192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-09-11T07:08:45.110 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 118.598524199, 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.732152524, 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 45398 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.111 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439929+0000", 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439930+0000", 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.1399999999999995e-07 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.112 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439941+0000", 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0886e-05 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439952+0000", 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1413999999999999e-05 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.439960+0000", 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.7549999999999994e-06 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.113 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440015+0000", 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4710999999999998e-05 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:46.440024+0000", 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.0469999999999999e-06 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145590+0000", 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.70556594699999997 2024-09-11T07:08:45.114 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:47.145611+0000", 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.1384999999999999e-05 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170263+0000", 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0246516409999999 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170382+0000", 2024-09-11T07:08:45.115 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000118899 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 2", 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.170591+0000", 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00020932899999999999 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171452+0000", 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00086127399999999998 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.116 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171933+0000", 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048124600000000001 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.171978+0000", 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.4753999999999999e-05 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.172081+0000", 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000103322 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.117 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118076 3.1b 3.403f121b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:07.010262+0000", 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.028190756000001, 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.019655347, 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.118 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118076 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010262+0000", 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010262+0000", 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.119 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010266+0000", 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.3900000000000002e-06 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010282+0000", 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6008e-05 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010316+0000", 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4051000000000003e-05 2024-09-11T07:08:45.120 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010333+0000", 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.677e-05 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022541+0000", 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012208627999999999 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022552+0000", 2024-09-11T07:08:45.121 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1236999999999999e-05 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.029891+0000", 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0073384359999999 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.029918+0000", 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6826999999999999e-05 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.122 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118077 3.1b 3.403f121b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 38.028074388999997, 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.0196433760000001, 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118077 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.123 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010379+0000", 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.61e-07 2024-09-11T07:08:45.124 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010385+0000", 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3460000000000001e-06 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010395+0000", 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.6909999999999992e-06 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.010401+0000", 2024-09-11T07:08:45.125 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.1709999999999999e-06 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022589+0000", 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.012188723 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.022595+0000", 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9240000000000004e-06 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.029994+0000", 2024-09-11T07:08:45.126 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.007398268 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.030022+0000", 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8492000000000001e-05 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118078 3.1b 3.403f121b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:07.365636+0000", 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 37.672816715000003, 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.66451633499999996, 2024-09-11T07:08:45.127 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118078 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365636+0000", 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.128 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365636+0000", 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365640+0000", 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.7069999999999998e-06 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.129 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365657+0000", 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6733000000000001e-05 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365697+0000", 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.9842000000000002e-05 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365720+0000", 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3693000000000002e-05 2024-09-11T07:08:45.130 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365918+0000", 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00019730400000000001 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:07.365935+0000", 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.7422e-05 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.030136+0000", 2024-09-11T07:08:45.131 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.66420112099999995 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:08.030153+0000", 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6512999999999999e-05 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:118458 3.3 3:c4c92e5a:::rbd_trash:head [call rbd.trash_add in=12b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:12.168315+0000", 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 32.870138480999998, 2024-09-11T07:08:45.132 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.93473760699999997, 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 118458 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168315+0000", 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.133 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168315+0000", 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168316+0000", 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.5999999999999991e-07 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.134 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168321+0000", 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3360000000000002e-06 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168332+0000", 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1009000000000001e-05 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168338+0000", 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.84e-06 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.135 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168390+0000", 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.2210000000000003e-05 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:12.168397+0000", 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.0029999999999997e-06 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.098752+0000", 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.93035478800000004 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.136 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.099116+0000", 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00036387600000000001 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for subops from 6", 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.099603+0000", 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00048711099999999998 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "op_commit", 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.101758+0000", 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.0021549260000000002 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.137 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.102794+0000", 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.001036702 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "commit_sent", 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.102943+0000", 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014871599999999999 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:13.103052+0000", 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00010912999999999999 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.138 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:119510 3.17 3:ed1c1937:::journal.11617431ac27:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e141)", 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:08:21.025014+0000", 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 24.013439195, 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.83167153699999996, 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "reached pg", 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.139 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 119510 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025014+0000", 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025014+0000", 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.140 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025016+0000", 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2000000000000001e-06 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025026+0000", 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.03e-05 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025056+0000", 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.9382000000000001e-05 2024-09-11T07:08:45.141 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025078+0000", 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2076e-05 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025179+0000", 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.000100757 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "waiting for peered", 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.025188+0000", 2024-09-11T07:08:45.142 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7340000000000003e-06 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.856537+0000", 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.83134908100000005 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:08:21.856685+0000", 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.00014800699999999999 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.143 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.144 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:45.144 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:45.037+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:45.145 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:45.137+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:45.146 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-09-11T07:08:45.183 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:45.183 INFO:teuthology.orchestra.run.smithi110.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-09-11T07:08:45.184 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:45.246 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:45.242+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:45.322 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:45.322 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:45.322 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:45.322 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:45.336 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-09-11T07:08:45.347 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:45.341+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:45.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:45.442+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:45.496 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:45.496 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:45.496 INFO:teuthology.orchestra.run.smithi079.stdout: "complaint_time": 30, 2024-09-11T07:08:45.496 INFO:teuthology.orchestra.run.smithi079.stdout: "num_blocked_ops": 0 2024-09-11T07:08:45.496 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:45.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-09-11T07:08:45.549 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:45.545+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:45.650 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:45.645+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:45.674 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:45.674 INFO:teuthology.orchestra.run.smithi079.stdout: "size": 20, 2024-09-11T07:08:45.674 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 600, 2024-09-11T07:08:45.674 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [ 2024-09-11T07:08:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46274 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5447680~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33825553600001, 2024-09-11T07:08:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042635002999999998, 2024-09-11T07:08:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.675 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46274 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.676 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331642+0000", 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9800000000000004e-07 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331645+0000", 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3520000000000001e-06 2024-09-11T07:08:45.677 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331652+0000", 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4159999999999998e-06 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331659+0000", 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2710000000000003e-06 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.678 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374165+0000", 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042505493999999998 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374214+0000", 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8826999999999999e-05 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374277+0000", 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3145000000000006e-05 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.679 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46275 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5496832~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33823057399999, 2024-09-11T07:08:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042748189999999998, 2024-09-11T07:08:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.680 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46275 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.681 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331667+0000", 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331669+0000", 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2900000000000001e-06 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.682 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331686+0000", 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.6767999999999999e-05 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331693+0000", 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6599999999999998e-06 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.683 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374308+0000", 2024-09-11T07:08:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042614919000000001 2024-09-11T07:08:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374355+0000", 2024-09-11T07:08:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7166000000000002e-05 2024-09-11T07:08:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.684 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374415+0000", 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9893999999999999e-05 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46276 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5545984~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33819614799999, 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042856001999999997, 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.685 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46276 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.686 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331701+0000", 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331702+0000", 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331704+0000", 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.5629999999999999e-06 2024-09-11T07:08:45.687 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331712+0000", 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9340000000000006e-06 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331720+0000", 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.1049999999999995e-06 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.688 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374445+0000", 2024-09-11T07:08:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042724597000000003 2024-09-11T07:08:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374494+0000", 2024-09-11T07:08:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9234999999999999e-05 2024-09-11T07:08:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.689 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374557+0000", 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3058000000000005e-05 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46277 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5595136~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.338145803, 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042946033000000002, 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.690 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46277 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.691 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331751+0000", 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331752+0000", 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2500000000000005e-07 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331755+0000", 2024-09-11T07:08:45.692 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7e-06 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331763+0000", 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.2470000000000008e-06 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331777+0000", 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.3749e-05 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.693 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374591+0000", 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042813898000000003 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374637+0000", 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.6492000000000001e-05 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374697+0000", 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0222e-05 2024-09-11T07:08:45.694 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46278 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5644288~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33811112399999, 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043078449999999997, 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46278 2024-09-11T07:08:45.695 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331786+0000", 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.696 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331787+0000", 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.9299999999999997e-07 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331789+0000", 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.559e-06 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331797+0000", 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.8140000000000001e-06 2024-09-11T07:08:45.697 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331804+0000", 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3010000000000001e-06 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374743+0000", 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042938538999999998 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.698 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374800+0000", 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6637e-05 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374865+0000", 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4906999999999994e-05 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.699 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46279 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5693440~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33808523800001, 2024-09-11T07:08:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043192304000000001, 2024-09-11T07:08:45.700 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.701 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46279 2024-09-11T07:08:45.702 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.702 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.702 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.702 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.702 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:45.703 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.704 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.704 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.704 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331812+0000", 2024-09-11T07:08:45.704 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.1500000000000005e-07 2024-09-11T07:08:45.704 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.705 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.705 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.705 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331815+0000", 2024-09-11T07:08:45.706 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4080000000000001e-06 2024-09-11T07:08:45.706 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.706 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.706 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.706 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331822+0000", 2024-09-11T07:08:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3359999999999997e-06 2024-09-11T07:08:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331831+0000", 2024-09-11T07:08:45.707 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.4530000000000002e-06 2024-09-11T07:08:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374897+0000", 2024-09-11T07:08:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043066213999999998 2024-09-11T07:08:45.708 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.374944+0000", 2024-09-11T07:08:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.7292000000000001e-05 2024-09-11T07:08:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.709 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.710 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.710 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375004+0000", 2024-09-11T07:08:45.710 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0086e-05 2024-09-11T07:08:45.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.710 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.710 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46280 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5742592~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33805511, 2024-09-11T07:08:45.711 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043330417000000003, 2024-09-11T07:08:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.712 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46280 2024-09-11T07:08:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:45.714 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.714 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.714 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.714 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.714 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331842+0000", 2024-09-11T07:08:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331843+0000", 2024-09-11T07:08:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9299999999999998e-07 2024-09-11T07:08:45.715 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.716 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.716 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.716 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331848+0000", 2024-09-11T07:08:45.716 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5570000000000003e-06 2024-09-11T07:08:45.716 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331857+0000", 2024-09-11T07:08:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6689999999999995e-06 2024-09-11T07:08:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.717 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331863+0000", 2024-09-11T07:08:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0610000000000001e-06 2024-09-11T07:08:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.718 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375049+0000", 2024-09-11T07:08:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043186443999999997 2024-09-11T07:08:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375104+0000", 2024-09-11T07:08:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4821999999999998e-05 2024-09-11T07:08:45.719 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375172+0000", 2024-09-11T07:08:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.8371e-05 2024-09-11T07:08:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.720 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46281 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5791744~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.338026848, 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043441781999999998, 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.721 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46281 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331870+0000", 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.722 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331871+0000", 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9900000000000001e-07 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331873+0000", 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.458e-06 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331885+0000", 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1919999999999999e-05 2024-09-11T07:08:45.723 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331891+0000", 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0950000000000001e-06 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375205+0000", 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043314084000000003 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.724 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375253+0000", 2024-09-11T07:08:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8047000000000003e-05 2024-09-11T07:08:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375312+0000", 2024-09-11T07:08:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8678999999999998e-05 2024-09-11T07:08:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.725 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46282 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5840896~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33794973400001, 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043532266999999999, 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.726 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46282 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331947+0000", 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.727 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331948+0000", 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.7199999999999997e-07 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331952+0000", 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.4479999999999999e-06 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331962+0000", 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.7389999999999994e-06 2024-09-11T07:08:45.728 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331968+0000", 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6789999999999999e-06 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375357+0000", 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043388559 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375413+0000", 2024-09-11T07:08:45.729 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5971999999999999e-05 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375480+0000", 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6997999999999998e-05 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46283 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5890048~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:45.730 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.337914794, 2024-09-11T07:08:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043635858999999999, 2024-09-11T07:08:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46283 2024-09-11T07:08:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.731 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331982+0000", 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.732 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331983+0000", 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3799999999999997e-07 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331985+0000", 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4990000000000001e-06 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.331993+0000", 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.9629999999999998e-06 2024-09-11T07:08:45.733 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332003+0000", 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 9.8199999999999992e-06 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375512+0000", 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043508865000000001 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.734 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375560+0000", 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8004999999999999e-05 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375618+0000", 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8168999999999998e-05 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.735 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46284 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5939200~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.337886407, 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043772483000000001, 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46284 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.736 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332011+0000", 2024-09-11T07:08:45.737 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0699999999999997e-07 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332014+0000", 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4619999999999999e-06 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332021+0000", 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5650000000000004e-06 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.738 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332029+0000", 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.2099999999999996e-06 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375663+0000", 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043634233000000001 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375717+0000", 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4209000000000002e-05 2024-09-11T07:08:45.739 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375783+0000", 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.6297000000000006e-05 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46285 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 5988352~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.337859966, 2024-09-11T07:08:45.740 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043885753, 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46285 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:45.741 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332037+0000", 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332038+0000", 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.2500000000000005e-07 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.742 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332040+0000", 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.542e-06 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332048+0000", 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.5830000000000001e-06 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332054+0000", 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0340000000000002e-06 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.743 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375817+0000", 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043762574999999998 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375865+0000", 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8637000000000002e-05 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.744 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375923+0000", 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.7757000000000003e-05 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46286 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6037504~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.337835779, 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044027821000000002, 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.745 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46286 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.746 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332061+0000", 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332062+0000", 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332064+0000", 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.2740000000000002e-06 2024-09-11T07:08:45.747 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332073+0000", 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.6719999999999993e-06 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332079+0000", 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8579999999999996e-06 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.375967+0000", 2024-09-11T07:08:45.748 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043888476000000003 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376022+0000", 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.4208e-05 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376089+0000", 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7688000000000007e-05 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.749 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46287 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6086656~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33778577699999, 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044117732999999999, 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.750 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46287 2024-09-11T07:08:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.751 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332111+0000", 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332112+0000", 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4499999999999997e-07 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.752 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332115+0000", 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.6680000000000001e-06 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332123+0000", 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.3110000000000006e-06 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332129+0000", 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.4230000000000002e-06 2024-09-11T07:08:45.753 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376121+0000", 2024-09-11T07:08:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.043991816000000003 2024-09-11T07:08:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.754 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376171+0000", 2024-09-11T07:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9540999999999999e-05 2024-09-11T07:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376229+0000", 2024-09-11T07:08:45.755 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8328999999999997e-05 2024-09-11T07:08:45.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.756 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.756 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.756 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.756 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46288 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6135808~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33775942299999, 2024-09-11T07:08:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044260648, 2024-09-11T07:08:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.757 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.758 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.758 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.758 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46288 2024-09-11T07:08:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:45.759 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.760 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.760 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.760 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.760 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:45.760 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332138+0000", 2024-09-11T07:08:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.7000000000000004e-07 2024-09-11T07:08:45.761 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.762 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.762 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.762 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332141+0000", 2024-09-11T07:08:45.762 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4449999999999999e-06 2024-09-11T07:08:45.762 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332153+0000", 2024-09-11T07:08:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1772e-05 2024-09-11T07:08:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.763 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.764 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.764 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332159+0000", 2024-09-11T07:08:45.764 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0669999999999997e-06 2024-09-11T07:08:45.764 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.764 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376274+0000", 2024-09-11T07:08:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044115170000000002 2024-09-11T07:08:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.765 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376333+0000", 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9017000000000001e-05 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376398+0000", 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.5506999999999995e-05 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46289 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6184960~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.766 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33771605, 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044357445000000002, 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46289 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:45.767 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332181+0000", 2024-09-11T07:08:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.768 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332182+0000", 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3200000000000005e-07 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332184+0000", 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.723e-06 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332192+0000", 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 8.0870000000000007e-06 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.769 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332200+0000", 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.3170000000000004e-06 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376431+0000", 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044230923999999998 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376479+0000", 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.8072999999999999e-05 2024-09-11T07:08:45.770 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376539+0000", 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9789e-05 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46290 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6234112~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:45.771 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.337689442, 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044494765999999998, 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46290 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.772 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332208+0000", 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0100000000000005e-07 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.773 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332211+0000", 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4099999999999998e-06 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332222+0000", 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1443999999999999e-05 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332228+0000", 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.9950000000000002e-06 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.774 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376583+0000", 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044355252999999997 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376639+0000", 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.5278000000000002e-05 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376703+0000", 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.3885000000000002e-05 2024-09-11T07:08:45.775 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46291 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 6283264~8192] snapc 0=[] RETRY=2 ondisk+retry+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.33766113999999, 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044598027999999998, 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.776 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46291 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.777 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332236+0000", 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332237+0000", 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.0999999999999999e-07 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332239+0000", 2024-09-11T07:08:45.778 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.4399999999999999e-06 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332246+0000", 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 7.4970000000000004e-06 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.332253+0000", 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 6.0379999999999996e-06 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.779 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376728+0000", 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.044475317 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376777+0000", 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 4.9475999999999999e-05 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.376834+0000", 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.6749999999999997e-05 2024-09-11T07:08:45.780 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46955 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9379840~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.121735946, 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042646256, 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.781 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46955 2024-09-11T07:08:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.782 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:45.783 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548161+0000", 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.3099999999999999e-07 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548163+0000", 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.127e-06 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.784 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548166+0000", 2024-09-11T07:08:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.179e-06 2024-09-11T07:08:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548169+0000", 2024-09-11T07:08:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.8609999999999998e-06 2024-09-11T07:08:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.785 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590717+0000", 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042547883000000002 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590754+0000", 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.765e-05 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590808+0000", 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.3325000000000002e-05 2024-09-11T07:08:45.786 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "description": "osd_op(client.4449.0:46956 3.4 3:21f79498:::rbd_data.1161c6a23e4b.0000000000000001:1b [read 9428992~8192] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e64)", 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "initiated_at": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "age": 117.12172468200001, 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042772421999999997, 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "continuous": false, 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "type_data": { 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "flag_point": "started", 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "client_info": { 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "client": "client.4449", 2024-09-11T07:08:45.787 INFO:teuthology.orchestra.run.smithi079.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "tid": 46956 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "events": [ 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "initiated", 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "header_read", 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.788 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "throttled", 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548173+0000", 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.17e-07 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "all_read", 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548174+0000", 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 1.1790000000000001e-06 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "dispatched", 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548177+0000", 2024-09-11T07:08:45.789 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 3.2119999999999999e-06 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "queued_for_pg", 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.548180+0000", 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 2.7369999999999998e-06 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "reached_pg", 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590827+0000", 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 0.042647353999999998 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "started", 2024-09-11T07:08:45.790 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590886+0000", 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8968999999999997e-05 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: { 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: "event": "done", 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: "time": "2024-09-11T07:06:48.590945+0000", 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: "duration": 5.8754e-05 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: } 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout: ] 2024-09-11T07:08:45.791 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:45.793 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-09-11T07:08:45.793 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:45.790+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:45.817 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-09-11T07:08:45.893 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:45.890+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:45.968 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:08:45.969 INFO:teuthology.orchestra.run.smithi079.stdout: "ops": [], 2024-09-11T07:08:45.969 INFO:teuthology.orchestra.run.smithi079.stdout: "num_ops": 0 2024-09-11T07:08:45.969 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:08:45.980 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:45.981 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:45.982 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-09-11T07:08:45.994 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:45.989+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:45.997 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:45.997 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:46.014 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:46.014 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:46.032 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:46.032 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:46.055 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:46.055 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:46.079 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:46.079 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:46.094 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-09-11T07:08:46.089+0000 7fb451436640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 26480) UID: 0 2024-09-11T07:08:46.100 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:46.100 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:46.118 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:46.119 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:46.124 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:46.124 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:46.134 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-09-11T07:08:46.196 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:46.189+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:46.296 INFO:tasks.ceph.osd.2.smithi079.stderr:2024-09-11T07:08:46.290+0000 7f8ebd299640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 26416) UID: 0 2024-09-11T07:08:46.309 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:46.310 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:46.324 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-09-11T07:08:46.398 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:46.393+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:46.488 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:46.488 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:46.498 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:46.493+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:46.502 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-09-11T07:08:46.599 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:46.594+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:46.624 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:46.625 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:46.639 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-09-11T07:08:46.700 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:46.693+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:46.797 INFO:teuthology.orchestra.run.smithi079.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:46.797 INFO:teuthology.orchestra.run.smithi079.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:46.801 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:46.793+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:46.815 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-09-11T07:08:46.901 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:46.898+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:46.946 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:46.947 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:46.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-09-11T07:08:47.005 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:47.001+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:47.084 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:47.085 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:47.103 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:47.097+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:47.105 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-09-11T07:08:47.148 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-09-11T07:08:47.205 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:47.198+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:47.262 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:47.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-09-11T07:08:47.305 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:47.302+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:47.401 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:47.401 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:47.406 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-09-11T07:08:47.401+0000 7f5140dfa640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 26487) UID: 0 2024-09-11T07:08:47.415 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-09-11T07:08:47.507 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:47.501+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:47.581 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:47.581 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:47.595 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-09-11T07:08:47.638 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:47.633+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:47.710 INFO:tasks.ceph.osd.0.smithi079.stderr:2024-09-11T07:08:47.706+0000 7f56e8165640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 26411) UID: 0 2024-09-11T07:08:47.762 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:47.763 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:47.777 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-09-11T07:08:47.822 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:47.817+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:47.894 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:47.894 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:47.908 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-09-11T07:08:47.911 INFO:tasks.ceph.osd.1.smithi079.stderr:2024-09-11T07:08:47.906+0000 7f1c0a551640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 26414) UID: 0 2024-09-11T07:08:48.012 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-09-11T07:08:48.005+0000 7fe3eaeeb640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 26483) UID: 0 2024-09-11T07:08:48.067 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is set 2024-09-11T07:08:48.075 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:48.075 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:48.093 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-09-11T07:08:48.138 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-09-11T07:08:48.133+0000 7fd94dd28640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 26485) UID: 0 2024-09-11T07:08:48.145 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-09-11T07:08:48.214 INFO:tasks.ceph.osd.3.smithi079.stderr:2024-09-11T07:08:48.210+0000 7fcd45d9d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 26418) UID: 0 2024-09-11T07:08:48.229 INFO:teuthology.orchestra.run.smithi079.stdout:All operations completed A-OK! 2024-09-11T07:08:48.270 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:48.270 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:48.284 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-09-11T07:08:48.304 INFO:teuthology.orchestra.run.smithi079.stdout:osd.0: {} 2024-09-11T07:08:48.304 INFO:teuthology.orchestra.run.smithi079.stderr:osd.0: osd_enable_op_tracker = '' 2024-09-11T07:08:48.308 DEBUG:teuthology.parallel:result is None 2024-09-11T07:08:48.308 DEBUG:teuthology.run_tasks:Unwinding manager rbd_fsx 2024-09-11T07:08:48.317 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-09-11T07:08:48.346 INFO:tasks.thrashosds:joining thrashosds 2024-09-11T07:08:48.346 INFO:teuthology.orchestra.run.smithi079.stdout:osd.1: {} 2024-09-11T07:08:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:osd.1: osd_enable_op_tracker = '' 2024-09-11T07:08:48.347 INFO:teuthology.orchestra.run.smithi079.stdout:osd.2: {} 2024-09-11T07:08:48.347 INFO:teuthology.orchestra.run.smithi079.stderr:osd.2: osd_enable_op_tracker = '' 2024-09-11T07:08:48.353 INFO:teuthology.orchestra.run.smithi079.stdout:osd.3: {} 2024-09-11T07:08:48.353 INFO:teuthology.orchestra.run.smithi079.stderr:osd.3: osd_enable_op_tracker = '' 2024-09-11T07:08:48.372 INFO:teuthology.orchestra.run.smithi079.stdout:osd.4: {} 2024-09-11T07:08:48.372 INFO:teuthology.orchestra.run.smithi079.stderr:osd.4: osd_enable_op_tracker = '' 2024-09-11T07:08:48.389 INFO:teuthology.orchestra.run.smithi079.stdout:osd.5: {} 2024-09-11T07:08:48.389 INFO:teuthology.orchestra.run.smithi079.stderr:osd.5: osd_enable_op_tracker = '' 2024-09-11T07:08:48.407 INFO:teuthology.orchestra.run.smithi079.stdout:osd.6: {} 2024-09-11T07:08:48.408 INFO:teuthology.orchestra.run.smithi079.stderr:osd.6: osd_enable_op_tracker = '' 2024-09-11T07:08:48.408 INFO:teuthology.orchestra.run.smithi110.stdout:ERROR: (22) Invalid argument 2024-09-11T07:08:48.408 INFO:teuthology.orchestra.run.smithi110.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-09-11T07:08:48.422 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-09-11T07:08:48.426 INFO:teuthology.orchestra.run.smithi079.stdout:osd.7: {} 2024-09-11T07:08:48.426 INFO:teuthology.orchestra.run.smithi079.stderr:osd.7: osd_enable_op_tracker = '' 2024-09-11T07:08:48.538 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [], 2024-09-11T07:08:48.538 INFO:teuthology.orchestra.run.smithi110.stdout: "complaint_time": 30, 2024-09-11T07:08:48.539 INFO:teuthology.orchestra.run.smithi110.stdout: "num_blocked_ops": 0 2024-09-11T07:08:48.539 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:48.552 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-09-11T07:08:48.675 INFO:teuthology.orchestra.run.smithi110.stdout:{ 2024-09-11T07:08:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "size": 20, 2024-09-11T07:08:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 600, 2024-09-11T07:08:48.675 INFO:teuthology.orchestra.run.smithi110.stdout: "ops": [ 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4169.0:1 1.0 1:30306672:devicehealth::main.db.0000000000000000:head [create,setxattr striper.version (16) in=15b,setxattr striper.excl in=12b,setxattr striper.size (16) in=12b,setxattr striper.allocated (16) in=17b,setxattr striper.layout.stripe_unit (16) in=26b,setxattr striper.layout.stripe_count (16) in=27b,setxattr striper.layout.object_size (16) in=26b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 185.60433886000001, 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.71922836700000004, 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4169", 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/732520181", 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 1 2024-09-11T07:08:48.676 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068309+0000", 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.677 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068312+0000", 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.4700000000000001e-06 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068325+0000", 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3417e-05 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068347+0000", 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.1523e-05 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.678 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068365+0000", 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7907e-05 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068499+0000", 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013395200000000001 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for peered", 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.068516+0000", 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6759999999999999e-05 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.679 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.783798+0000", 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.715282894 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784173+0000", 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000374373 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 0", 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.784519+0000", 2024-09-11T07:08:48.680 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00034599799999999998 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.785742+0000", 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0012230469999999999 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787369+0000", 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.0016272770000000001 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.681 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787467+0000", 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.7752999999999997e-05 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:05:43.787538+0000", 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.0995999999999996e-05 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26130 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 245760~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.682 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.178168365, 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058718671, 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26130 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:48.683 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494480+0000", 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494481+0000", 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.297e-06 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494487+0000", 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0100000000000001e-06 2024-09-11T07:08:48.684 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494505+0000", 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8076000000000001e-05 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494519+0000", 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3404000000000001e-05 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.552837+0000", 2024-09-11T07:08:48.685 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058318056 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553013+0000", 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000176236 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553199+0000", 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00018559199999999999 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.686 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26131 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 258048~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.178112148, 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058957250000000003, 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26131 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.687 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494536+0000", 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494537+0000", 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.15e-06 2024-09-11T07:08:48.688 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494543+0000", 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7400000000000001e-06 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494560+0000", 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.7076e-05 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.689 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.494574+0000", 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.344e-05 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553248+0000", 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058674716000000002 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553367+0000", 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000118255 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.690 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.553493+0000", 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000126873 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26246 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 100352~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17506498700001, 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058669076000000001, 2024-09-11T07:08:48.691 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26246 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.692 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497583+0000", 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497585+0000", 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3319999999999999e-06 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497590+0000", 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.091e-06 2024-09-11T07:08:48.693 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497606+0000", 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5914e-05 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497618+0000", 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556060+0000", 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058441911999999999 2024-09-11T07:08:48.694 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556139+0000", 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.8944999999999997e-05 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556252+0000", 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113542 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26247 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 112640~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.695 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17501188700001, 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058848589, 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26247 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:48.696 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497636+0000", 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497637+0000", 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.006e-06 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497642+0000", 2024-09-11T07:08:48.697 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.7770000000000002e-06 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497657+0000", 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5234e-05 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497672+0000", 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4049000000000001e-05 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.698 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556286+0000", 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058614231000000003 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556369+0000", 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3240999999999998e-05 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556485+0000", 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000116051 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.699 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26248 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 124928~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.174912982, 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059009997000000002, 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26248 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.700 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497735+0000", 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497737+0000", 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.609e-06 2024-09-11T07:08:48.701 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497743+0000", 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0569999999999998e-06 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497761+0000", 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8304999999999998e-05 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497775+0000", 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3662999999999999e-05 2024-09-11T07:08:48.702 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556532+0000", 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058757363 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556618+0000", 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.5551999999999997e-05 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556745+0000", 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000127448 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.703 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26249 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 137216~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17484511399999, 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059166199000000003, 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.704 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26249 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497803+0000", 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.705 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497805+0000", 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.46e-06 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497811+0000", 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.0599999999999996e-06 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497827+0000", 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6606e-05 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.706 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497841+0000", 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3444999999999999e-05 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556777+0000", 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058936304000000002 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556868+0000", 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.0419000000000003e-05 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.707 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.556969+0000", 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00010190499999999999 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26250 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 149504~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17478858000001, 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059494462999999997, 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.708 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26250 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497860+0000", 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.709 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497861+0000", 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.074e-06 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497866+0000", 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1290000000000004e-06 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497882+0000", 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6161999999999999e-05 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.710 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497895+0000", 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2768999999999999e-05 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557011+0000", 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.05911657 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557095+0000", 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.3165999999999996e-05 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.711 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557354+0000", 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00025959300000000002 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26251 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 161792~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17473612000001, 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059754808999999999, 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.712 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26251 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.713 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497912+0000", 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497913+0000", 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2049999999999999e-06 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497918+0000", 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.9339999999999997e-06 2024-09-11T07:08:48.714 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497933+0000", 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4986e-05 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497946+0000", 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.234e-05 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557396+0000", 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059450731 2024-09-11T07:08:48.715 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557521+0000", 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00012480600000000001 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557667+0000", 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014580699999999999 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.716 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26252 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 174080~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17468449200001, 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059956941999999999, 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.717 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26252 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497964+0000", 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.718 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497965+0000", 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2139999999999999e-06 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497970+0000", 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0969999999999996e-06 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497987+0000", 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6334e-05 2024-09-11T07:08:48.719 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.497999+0000", 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2734e-05 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557710+0000", 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059710510000000001 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.720 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557805+0000", 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5177e-05 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557921+0000", 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000115876 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.721 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26253 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 186368~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17463307, 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060152534000000001, 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26253 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.722 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498015+0000", 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498016+0000", 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.186e-06 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.723 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498022+0000", 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.1939999999999997e-06 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498038+0000", 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6163000000000001e-05 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498051+0000", 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.312e-05 2024-09-11T07:08:48.724 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.557957+0000", 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.059906062000000003 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558057+0000", 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000100456 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558168+0000", 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00011035300000000001 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.725 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26254 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 198656~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17458197600001, 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060447009000000003, 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26254 2024-09-11T07:08:48.726 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498066+0000", 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498068+0000", 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:48.727 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498073+0000", 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.8799999999999999e-06 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498089+0000", 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6268000000000001e-05 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498101+0000", 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2071e-05 2024-09-11T07:08:48.728 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558235+0000", 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060134418000000002 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558374+0000", 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013904600000000001 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.729 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558513+0000", 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013898 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26255 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 210944~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17453001600001, 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060723786000000002, 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.730 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26255 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498118+0000", 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.731 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498119+0000", 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.077e-06 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498124+0000", 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.0509999999999996e-06 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.732 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498140+0000", 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5965999999999999e-05 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498153+0000", 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2999999999999999e-05 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558567+0000", 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060413372 2024-09-11T07:08:48.733 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558697+0000", 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000130183 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558842+0000", 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014513699999999999 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.734 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26256 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 223232~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.174430503, 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060874494000000001, 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26256 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.735 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498218+0000", 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498219+0000", 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.486e-06 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.736 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498225+0000", 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 6.071e-06 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498244+0000", 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8603000000000001e-05 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498258+0000", 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4246e-05 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.737 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558883+0000", 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060624834000000002 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.558979+0000", 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.5452999999999996e-05 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559092+0000", 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000113801 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.738 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26257 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 235520~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17437169799999, 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061136762999999997, 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26257 2024-09-11T07:08:48.739 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498277+0000", 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.740 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498278+0000", 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4980000000000001e-06 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498283+0000", 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 4.977e-06 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498299+0000", 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6025e-05 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.741 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498311+0000", 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.2006e-05 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559128+0000", 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.060817076999999997 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559219+0000", 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.1101999999999996e-05 2024-09-11T07:08:48.742 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559413+0000", 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00019407800000000001 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26258 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 247808~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17432054400001, 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061301580000000001, 2024-09-11T07:08:48.743 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26258 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.744 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498328+0000", 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498329+0000", 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1829999999999999e-06 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498335+0000", 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.8459999999999996e-06 2024-09-11T07:08:48.745 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498350+0000", 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5102999999999999e-05 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498366+0000", 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.6558999999999998e-05 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559451+0000", 2024-09-11T07:08:48.746 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061084919000000001 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559533+0000", 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.1814e-05 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559629+0000", 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.6156000000000006e-05 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.747 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26259 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 260096~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.17426423800001, 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061508168000000002, 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26259 2024-09-11T07:08:48.748 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498384+0000", 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.749 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498385+0000", 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.311e-06 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498391+0000", 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.7570000000000001e-06 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498410+0000", 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.8326e-05 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.750 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.498423+0000", 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3148e-05 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559662+0000", 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061239684000000003 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559772+0000", 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000109609 2024-09-11T07:08:48.751 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.559892+0000", 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120333 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:26383 3.f 3:f1c597b9:::rbd_data.1161cd812748.0000000000000006:d [read 212992~2048] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e41)", 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 144.16746472299999, 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.058677396999999999, 2024-09-11T07:08:48.752 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "started", 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 26383 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.753 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505184+0000", 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505185+0000", 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.3459999999999999e-06 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505190+0000", 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 5.3029999999999999e-06 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.754 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505225+0000", 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.4968000000000001e-05 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.505860+0000", 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00063477 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563646+0000", 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.057786392999999998 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.755 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563740+0000", 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 9.3848e-05 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:06:24.563861+0000", 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000120769 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.756 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:71966 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.435394697999996, 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.061264696, 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 71966 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.757 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237254+0000", 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237256+0000", 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.3700000000000002e-06 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.758 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237268+0000", 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1970000000000001e-05 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237297+0000", 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.9309e-05 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237312+0000", 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.4739999999999999e-05 2024-09-11T07:08:48.759 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237414+0000", 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000101895 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.237555+0000", 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00014127500000000001 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.249163+0000", 2024-09-11T07:08:48.760 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.011607848 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298317+0000", 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.049154282000000001 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298350+0000", 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 3.2422999999999998e-05 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.761 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298439+0000", 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 8.9184999999999994e-05 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.298518+0000", 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.9399000000000003e-05 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "description": "osd_op(client.4449.0:72103 3.f 3:f23ad575:::rbd_data.1161b94a6d64.0000000000000000:head [stat,write-same] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e88)", 2024-09-11T07:08:48.762 INFO:teuthology.orchestra.run.smithi110.stdout: "initiated_at": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "age": 88.117985650999998, 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.062148363999999998, 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "continuous": false, 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "type_data": { 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "flag_point": "commit sent; apply or cleanup", 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client_info": { 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client": "client.4449", 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "client_addr": "172.21.15.79:0/1618803360", 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "tid": 72103 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: "events": [ 2024-09-11T07:08:48.763 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "initiated", 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "header_read", 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554663+0000", 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "throttled", 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554665+0000", 2024-09-11T07:08:48.764 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.2400000000000002e-06 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "all_read", 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554677+0000", 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.1883e-05 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "dispatched", 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554706+0000", 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 2.8873e-05 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.765 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "queued_for_pg", 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554721+0000", 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 1.5313000000000001e-05 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "reached_pg", 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554832+0000", 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000111202 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "started", 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.554969+0000", 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.00013691699999999999 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.766 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "waiting for subops from 4", 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.567978+0000", 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.013008389 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "op_commit", 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616509+0000", 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.048531763999999998 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "sub_op_commit_rec", 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616631+0000", 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000121716 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.767 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "commit_sent", 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616734+0000", 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 0.000102772 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: }, 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: { 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "event": "done", 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "time": "2024-09-11T07:07:20.616811+0000", 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: "duration": 7.7294999999999998e-05 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: } 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout: ] 2024-09-11T07:08:48.768 INFO:teuthology.orchestra.run.smithi110.stdout:} 2024-09-11T07:08:50.096 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-09-11T07:08:50.199 INFO:tasks.thrashosds.thrasher:inning osd 2024-09-11T07:08:50.199 INFO:tasks.thrashosds.thrasher:Adding osd 4 2024-09-11T07:08:50.199 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 4 2024-09-11T07:08:50.510 INFO:tasks.ceph.mon.a.smithi079.stderr:2024-09-11T07:08:50.505+0000 7f4290681640 -1 mon.a@0(leader).osd e169 definitely_dead 0 2024-09-11T07:08:51.073 INFO:teuthology.orchestra.run.smithi079.stderr:noscrub is unset 2024-09-11T07:08:51.083 INFO:teuthology.orchestra.run.smithi079.stderr:marked in osd.4. 2024-09-11T07:08:51.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-09-11T07:08:51.112 INFO:tasks.thrashosds.thrasher:Added osd 4 2024-09-11T07:08:51.112 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-09-11T07:08:51.293 INFO:teuthology.orchestra.run.smithi079.stdout:mon.a: {} 2024-09-11T07:08:51.293 INFO:teuthology.orchestra.run.smithi079.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T07:08:51.305 INFO:teuthology.orchestra.run.smithi079.stdout:mon.b: {} 2024-09-11T07:08:51.306 INFO:teuthology.orchestra.run.smithi079.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T07:08:51.315 INFO:teuthology.orchestra.run.smithi079.stdout:mon.c: {} 2024-09-11T07:08:51.315 INFO:teuthology.orchestra.run.smithi079.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-09-11T07:08:51.331 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-09-11T07:08:52.085 INFO:teuthology.orchestra.run.smithi079.stderr:nodeep-scrub is unset 2024-09-11T07:08:52.087 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.0 to 1 (10000) 2024-09-11T07:08:52.118 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-09-11T07:08:53.079 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-09-11T07:08:53.115 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-09-11T07:08:53.847 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.1 to 1 (10000) 2024-09-11T07:08:53.877 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-09-11T07:08:54.849 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-09-11T07:08:54.876 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-09-11T07:08:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.2 to 1 (10000) 2024-09-11T07:08:55.879 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-09-11T07:08:56.873 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-09-11T07:08:56.902 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-09-11T07:08:57.869 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.3 to 1 (10000) 2024-09-11T07:08:57.896 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-09-11T07:08:58.843 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-09-11T07:08:58.871 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-09-11T07:08:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.4 to 1 (10000) 2024-09-11T07:08:59.870 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-09-11T07:09:01.125 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-09-11T07:09:01.151 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-09-11T07:09:02.143 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.5 to 1 (10000) 2024-09-11T07:09:02.167 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-09-11T07:09:03.139 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-09-11T07:09:03.166 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-09-11T07:09:03.853 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.6 to 1 (10000) 2024-09-11T07:09:03.878 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-09-11T07:09:05.155 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-09-11T07:09:05.185 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-09-11T07:09:06.167 INFO:teuthology.orchestra.run.smithi079.stderr:reweighted osd.7 to 1 (10000) 2024-09-11T07:09:06.197 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-09-11T07:09:07.189 INFO:teuthology.orchestra.run.smithi079.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-09-11T07:09:07.213 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-09-11T07:09:07.214 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-09-11T07:09:07.214 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-09-11T07:09:07.214 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-09-11T07:09:07.214 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-11T07:09:07.214 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T07:09:07.501 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:09:07.501 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":186,"fsid":"e1313abd-54a9-4e53-ab67-469f744048b1","created":"2024-09-11T07:05:29.098467+0000","modified":"2024-09-11T07:09:07.175415+0000","last_up_change":"2024-09-11T07:05:41.051856+0000","last_in_change":"2024-09-11T07:08:51.070082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T07:05:41.897005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T07:05:47.687214+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T07:05:57.298060+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":49,"snap_epoch":168,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"24d57cdb-2f3a-4a96-903d-11be7dc26a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6825","nonce":1708235775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6827","nonce":1708235775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6831","nonce":1708235775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6829","nonce":1708235775}]},"public_addr":"172.21.15.79:6825/1708235775","cluster_addr":"172.21.15.79:6827/1708235775","heartbeat_back_addr":"172.21.15.79:6831/1708235775","heartbeat_front_addr":"172.21.15.79:6829/1708235775","state":["exists","up"]},{"osd":1,"uuid":"aa51dc1b-b783-4212-8736-1f666239613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6801","nonce":2076268206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6803","nonce":2076268206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6807","nonce":2076268206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6805","nonce":2076268206}]},"public_addr":"172.21.15.79:6801/2076268206","cluster_addr":"172.21.15.79:6803/2076268206","heartbeat_back_addr":"172.21.15.79:6807/2076268206","heartbeat_front_addr":"172.21.15.79:6805/2076268206","state":["exists","up"]},{"osd":2,"uuid":"141a913f-7353-44a9-9dbd-70219bcee638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6817","nonce":1904492349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6819","nonce":1904492349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6823","nonce":1904492349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6821","nonce":1904492349}]},"public_addr":"172.21.15.79:6817/1904492349","cluster_addr":"172.21.15.79:6819/1904492349","heartbeat_back_addr":"172.21.15.79:6823/1904492349","heartbeat_front_addr":"172.21.15.79:6821/1904492349","state":["exists","up"]},{"osd":3,"uuid":"32550aeb-0c8d-4ca9-afd5-3e5258e7255b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6809","nonce":1327328912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6811","nonce":1327328912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6815","nonce":1327328912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6813","nonce":1327328912}]},"public_addr":"172.21.15.79:6809/1327328912","cluster_addr":"172.21.15.79:6811/1327328912","heartbeat_back_addr":"172.21.15.79:6815/1327328912","heartbeat_front_addr":"172.21.15.79:6813/1327328912","state":["exists","up"]},{"osd":4,"uuid":"88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6809","nonce":4087452871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6811","nonce":4087452871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6815","nonce":4087452871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6813","nonce":4087452871}]},"public_addr":"172.21.15.110:6809/4087452871","cluster_addr":"172.21.15.110:6811/4087452871","heartbeat_back_addr":"172.21.15.110:6815/4087452871","heartbeat_front_addr":"172.21.15.110:6813/4087452871","state":["exists","up"]},{"osd":5,"uuid":"42c83053-328e-4c9b-bdaf-09e1a4cc8b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6825","nonce":2133006853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6827","nonce":2133006853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6831","nonce":2133006853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6829","nonce":2133006853}]},"public_addr":"172.21.15.110:6825/2133006853","cluster_addr":"172.21.15.110:6827/2133006853","heartbeat_back_addr":"172.21.15.110:6831/2133006853","heartbeat_front_addr":"172.21.15.110:6829/2133006853","state":["exists","up"]},{"osd":6,"uuid":"0ab29b1f-3012-4528-8f47-2cac908122c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6817","nonce":2083734892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6819","nonce":2083734892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6823","nonce":2083734892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6821","nonce":2083734892}]},"public_addr":"172.21.15.110:6817/2083734892","cluster_addr":"172.21.15.110:6819/2083734892","heartbeat_back_addr":"172.21.15.110:6823/2083734892","heartbeat_front_addr":"172.21.15.110:6821/2083734892","state":["exists","up"]},{"osd":7,"uuid":"d9c7d12b-be93-41c9-a246-773faa65ecaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6801","nonce":2322042784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6803","nonce":2322042784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6807","nonce":2322042784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6805","nonce":2322042784}]},"public_addr":"172.21.15.110:6801/2322042784","cluster_addr":"172.21.15.110:6803/2322042784","heartbeat_back_addr":"172.21.15.110:6807/2322042784","heartbeat_front_addr":"172.21.15.110:6805/2322042784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.653648+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.846269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.970884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.985630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.236412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.336953+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.306806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.104744+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.0","osds":[0,6]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T07:09:07.519 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-11T07:09:07.519 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T07:09:07.808 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:09:07.808 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":186,"fsid":"e1313abd-54a9-4e53-ab67-469f744048b1","created":"2024-09-11T07:05:29.098467+0000","modified":"2024-09-11T07:09:07.175415+0000","last_up_change":"2024-09-11T07:05:41.051856+0000","last_in_change":"2024-09-11T07:08:51.070082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T07:05:41.897005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T07:05:47.687214+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T07:05:57.298060+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":49,"snap_epoch":168,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"24d57cdb-2f3a-4a96-903d-11be7dc26a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6825","nonce":1708235775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6827","nonce":1708235775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6831","nonce":1708235775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6829","nonce":1708235775}]},"public_addr":"172.21.15.79:6825/1708235775","cluster_addr":"172.21.15.79:6827/1708235775","heartbeat_back_addr":"172.21.15.79:6831/1708235775","heartbeat_front_addr":"172.21.15.79:6829/1708235775","state":["exists","up"]},{"osd":1,"uuid":"aa51dc1b-b783-4212-8736-1f666239613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6801","nonce":2076268206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6803","nonce":2076268206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6807","nonce":2076268206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6805","nonce":2076268206}]},"public_addr":"172.21.15.79:6801/2076268206","cluster_addr":"172.21.15.79:6803/2076268206","heartbeat_back_addr":"172.21.15.79:6807/2076268206","heartbeat_front_addr":"172.21.15.79:6805/2076268206","state":["exists","up"]},{"osd":2,"uuid":"141a913f-7353-44a9-9dbd-70219bcee638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6817","nonce":1904492349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6819","nonce":1904492349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6823","nonce":1904492349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6821","nonce":1904492349}]},"public_addr":"172.21.15.79:6817/1904492349","cluster_addr":"172.21.15.79:6819/1904492349","heartbeat_back_addr":"172.21.15.79:6823/1904492349","heartbeat_front_addr":"172.21.15.79:6821/1904492349","state":["exists","up"]},{"osd":3,"uuid":"32550aeb-0c8d-4ca9-afd5-3e5258e7255b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6809","nonce":1327328912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6811","nonce":1327328912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6815","nonce":1327328912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6813","nonce":1327328912}]},"public_addr":"172.21.15.79:6809/1327328912","cluster_addr":"172.21.15.79:6811/1327328912","heartbeat_back_addr":"172.21.15.79:6815/1327328912","heartbeat_front_addr":"172.21.15.79:6813/1327328912","state":["exists","up"]},{"osd":4,"uuid":"88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6809","nonce":4087452871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6811","nonce":4087452871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6815","nonce":4087452871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6813","nonce":4087452871}]},"public_addr":"172.21.15.110:6809/4087452871","cluster_addr":"172.21.15.110:6811/4087452871","heartbeat_back_addr":"172.21.15.110:6815/4087452871","heartbeat_front_addr":"172.21.15.110:6813/4087452871","state":["exists","up"]},{"osd":5,"uuid":"42c83053-328e-4c9b-bdaf-09e1a4cc8b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6825","nonce":2133006853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6827","nonce":2133006853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6831","nonce":2133006853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6829","nonce":2133006853}]},"public_addr":"172.21.15.110:6825/2133006853","cluster_addr":"172.21.15.110:6827/2133006853","heartbeat_back_addr":"172.21.15.110:6831/2133006853","heartbeat_front_addr":"172.21.15.110:6829/2133006853","state":["exists","up"]},{"osd":6,"uuid":"0ab29b1f-3012-4528-8f47-2cac908122c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6817","nonce":2083734892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6819","nonce":2083734892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6823","nonce":2083734892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6821","nonce":2083734892}]},"public_addr":"172.21.15.110:6817/2083734892","cluster_addr":"172.21.15.110:6819/2083734892","heartbeat_back_addr":"172.21.15.110:6823/2083734892","heartbeat_front_addr":"172.21.15.110:6821/2083734892","state":["exists","up"]},{"osd":7,"uuid":"d9c7d12b-be93-41c9-a246-773faa65ecaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6801","nonce":2322042784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6803","nonce":2322042784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6807","nonce":2322042784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6805","nonce":2322042784}]},"public_addr":"172.21.15.110:6801/2322042784","cluster_addr":"172.21.15.110:6803/2322042784","heartbeat_back_addr":"172.21.15.110:6807/2322042784","heartbeat_front_addr":"172.21.15.110:6805/2322042784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.653648+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.846269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.970884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.985630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.236412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.336953+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.306806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.104744+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.0","osds":[0,6]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T07:09:07.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-11T07:09:07.826 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-11T07:09:07.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-11T07:09:07.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-11T07:09:07.827 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-11T07:09:07.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-11T07:09:07.828 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-11T07:09:07.829 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-11T07:09:08.091 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:08.091 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T07:09:08.092 INFO:teuthology.orchestra.run.smithi079.stdout:55834574894 2024-09-11T07:09:08.093 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T07:09:08.094 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:08.094 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T07:09:08.101 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-11T07:09:08.101 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T07:09:08.107 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:08.107 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T07:09:08.108 INFO:teuthology.orchestra.run.smithi079.stdout:55834574894 2024-09-11T07:09:08.108 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T07:09:08.110 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:08.110 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T07:09:08.111 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-11T07:09:08.111 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T07:09:08.541 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-11T07:09:08.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.0 2024-09-11T07:09:08.591 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-11T07:09:08.617 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.2 2024-09-11T07:09:08.623 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:08.637 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:08.642 INFO:teuthology.orchestra.run.smithi079.stdout:55834574891 2024-09-11T07:09:08.647 INFO:teuthology.orchestra.run.smithi079.stdout:55834574891 2024-09-11T07:09:08.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574893 for osd.6 2024-09-11T07:09:08.660 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574893 for osd.4 2024-09-11T07:09:08.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.7 2024-09-11T07:09:08.665 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-11T07:09:08.677 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.1 2024-09-11T07:09:08.682 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.5 2024-09-11T07:09:08.699 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-11T07:09:08.716 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.3 2024-09-11T07:09:09.576 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T07:09:09.617 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T07:09:09.652 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T07:09:09.661 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T07:09:09.665 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T07:09:09.678 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-11T07:09:09.683 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-11T07:09:09.717 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-11T07:09:10.073 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-11T07:09:10.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.0 2024-09-11T07:09:10.108 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-11T07:09:10.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574892 for osd.2 2024-09-11T07:09:10.178 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:10.182 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:10.189 INFO:teuthology.orchestra.run.smithi079.stdout:55834574891 2024-09-11T07:09:10.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574893 for osd.6 2024-09-11T07:09:10.214 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574893 for osd.4 2024-09-11T07:09:10.219 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574891 for osd.7 2024-09-11T07:09:10.222 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-11T07:09:10.243 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.1 2024-09-11T07:09:10.244 DEBUG:teuthology.parallel:result is None 2024-09-11T07:09:10.248 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:10.255 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:10.266 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.3 2024-09-11T07:09:10.267 DEBUG:teuthology.parallel:result is None 2024-09-11T07:09:10.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.5 2024-09-11T07:09:10.274 DEBUG:teuthology.parallel:result is None 2024-09-11T07:09:11.100 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-11T07:09:11.128 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-11T07:09:11.210 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-11T07:09:11.215 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-11T07:09:11.219 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-11T07:09:11.456 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:11.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.2 2024-09-11T07:09:11.476 DEBUG:teuthology.parallel:result is None 2024-09-11T07:09:11.539 INFO:teuthology.orchestra.run.smithi079.stdout:55834574894 2024-09-11T07:09:11.541 INFO:teuthology.orchestra.run.smithi079.stdout:55834574893 2024-09-11T07:09:11.542 INFO:teuthology.orchestra.run.smithi079.stdout:55834574892 2024-09-11T07:09:11.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574894 for osd.4 2024-09-11T07:09:11.569 DEBUG:teuthology.parallel:result is None 2024-09-11T07:09:11.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574893 got 55834574893 for osd.0 2024-09-11T07:09:11.570 DEBUG:teuthology.parallel:result is None 2024-09-11T07:09:11.571 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574892 got 55834574892 for osd.7 2024-09-11T07:09:11.571 DEBUG:teuthology.parallel:result is None 2024-09-11T07:09:11.632 INFO:teuthology.orchestra.run.smithi079.stdout:55834574894 2024-09-11T07:09:11.649 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574894 got 55834574894 for osd.6 2024-09-11T07:09:11.649 DEBUG:teuthology.parallel:result is None 2024-09-11T07:09:11.649 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-09-11T07:09:11.649 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:09:11.924 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:09:11.925 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:09:11.940 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-11T07:09:11.867482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":956,"num_object_clones":0,"num_object_copies":1912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":956,"num_whiteouts":948,"num_read":171929,"num_read_kb":628453,"num_write":20153,"num_write_kb":417776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4499,"num_bytes_recovered":293540896,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18629,"ondisk_log_size":18629,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400368,"kb_used_data":17600,"kb_used_omap":12,"kb_used_meta":382579,"kb_avail":754574352,"statfs":{"total":773094113280,"available":772684136448,"internally_reserved":0,"allocated":18022400,"data_stored":9840676,"data_compressed":12474,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":12760,"internal_metadata":391761448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.711104"},"pg_stats":[{"pgid":"3.1f","version":"168'468","reported_seq":3070,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.189047+0000","last_change":"2024-09-11T07:08:48.123890+0000","last_active":"2024-09-11T07:09:07.189047+0000","last_peered":"2024-09-11T07:09:07.189047+0000","last_clean":"2024-09-11T07:09:07.189047+0000","last_became_active":"2024-09-11T07:08:13.087864+0000","last_became_peered":"2024-09-11T07:08:13.087864+0000","last_unstale":"2024-09-11T07:09:07.189047+0000","last_undegraded":"2024-09-11T07:09:07.189047+0000","last_fullsized":"2024-09-11T07:09:07.189047+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:15:41.981140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028069940000000002,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2694,"num_read_kb":5154,"num_write":552,"num_write_kb":22529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":3432884,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'412","reported_seq":2205,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616940+0000","last_change":"2024-09-11T07:08:48.203786+0000","last_active":"2024-09-11T07:09:06.616940+0000","last_peered":"2024-09-11T07:09:06.616940+0000","last_clean":"2024-09-11T07:09:06.616940+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:09:06.616940+0000","last_undegraded":"2024-09-11T07:09:06.616940+0000","last_fullsized":"2024-09-11T07:09:06.616940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:36.315451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028533249999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":1677,"num_read_kb":19454,"num_write":399,"num_write_kb":12631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"165'649","reported_seq":12980,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703100+0000","last_change":"2024-09-11T07:08:55.868195+0000","last_active":"2024-09-11T07:09:06.703100+0000","last_peered":"2024-09-11T07:09:06.703100+0000","last_clean":"2024-09-11T07:09:06.703100+0000","last_became_active":"2024-09-11T07:08:55.865799+0000","last_became_peered":"2024-09-11T07:08:55.865799+0000","last_unstale":"2024-09-11T07:09:06.703100+0000","last_undegraded":"2024-09-11T07:09:06.703100+0000","last_fullsized":"2024-09-11T07:09:06.703100+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:49:41.498042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019228699999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":13982,"num_read_kb":66796,"num_write":768,"num_write_kb":14794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":5987441,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"168'909","reported_seq":4677,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702821+0000","last_change":"2024-09-11T07:08:57.885182+0000","last_active":"2024-09-11T07:09:06.702821+0000","last_peered":"2024-09-11T07:09:06.702821+0000","last_clean":"2024-09-11T07:09:06.702821+0000","last_became_active":"2024-09-11T07:08:57.881857+0000","last_became_peered":"2024-09-11T07:08:57.881857+0000","last_unstale":"2024-09-11T07:09:06.702821+0000","last_undegraded":"2024-09-11T07:09:06.702821+0000","last_fullsized":"2024-09-11T07:09:06.702821+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:28:07.362960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021881650000000002,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":5039,"num_read_kb":16054,"num_write":1190,"num_write_kb":13844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":6996622,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'539","reported_seq":6881,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188813+0000","last_change":"2024-09-11T07:08:57.881662+0000","last_active":"2024-09-11T07:09:07.188813+0000","last_peered":"2024-09-11T07:09:07.188813+0000","last_clean":"2024-09-11T07:09:07.188813+0000","last_became_active":"2024-09-11T07:08:57.880103+0000","last_became_peered":"2024-09-11T07:08:57.880103+0000","last_unstale":"2024-09-11T07:09:07.188813+0000","last_undegraded":"2024-09-11T07:09:07.188813+0000","last_fullsized":"2024-09-11T07:09:07.188813+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:54.645362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025371069999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":8318,"num_read_kb":11321,"num_write":542,"num_write_kb":4670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":4425669,"num_keys_recovered":47,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"163'520","reported_seq":5071,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173410+0000","last_change":"2024-09-11T07:09:02.150715+0000","last_active":"2024-09-11T07:09:06.173410+0000","last_peered":"2024-09-11T07:09:06.173410+0000","last_clean":"2024-09-11T07:09:06.173410+0000","last_became_active":"2024-09-11T07:09:02.145138+0000","last_became_peered":"2024-09-11T07:09:02.145138+0000","last_unstale":"2024-09-11T07:09:06.173410+0000","last_undegraded":"2024-09-11T07:09:06.173410+0000","last_fullsized":"2024-09-11T07:09:06.173410+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:02:56.439518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024466639999999999,"stat_sum":{"num_bytes":19,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":41,"num_read":6616,"num_read_kb":11567,"num_write":528,"num_write_kb":10022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":3177242,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"168'483","reported_seq":2146,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171830+0000","last_change":"2024-09-11T07:08:48.078593+0000","last_active":"2024-09-11T07:09:06.171830+0000","last_peered":"2024-09-11T07:09:06.171830+0000","last_clean":"2024-09-11T07:09:06.171830+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:09:06.171830+0000","last_undegraded":"2024-09-11T07:09:06.171830+0000","last_fullsized":"2024-09-11T07:09:06.171830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:35.663171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016777719999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2274,"num_read_kb":6232,"num_write":578,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"167'723","reported_seq":4881,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616636+0000","last_change":"2024-09-11T07:08:48.201459+0000","last_active":"2024-09-11T07:09:06.616636+0000","last_peered":"2024-09-11T07:09:06.616636+0000","last_clean":"2024-09-11T07:09:06.616636+0000","last_became_active":"2024-09-11T07:08:14.106879+0000","last_became_peered":"2024-09-11T07:08:14.106879+0000","last_unstale":"2024-09-11T07:09:06.616636+0000","last_undegraded":"2024-09-11T07:09:06.616636+0000","last_fullsized":"2024-09-11T07:09:06.616636+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:07.608483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013481490000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6716,"num_read_kb":13771,"num_write":714,"num_write_kb":21799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":9689178,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"162'445","reported_seq":6684,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188867+0000","last_change":"2024-09-11T07:08:48.122544+0000","last_active":"2024-09-11T07:09:07.188867+0000","last_peered":"2024-09-11T07:09:07.188867+0000","last_clean":"2024-09-11T07:09:07.188867+0000","last_became_active":"2024-09-11T07:08:21.855245+0000","last_became_peered":"2024-09-11T07:08:21.855245+0000","last_unstale":"2024-09-11T07:09:07.188867+0000","last_undegraded":"2024-09-11T07:09:07.188867+0000","last_fullsized":"2024-09-11T07:09:07.188867+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:49:30.408153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020224750000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":6674,"num_read_kb":41299,"num_write":387,"num_write_kb":21088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":28975126,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"168'688","reported_seq":4228,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703013+0000","last_change":"2024-09-11T07:08:48.086510+0000","last_active":"2024-09-11T07:09:06.703013+0000","last_peered":"2024-09-11T07:09:06.703013+0000","last_clean":"2024-09-11T07:09:06.703013+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:09:06.703013+0000","last_undegraded":"2024-09-11T07:09:06.703013+0000","last_fullsized":"2024-09-11T07:09:06.703013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:32:02.395296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033666669999999998,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5507,"num_read_kb":16321,"num_write":723,"num_write_kb":8687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'483","reported_seq":4221,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187154+0000","last_change":"2024-09-11T07:08:48.076124+0000","last_active":"2024-09-11T07:09:07.187154+0000","last_peered":"2024-09-11T07:09:07.187154+0000","last_clean":"2024-09-11T07:09:07.187154+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:09:07.187154+0000","last_undegraded":"2024-09-11T07:09:07.187154+0000","last_fullsized":"2024-09-11T07:09:07.187154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:09.463660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041864520000000002,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4880,"num_read_kb":24721,"num_write":443,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"168'598","reported_seq":4851,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173739+0000","last_change":"2024-09-11T07:09:02.153702+0000","last_active":"2024-09-11T07:09:06.173739+0000","last_peered":"2024-09-11T07:09:06.173739+0000","last_clean":"2024-09-11T07:09:06.173739+0000","last_became_active":"2024-09-11T07:09:02.149433+0000","last_became_peered":"2024-09-11T07:09:02.149433+0000","last_unstale":"2024-09-11T07:09:06.173739+0000","last_undegraded":"2024-09-11T07:09:06.173739+0000","last_fullsized":"2024-09-11T07:09:06.173739+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:41.039056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001012333,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6911,"num_read_kb":17769,"num_write":573,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":3955769,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":263,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186748+0000","last_change":"2024-09-11T07:07:24.114928+0000","last_active":"2024-09-11T07:09:07.186748+0000","last_peered":"2024-09-11T07:09:07.186748+0000","last_clean":"2024-09-11T07:09:07.186748+0000","last_became_active":"2024-09-11T07:07:24.114181+0000","last_became_peered":"2024-09-11T07:07:24.114181+0000","last_unstale":"2024-09-11T07:09:07.186748+0000","last_undegraded":"2024-09-11T07:09:07.186748+0000","last_fullsized":"2024-09-11T07:09:07.186748+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:03.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"168'628","reported_seq":4054,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188734+0000","last_change":"2024-09-11T07:08:48.123105+0000","last_active":"2024-09-11T07:09:07.188734+0000","last_peered":"2024-09-11T07:09:07.188734+0000","last_clean":"2024-09-11T07:09:07.188734+0000","last_became_active":"2024-09-11T07:08:11.076673+0000","last_became_peered":"2024-09-11T07:08:11.076673+0000","last_unstale":"2024-09-11T07:09:07.188734+0000","last_undegraded":"2024-09-11T07:09:07.188734+0000","last_fullsized":"2024-09-11T07:09:07.188734+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:17:38.398538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024495049999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":4338,"num_read_kb":14044,"num_write":542,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":16056304,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":348,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.172090+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:09:06.172090+0000","last_peered":"2024-09-11T07:09:06.172090+0000","last_clean":"2024-09-11T07:09:06.172090+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:09:06.172090+0000","last_undegraded":"2024-09-11T07:09:06.172090+0000","last_fullsized":"2024-09-11T07:09:06.172090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"166'680","reported_seq":2593,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616923+0000","last_change":"2024-09-11T07:08:48.203453+0000","last_active":"2024-09-11T07:09:06.616923+0000","last_peered":"2024-09-11T07:09:06.616923+0000","last_clean":"2024-09-11T07:09:06.616923+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:09:06.616923+0000","last_undegraded":"2024-09-11T07:09:06.616923+0000","last_fullsized":"2024-09-11T07:09:06.616923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:28.692608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023129169999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4034,"num_read_kb":11596,"num_write":855,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187457+0000","last_change":"2024-09-11T07:08:08.034462+0000","last_active":"2024-09-11T07:09:07.187457+0000","last_peered":"2024-09-11T07:09:07.187457+0000","last_clean":"2024-09-11T07:09:07.187457+0000","last_became_active":"2024-09-11T07:08:08.033647+0000","last_became_peered":"2024-09-11T07:08:08.033647+0000","last_unstale":"2024-09-11T07:09:07.187457+0000","last_undegraded":"2024-09-11T07:09:07.187457+0000","last_fullsized":"2024-09-11T07:09:07.187457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:34:57.644981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"165'515","reported_seq":5204,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171863+0000","last_change":"2024-09-11T07:08:48.079207+0000","last_active":"2024-09-11T07:09:06.171863+0000","last_peered":"2024-09-11T07:09:06.171863+0000","last_clean":"2024-09-11T07:09:06.171863+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:09:06.171863+0000","last_undegraded":"2024-09-11T07:09:06.171863+0000","last_fullsized":"2024-09-11T07:09:06.171863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:16.525589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002205477,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6066,"num_read_kb":28471,"num_write":492,"num_write_kb":12910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":358,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.172023+0000","last_change":"2024-09-11T07:08:08.036204+0000","last_active":"2024-09-11T07:09:06.172023+0000","last_peered":"2024-09-11T07:09:06.172023+0000","last_clean":"2024-09-11T07:09:06.172023+0000","last_became_active":"2024-09-11T07:08:08.035491+0000","last_became_peered":"2024-09-11T07:08:08.035491+0000","last_unstale":"2024-09-11T07:09:06.172023+0000","last_undegraded":"2024-09-11T07:09:06.172023+0000","last_fullsized":"2024-09-11T07:09:06.172023+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:23.281269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"168'540","reported_seq":2961,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703091+0000","last_change":"2024-09-11T07:08:48.087759+0000","last_active":"2024-09-11T07:09:06.703091+0000","last_peered":"2024-09-11T07:09:06.703091+0000","last_clean":"2024-09-11T07:09:06.703091+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:09:06.703091+0000","last_undegraded":"2024-09-11T07:09:06.703091+0000","last_fullsized":"2024-09-11T07:09:06.703091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:05.015024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042550620000000004,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3092,"num_read_kb":8737,"num_write":637,"num_write_kb":5048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"168'738","reported_seq":4496,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173437+0000","last_change":"2024-09-11T07:09:02.152239+0000","last_active":"2024-09-11T07:09:06.173437+0000","last_peered":"2024-09-11T07:09:06.173437+0000","last_clean":"2024-09-11T07:09:06.173437+0000","last_became_active":"2024-09-11T07:09:02.147735+0000","last_became_peered":"2024-09-11T07:09:02.147735+0000","last_unstale":"2024-09-11T07:09:06.173437+0000","last_undegraded":"2024-09-11T07:09:06.173437+0000","last_fullsized":"2024-09-11T07:09:06.173437+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:14.396794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020874370000000001,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":24,"num_read":5018,"num_read_kb":11581,"num_write":787,"num_write_kb":11396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":7952009,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":352,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702790+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:09:06.702790+0000","last_peered":"2024-09-11T07:09:06.702790+0000","last_clean":"2024-09-11T07:09:06.702790+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:09:06.702790+0000","last_undegraded":"2024-09-11T07:09:06.702790+0000","last_fullsized":"2024-09-11T07:09:06.702790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"168'683","reported_seq":5241,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171860+0000","last_change":"2024-09-11T07:08:48.077928+0000","last_active":"2024-09-11T07:09:06.171860+0000","last_peered":"2024-09-11T07:09:06.171860+0000","last_clean":"2024-09-11T07:09:06.171860+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:09:06.171860+0000","last_undegraded":"2024-09-11T07:09:06.171860+0000","last_fullsized":"2024-09-11T07:09:06.171860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:11.799895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011597129999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5953,"num_read_kb":41533,"num_write":674,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":351,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.731446+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:09:07.731446+0000","last_peered":"2024-09-11T07:09:07.731446+0000","last_clean":"2024-09-11T07:09:07.731446+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:09:07.731446+0000","last_undegraded":"2024-09-11T07:09:07.731446+0000","last_fullsized":"2024-09-11T07:09:07.731446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'472","reported_seq":8833,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188231+0000","last_change":"2024-09-11T07:08:55.866882+0000","last_active":"2024-09-11T07:09:07.188231+0000","last_peered":"2024-09-11T07:09:07.188231+0000","last_clean":"2024-09-11T07:09:07.188231+0000","last_became_active":"2024-09-11T07:08:55.865598+0000","last_became_peered":"2024-09-11T07:08:55.865598+0000","last_unstale":"2024-09-11T07:09:07.188231+0000","last_undegraded":"2024-09-11T07:09:07.188231+0000","last_fullsized":"2024-09-11T07:09:07.188231+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:43.022711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012557989999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":8865,"num_read_kb":33202,"num_write":482,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":323,"num_bytes_recovered":61422801,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188279+0000","last_change":"2024-09-11T07:08:08.034045+0000","last_active":"2024-09-11T07:09:07.188279+0000","last_peered":"2024-09-11T07:09:07.188279+0000","last_clean":"2024-09-11T07:09:07.188279+0000","last_became_active":"2024-09-11T07:08:08.033145+0000","last_became_peered":"2024-09-11T07:08:08.033145+0000","last_unstale":"2024-09-11T07:09:07.188279+0000","last_undegraded":"2024-09-11T07:09:07.188279+0000","last_fullsized":"2024-09-11T07:09:07.188279+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:23:05.963512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"167'462","reported_seq":5352,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616776+0000","last_change":"2024-09-11T07:08:48.202029+0000","last_active":"2024-09-11T07:09:06.616776+0000","last_peered":"2024-09-11T07:09:06.616776+0000","last_clean":"2024-09-11T07:09:06.616776+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:09:06.616776+0000","last_undegraded":"2024-09-11T07:09:06.616776+0000","last_fullsized":"2024-09-11T07:09:06.616776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:28.720201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018328699999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5357,"num_read_kb":20493,"num_write":487,"num_write_kb":10685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":351,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702781+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:09:06.702781+0000","last_peered":"2024-09-11T07:09:06.702781+0000","last_clean":"2024-09-11T07:09:06.702781+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:09:06.702781+0000","last_undegraded":"2024-09-11T07:09:06.702781+0000","last_fullsized":"2024-09-11T07:09:06.702781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":529,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187056+0000","last_change":"2024-09-11T07:08:13.093650+0000","last_active":"2024-09-11T07:09:07.187056+0000","last_peered":"2024-09-11T07:09:07.187056+0000","last_clean":"2024-09-11T07:09:07.187056+0000","last_became_active":"2024-09-11T07:08:13.085823+0000","last_became_peered":"2024-09-11T07:08:13.085823+0000","last_unstale":"2024-09-11T07:09:07.187056+0000","last_undegraded":"2024-09-11T07:09:07.187056+0000","last_fullsized":"2024-09-11T07:09:07.187056+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:40.664683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"168'417","reported_seq":3550,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616659+0000","last_change":"2024-09-11T07:08:48.202051+0000","last_active":"2024-09-11T07:09:06.616659+0000","last_peered":"2024-09-11T07:09:06.616659+0000","last_clean":"2024-09-11T07:09:06.616659+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:09:06.616659+0000","last_undegraded":"2024-09-11T07:09:06.616659+0000","last_fullsized":"2024-09-11T07:09:06.616659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:43.653964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886642,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3136,"num_read_kb":12190,"num_write":362,"num_write_kb":7014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'299","reported_seq":2285,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173312+0000","last_change":"2024-09-11T07:09:02.151236+0000","last_active":"2024-09-11T07:09:06.173312+0000","last_peered":"2024-09-11T07:09:06.173312+0000","last_clean":"2024-09-11T07:09:06.173312+0000","last_became_active":"2024-09-11T07:09:02.146228+0000","last_became_peered":"2024-09-11T07:09:02.146228+0000","last_unstale":"2024-09-11T07:09:06.173312+0000","last_undegraded":"2024-09-11T07:09:06.173312+0000","last_fullsized":"2024-09-11T07:09:06.173312+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:06:14.189857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010147260000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":1603,"num_read_kb":8035,"num_write":242,"num_write_kb":8539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":4236596,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"167'604","reported_seq":5585,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187660+0000","last_change":"2024-09-11T07:09:06.177501+0000","last_active":"2024-09-11T07:09:07.187660+0000","last_peered":"2024-09-11T07:09:07.187660+0000","last_clean":"2024-09-11T07:09:07.187660+0000","last_became_active":"2024-09-11T07:09:06.175303+0000","last_became_peered":"2024-09-11T07:09:06.175303+0000","last_unstale":"2024-09-11T07:09:07.187660+0000","last_undegraded":"2024-09-11T07:09:07.187660+0000","last_fullsized":"2024-09-11T07:09:07.187660+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:00.818882+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0083757740000000008,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":7105,"num_read_kb":12374,"num_write":638,"num_write_kb":6832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":288,"num_bytes_recovered":4540944,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"167'554","reported_seq":3894,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616774+0000","last_change":"2024-09-11T07:08:48.202794+0000","last_active":"2024-09-11T07:09:06.616774+0000","last_peered":"2024-09-11T07:09:06.616774+0000","last_clean":"2024-09-11T07:09:06.616774+0000","last_became_active":"2024-09-11T07:08:13.094279+0000","last_became_peered":"2024-09-11T07:08:13.094279+0000","last_unstale":"2024-09-11T07:09:06.616774+0000","last_undegraded":"2024-09-11T07:09:06.616774+0000","last_fullsized":"2024-09-11T07:09:06.616774+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:05:19.294505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022690100000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5323,"num_read_kb":21130,"num_write":584,"num_write_kb":14713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":42089319,"num_keys_recovered":120,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"167'374","reported_seq":3081,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702834+0000","last_change":"2024-09-11T07:08:48.086616+0000","last_active":"2024-09-11T07:09:06.702834+0000","last_peered":"2024-09-11T07:09:06.702834+0000","last_clean":"2024-09-11T07:09:06.702834+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:09:06.702834+0000","last_undegraded":"2024-09-11T07:09:06.702834+0000","last_fullsized":"2024-09-11T07:09:06.702834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:14.712547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032901720000000001,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":2243,"num_read_kb":7360,"num_write":303,"num_write_kb":6081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"166'472","reported_seq":4057,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187174+0000","last_change":"2024-09-11T07:08:48.077078+0000","last_active":"2024-09-11T07:09:07.187174+0000","last_peered":"2024-09-11T07:09:07.187174+0000","last_clean":"2024-09-11T07:09:07.187174+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:09:07.187174+0000","last_undegraded":"2024-09-11T07:09:07.187174+0000","last_fullsized":"2024-09-11T07:09:07.187174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:01.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048801529999999999,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":5047,"num_read_kb":19575,"num_write":443,"num_write_kb":9370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"168'510","reported_seq":3756,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187328+0000","last_change":"2024-09-11T07:08:54.863283+0000","last_active":"2024-09-11T07:09:07.187328+0000","last_peered":"2024-09-11T07:09:07.187328+0000","last_clean":"2024-09-11T07:09:07.187328+0000","last_became_active":"2024-09-11T07:08:54.860099+0000","last_became_peered":"2024-09-11T07:08:54.860099+0000","last_unstale":"2024-09-11T07:09:07.187328+0000","last_undegraded":"2024-09-11T07:09:07.187328+0000","last_fullsized":"2024-09-11T07:09:07.187328+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:28:05.233558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058914980000000002,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5468,"num_read_kb":40931,"num_write":483,"num_write_kb":33825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":29182336,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'908","reported_seq":5692,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187215+0000","last_change":"2024-09-11T07:08:59.860723+0000","last_active":"2024-09-11T07:09:07.187215+0000","last_peered":"2024-09-11T07:09:07.187215+0000","last_clean":"2024-09-11T07:09:07.187215+0000","last_became_active":"2024-09-11T07:08:59.857371+0000","last_became_peered":"2024-09-11T07:08:59.857371+0000","last_unstale":"2024-09-11T07:09:07.187215+0000","last_undegraded":"2024-09-11T07:09:07.187215+0000","last_fullsized":"2024-09-11T07:09:07.187215+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:39.427043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037300609999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7268,"num_read_kb":23165,"num_write":1135,"num_write_kb":16436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":309,"num_bytes_recovered":38565066,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"164'1332","reported_seq":3550,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:48.072601+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:12.088833+0000","last_became_peered":"2024-09-11T07:08:12.088833+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:10.966554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025943210000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7126,"num_read_kb":16929,"num_write":1954,"num_write_kb":15903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":5558122,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"166'305","reported_seq":4432,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:57.881661+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:57.878966+0000","last_became_peered":"2024-09-11T07:08:57.878966+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:57:28.004494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030609069999999999,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":3180,"num_read_kb":9248,"num_write":258,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":2139720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"168'502","reported_seq":6667,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188231+0000","last_change":"2024-09-11T07:08:48.121587+0000","last_active":"2024-09-11T07:09:07.188231+0000","last_peered":"2024-09-11T07:09:07.188231+0000","last_clean":"2024-09-11T07:09:07.188231+0000","last_became_active":"2024-09-11T07:08:12.092494+0000","last_became_peered":"2024-09-11T07:08:12.092494+0000","last_unstale":"2024-09-11T07:09:07.188231+0000","last_undegraded":"2024-09-11T07:09:07.188231+0000","last_fullsized":"2024-09-11T07:09:07.188231+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:18:59.887309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011861700000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":6702,"num_read_kb":31801,"num_write":602,"num_write_kb":10266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":13150126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"166'597","reported_seq":3338,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187361+0000","last_change":"2024-09-11T07:08:58.859305+0000","last_active":"2024-09-11T07:09:07.187361+0000","last_peered":"2024-09-11T07:09:07.187361+0000","last_clean":"2024-09-11T07:09:07.187361+0000","last_became_active":"2024-09-11T07:08:58.856080+0000","last_became_peered":"2024-09-11T07:08:58.856080+0000","last_unstale":"2024-09-11T07:09:07.187361+0000","last_undegraded":"2024-09-11T07:09:07.187361+0000","last_fullsized":"2024-09-11T07:09:07.187361+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:44.826014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019838210000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3601,"num_read_kb":5499,"num_write":635,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":826886,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":952,"num_object_clones":0,"num_object_copies":1904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":952,"num_whiteouts":948,"num_read":171813,"num_read_kb":628353,"num_write":19992,"num_write_kb":415358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4495,"num_bytes_recovered":292360160,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18509,"ondisk_log_size":18509,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":19129,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47332,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324508,"statfs":{"total":96636764160,"available":96588296192,"internally_reserved":0,"allocated":2301952,"data_stored":1675772,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":46135753},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33380,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338460,"statfs":{"total":96636764160,"available":96602583040,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59744,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312096,"statfs":{"total":96636764160,"available":96575586304,"internally_reserved":0,"allocated":2236416,"data_stored":1079581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":58915268},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51420,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320420,"statfs":{"total":96636764160,"available":96584110080,"internally_reserved":0,"allocated":2236416,"data_stored":1079581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2232320,"data_stored":1079562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41700,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330140,"statfs":{"total":96636764160,"available":96594063360,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55584,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316256,"statfs":{"total":96636764160,"available":96579846144,"internally_reserved":0,"allocated":2240512,"data_stored":1079600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55632,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316208,"statfs":{"total":96636764160,"available":96579796992,"internally_reserved":0,"allocated":2285568,"data_stored":1675772,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:09:11.942 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:09:12.227 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:09:12.227 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:09:12.243 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-11T07:09:11.867482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":956,"num_object_clones":0,"num_object_copies":1912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":956,"num_whiteouts":948,"num_read":171929,"num_read_kb":628453,"num_write":20153,"num_write_kb":417776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4499,"num_bytes_recovered":293540896,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18629,"ondisk_log_size":18629,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400368,"kb_used_data":17600,"kb_used_omap":12,"kb_used_meta":382579,"kb_avail":754574352,"statfs":{"total":773094113280,"available":772684136448,"internally_reserved":0,"allocated":18022400,"data_stored":9840676,"data_compressed":12474,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":12760,"internal_metadata":391761448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.711104"},"pg_stats":[{"pgid":"3.1f","version":"168'468","reported_seq":3070,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.189047+0000","last_change":"2024-09-11T07:08:48.123890+0000","last_active":"2024-09-11T07:09:07.189047+0000","last_peered":"2024-09-11T07:09:07.189047+0000","last_clean":"2024-09-11T07:09:07.189047+0000","last_became_active":"2024-09-11T07:08:13.087864+0000","last_became_peered":"2024-09-11T07:08:13.087864+0000","last_unstale":"2024-09-11T07:09:07.189047+0000","last_undegraded":"2024-09-11T07:09:07.189047+0000","last_fullsized":"2024-09-11T07:09:07.189047+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:15:41.981140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028069940000000002,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2694,"num_read_kb":5154,"num_write":552,"num_write_kb":22529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":3432884,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'412","reported_seq":2205,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616940+0000","last_change":"2024-09-11T07:08:48.203786+0000","last_active":"2024-09-11T07:09:06.616940+0000","last_peered":"2024-09-11T07:09:06.616940+0000","last_clean":"2024-09-11T07:09:06.616940+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:09:06.616940+0000","last_undegraded":"2024-09-11T07:09:06.616940+0000","last_fullsized":"2024-09-11T07:09:06.616940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:36.315451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028533249999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":1677,"num_read_kb":19454,"num_write":399,"num_write_kb":12631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"165'649","reported_seq":12980,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703100+0000","last_change":"2024-09-11T07:08:55.868195+0000","last_active":"2024-09-11T07:09:06.703100+0000","last_peered":"2024-09-11T07:09:06.703100+0000","last_clean":"2024-09-11T07:09:06.703100+0000","last_became_active":"2024-09-11T07:08:55.865799+0000","last_became_peered":"2024-09-11T07:08:55.865799+0000","last_unstale":"2024-09-11T07:09:06.703100+0000","last_undegraded":"2024-09-11T07:09:06.703100+0000","last_fullsized":"2024-09-11T07:09:06.703100+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:49:41.498042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019228699999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":13982,"num_read_kb":66796,"num_write":768,"num_write_kb":14794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":5987441,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"168'909","reported_seq":4677,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702821+0000","last_change":"2024-09-11T07:08:57.885182+0000","last_active":"2024-09-11T07:09:06.702821+0000","last_peered":"2024-09-11T07:09:06.702821+0000","last_clean":"2024-09-11T07:09:06.702821+0000","last_became_active":"2024-09-11T07:08:57.881857+0000","last_became_peered":"2024-09-11T07:08:57.881857+0000","last_unstale":"2024-09-11T07:09:06.702821+0000","last_undegraded":"2024-09-11T07:09:06.702821+0000","last_fullsized":"2024-09-11T07:09:06.702821+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:28:07.362960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021881650000000002,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":5039,"num_read_kb":16054,"num_write":1190,"num_write_kb":13844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":6996622,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'539","reported_seq":6881,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188813+0000","last_change":"2024-09-11T07:08:57.881662+0000","last_active":"2024-09-11T07:09:07.188813+0000","last_peered":"2024-09-11T07:09:07.188813+0000","last_clean":"2024-09-11T07:09:07.188813+0000","last_became_active":"2024-09-11T07:08:57.880103+0000","last_became_peered":"2024-09-11T07:08:57.880103+0000","last_unstale":"2024-09-11T07:09:07.188813+0000","last_undegraded":"2024-09-11T07:09:07.188813+0000","last_fullsized":"2024-09-11T07:09:07.188813+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:54.645362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025371069999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":8318,"num_read_kb":11321,"num_write":542,"num_write_kb":4670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":4425669,"num_keys_recovered":47,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"163'520","reported_seq":5071,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173410+0000","last_change":"2024-09-11T07:09:02.150715+0000","last_active":"2024-09-11T07:09:06.173410+0000","last_peered":"2024-09-11T07:09:06.173410+0000","last_clean":"2024-09-11T07:09:06.173410+0000","last_became_active":"2024-09-11T07:09:02.145138+0000","last_became_peered":"2024-09-11T07:09:02.145138+0000","last_unstale":"2024-09-11T07:09:06.173410+0000","last_undegraded":"2024-09-11T07:09:06.173410+0000","last_fullsized":"2024-09-11T07:09:06.173410+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:02:56.439518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024466639999999999,"stat_sum":{"num_bytes":19,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":41,"num_read":6616,"num_read_kb":11567,"num_write":528,"num_write_kb":10022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":3177242,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"168'483","reported_seq":2146,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171830+0000","last_change":"2024-09-11T07:08:48.078593+0000","last_active":"2024-09-11T07:09:06.171830+0000","last_peered":"2024-09-11T07:09:06.171830+0000","last_clean":"2024-09-11T07:09:06.171830+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:09:06.171830+0000","last_undegraded":"2024-09-11T07:09:06.171830+0000","last_fullsized":"2024-09-11T07:09:06.171830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:35.663171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016777719999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2274,"num_read_kb":6232,"num_write":578,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"167'723","reported_seq":4881,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616636+0000","last_change":"2024-09-11T07:08:48.201459+0000","last_active":"2024-09-11T07:09:06.616636+0000","last_peered":"2024-09-11T07:09:06.616636+0000","last_clean":"2024-09-11T07:09:06.616636+0000","last_became_active":"2024-09-11T07:08:14.106879+0000","last_became_peered":"2024-09-11T07:08:14.106879+0000","last_unstale":"2024-09-11T07:09:06.616636+0000","last_undegraded":"2024-09-11T07:09:06.616636+0000","last_fullsized":"2024-09-11T07:09:06.616636+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:07.608483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013481490000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6716,"num_read_kb":13771,"num_write":714,"num_write_kb":21799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":9689178,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"162'445","reported_seq":6684,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188867+0000","last_change":"2024-09-11T07:08:48.122544+0000","last_active":"2024-09-11T07:09:07.188867+0000","last_peered":"2024-09-11T07:09:07.188867+0000","last_clean":"2024-09-11T07:09:07.188867+0000","last_became_active":"2024-09-11T07:08:21.855245+0000","last_became_peered":"2024-09-11T07:08:21.855245+0000","last_unstale":"2024-09-11T07:09:07.188867+0000","last_undegraded":"2024-09-11T07:09:07.188867+0000","last_fullsized":"2024-09-11T07:09:07.188867+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:49:30.408153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020224750000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":6674,"num_read_kb":41299,"num_write":387,"num_write_kb":21088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":28975126,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"168'688","reported_seq":4228,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703013+0000","last_change":"2024-09-11T07:08:48.086510+0000","last_active":"2024-09-11T07:09:06.703013+0000","last_peered":"2024-09-11T07:09:06.703013+0000","last_clean":"2024-09-11T07:09:06.703013+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:09:06.703013+0000","last_undegraded":"2024-09-11T07:09:06.703013+0000","last_fullsized":"2024-09-11T07:09:06.703013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:32:02.395296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033666669999999998,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5507,"num_read_kb":16321,"num_write":723,"num_write_kb":8687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'483","reported_seq":4221,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187154+0000","last_change":"2024-09-11T07:08:48.076124+0000","last_active":"2024-09-11T07:09:07.187154+0000","last_peered":"2024-09-11T07:09:07.187154+0000","last_clean":"2024-09-11T07:09:07.187154+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:09:07.187154+0000","last_undegraded":"2024-09-11T07:09:07.187154+0000","last_fullsized":"2024-09-11T07:09:07.187154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:09.463660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041864520000000002,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4880,"num_read_kb":24721,"num_write":443,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"168'598","reported_seq":4851,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173739+0000","last_change":"2024-09-11T07:09:02.153702+0000","last_active":"2024-09-11T07:09:06.173739+0000","last_peered":"2024-09-11T07:09:06.173739+0000","last_clean":"2024-09-11T07:09:06.173739+0000","last_became_active":"2024-09-11T07:09:02.149433+0000","last_became_peered":"2024-09-11T07:09:02.149433+0000","last_unstale":"2024-09-11T07:09:06.173739+0000","last_undegraded":"2024-09-11T07:09:06.173739+0000","last_fullsized":"2024-09-11T07:09:06.173739+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:41.039056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001012333,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6911,"num_read_kb":17769,"num_write":573,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":3955769,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":263,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186748+0000","last_change":"2024-09-11T07:07:24.114928+0000","last_active":"2024-09-11T07:09:07.186748+0000","last_peered":"2024-09-11T07:09:07.186748+0000","last_clean":"2024-09-11T07:09:07.186748+0000","last_became_active":"2024-09-11T07:07:24.114181+0000","last_became_peered":"2024-09-11T07:07:24.114181+0000","last_unstale":"2024-09-11T07:09:07.186748+0000","last_undegraded":"2024-09-11T07:09:07.186748+0000","last_fullsized":"2024-09-11T07:09:07.186748+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:03.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"168'628","reported_seq":4054,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188734+0000","last_change":"2024-09-11T07:08:48.123105+0000","last_active":"2024-09-11T07:09:07.188734+0000","last_peered":"2024-09-11T07:09:07.188734+0000","last_clean":"2024-09-11T07:09:07.188734+0000","last_became_active":"2024-09-11T07:08:11.076673+0000","last_became_peered":"2024-09-11T07:08:11.076673+0000","last_unstale":"2024-09-11T07:09:07.188734+0000","last_undegraded":"2024-09-11T07:09:07.188734+0000","last_fullsized":"2024-09-11T07:09:07.188734+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:17:38.398538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024495049999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":4338,"num_read_kb":14044,"num_write":542,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":16056304,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":348,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.172090+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:09:06.172090+0000","last_peered":"2024-09-11T07:09:06.172090+0000","last_clean":"2024-09-11T07:09:06.172090+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:09:06.172090+0000","last_undegraded":"2024-09-11T07:09:06.172090+0000","last_fullsized":"2024-09-11T07:09:06.172090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"166'680","reported_seq":2593,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616923+0000","last_change":"2024-09-11T07:08:48.203453+0000","last_active":"2024-09-11T07:09:06.616923+0000","last_peered":"2024-09-11T07:09:06.616923+0000","last_clean":"2024-09-11T07:09:06.616923+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:09:06.616923+0000","last_undegraded":"2024-09-11T07:09:06.616923+0000","last_fullsized":"2024-09-11T07:09:06.616923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:28.692608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023129169999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4034,"num_read_kb":11596,"num_write":855,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187457+0000","last_change":"2024-09-11T07:08:08.034462+0000","last_active":"2024-09-11T07:09:07.187457+0000","last_peered":"2024-09-11T07:09:07.187457+0000","last_clean":"2024-09-11T07:09:07.187457+0000","last_became_active":"2024-09-11T07:08:08.033647+0000","last_became_peered":"2024-09-11T07:08:08.033647+0000","last_unstale":"2024-09-11T07:09:07.187457+0000","last_undegraded":"2024-09-11T07:09:07.187457+0000","last_fullsized":"2024-09-11T07:09:07.187457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:34:57.644981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"165'515","reported_seq":5204,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171863+0000","last_change":"2024-09-11T07:08:48.079207+0000","last_active":"2024-09-11T07:09:06.171863+0000","last_peered":"2024-09-11T07:09:06.171863+0000","last_clean":"2024-09-11T07:09:06.171863+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:09:06.171863+0000","last_undegraded":"2024-09-11T07:09:06.171863+0000","last_fullsized":"2024-09-11T07:09:06.171863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:16.525589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002205477,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6066,"num_read_kb":28471,"num_write":492,"num_write_kb":12910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":358,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.172023+0000","last_change":"2024-09-11T07:08:08.036204+0000","last_active":"2024-09-11T07:09:06.172023+0000","last_peered":"2024-09-11T07:09:06.172023+0000","last_clean":"2024-09-11T07:09:06.172023+0000","last_became_active":"2024-09-11T07:08:08.035491+0000","last_became_peered":"2024-09-11T07:08:08.035491+0000","last_unstale":"2024-09-11T07:09:06.172023+0000","last_undegraded":"2024-09-11T07:09:06.172023+0000","last_fullsized":"2024-09-11T07:09:06.172023+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:23.281269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"168'540","reported_seq":2961,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703091+0000","last_change":"2024-09-11T07:08:48.087759+0000","last_active":"2024-09-11T07:09:06.703091+0000","last_peered":"2024-09-11T07:09:06.703091+0000","last_clean":"2024-09-11T07:09:06.703091+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:09:06.703091+0000","last_undegraded":"2024-09-11T07:09:06.703091+0000","last_fullsized":"2024-09-11T07:09:06.703091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:05.015024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042550620000000004,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3092,"num_read_kb":8737,"num_write":637,"num_write_kb":5048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"168'738","reported_seq":4496,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173437+0000","last_change":"2024-09-11T07:09:02.152239+0000","last_active":"2024-09-11T07:09:06.173437+0000","last_peered":"2024-09-11T07:09:06.173437+0000","last_clean":"2024-09-11T07:09:06.173437+0000","last_became_active":"2024-09-11T07:09:02.147735+0000","last_became_peered":"2024-09-11T07:09:02.147735+0000","last_unstale":"2024-09-11T07:09:06.173437+0000","last_undegraded":"2024-09-11T07:09:06.173437+0000","last_fullsized":"2024-09-11T07:09:06.173437+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:14.396794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020874370000000001,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":24,"num_read":5018,"num_read_kb":11581,"num_write":787,"num_write_kb":11396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":7952009,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":352,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702790+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:09:06.702790+0000","last_peered":"2024-09-11T07:09:06.702790+0000","last_clean":"2024-09-11T07:09:06.702790+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:09:06.702790+0000","last_undegraded":"2024-09-11T07:09:06.702790+0000","last_fullsized":"2024-09-11T07:09:06.702790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"168'683","reported_seq":5241,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171860+0000","last_change":"2024-09-11T07:08:48.077928+0000","last_active":"2024-09-11T07:09:06.171860+0000","last_peered":"2024-09-11T07:09:06.171860+0000","last_clean":"2024-09-11T07:09:06.171860+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:09:06.171860+0000","last_undegraded":"2024-09-11T07:09:06.171860+0000","last_fullsized":"2024-09-11T07:09:06.171860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:11.799895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011597129999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5953,"num_read_kb":41533,"num_write":674,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":351,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.731446+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:09:07.731446+0000","last_peered":"2024-09-11T07:09:07.731446+0000","last_clean":"2024-09-11T07:09:07.731446+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:09:07.731446+0000","last_undegraded":"2024-09-11T07:09:07.731446+0000","last_fullsized":"2024-09-11T07:09:07.731446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'472","reported_seq":8833,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188231+0000","last_change":"2024-09-11T07:08:55.866882+0000","last_active":"2024-09-11T07:09:07.188231+0000","last_peered":"2024-09-11T07:09:07.188231+0000","last_clean":"2024-09-11T07:09:07.188231+0000","last_became_active":"2024-09-11T07:08:55.865598+0000","last_became_peered":"2024-09-11T07:08:55.865598+0000","last_unstale":"2024-09-11T07:09:07.188231+0000","last_undegraded":"2024-09-11T07:09:07.188231+0000","last_fullsized":"2024-09-11T07:09:07.188231+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:43.022711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012557989999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":8865,"num_read_kb":33202,"num_write":482,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":323,"num_bytes_recovered":61422801,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188279+0000","last_change":"2024-09-11T07:08:08.034045+0000","last_active":"2024-09-11T07:09:07.188279+0000","last_peered":"2024-09-11T07:09:07.188279+0000","last_clean":"2024-09-11T07:09:07.188279+0000","last_became_active":"2024-09-11T07:08:08.033145+0000","last_became_peered":"2024-09-11T07:08:08.033145+0000","last_unstale":"2024-09-11T07:09:07.188279+0000","last_undegraded":"2024-09-11T07:09:07.188279+0000","last_fullsized":"2024-09-11T07:09:07.188279+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:23:05.963512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"167'462","reported_seq":5352,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616776+0000","last_change":"2024-09-11T07:08:48.202029+0000","last_active":"2024-09-11T07:09:06.616776+0000","last_peered":"2024-09-11T07:09:06.616776+0000","last_clean":"2024-09-11T07:09:06.616776+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:09:06.616776+0000","last_undegraded":"2024-09-11T07:09:06.616776+0000","last_fullsized":"2024-09-11T07:09:06.616776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:28.720201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018328699999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5357,"num_read_kb":20493,"num_write":487,"num_write_kb":10685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":351,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702781+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:09:06.702781+0000","last_peered":"2024-09-11T07:09:06.702781+0000","last_clean":"2024-09-11T07:09:06.702781+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:09:06.702781+0000","last_undegraded":"2024-09-11T07:09:06.702781+0000","last_fullsized":"2024-09-11T07:09:06.702781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":529,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187056+0000","last_change":"2024-09-11T07:08:13.093650+0000","last_active":"2024-09-11T07:09:07.187056+0000","last_peered":"2024-09-11T07:09:07.187056+0000","last_clean":"2024-09-11T07:09:07.187056+0000","last_became_active":"2024-09-11T07:08:13.085823+0000","last_became_peered":"2024-09-11T07:08:13.085823+0000","last_unstale":"2024-09-11T07:09:07.187056+0000","last_undegraded":"2024-09-11T07:09:07.187056+0000","last_fullsized":"2024-09-11T07:09:07.187056+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:40.664683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"168'417","reported_seq":3550,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616659+0000","last_change":"2024-09-11T07:08:48.202051+0000","last_active":"2024-09-11T07:09:06.616659+0000","last_peered":"2024-09-11T07:09:06.616659+0000","last_clean":"2024-09-11T07:09:06.616659+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:09:06.616659+0000","last_undegraded":"2024-09-11T07:09:06.616659+0000","last_fullsized":"2024-09-11T07:09:06.616659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:43.653964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886642,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3136,"num_read_kb":12190,"num_write":362,"num_write_kb":7014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'299","reported_seq":2285,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173312+0000","last_change":"2024-09-11T07:09:02.151236+0000","last_active":"2024-09-11T07:09:06.173312+0000","last_peered":"2024-09-11T07:09:06.173312+0000","last_clean":"2024-09-11T07:09:06.173312+0000","last_became_active":"2024-09-11T07:09:02.146228+0000","last_became_peered":"2024-09-11T07:09:02.146228+0000","last_unstale":"2024-09-11T07:09:06.173312+0000","last_undegraded":"2024-09-11T07:09:06.173312+0000","last_fullsized":"2024-09-11T07:09:06.173312+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:06:14.189857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010147260000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":1603,"num_read_kb":8035,"num_write":242,"num_write_kb":8539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":4236596,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"167'604","reported_seq":5585,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187660+0000","last_change":"2024-09-11T07:09:06.177501+0000","last_active":"2024-09-11T07:09:07.187660+0000","last_peered":"2024-09-11T07:09:07.187660+0000","last_clean":"2024-09-11T07:09:07.187660+0000","last_became_active":"2024-09-11T07:09:06.175303+0000","last_became_peered":"2024-09-11T07:09:06.175303+0000","last_unstale":"2024-09-11T07:09:07.187660+0000","last_undegraded":"2024-09-11T07:09:07.187660+0000","last_fullsized":"2024-09-11T07:09:07.187660+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:00.818882+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0083757740000000008,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":7105,"num_read_kb":12374,"num_write":638,"num_write_kb":6832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":288,"num_bytes_recovered":4540944,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"167'554","reported_seq":3894,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616774+0000","last_change":"2024-09-11T07:08:48.202794+0000","last_active":"2024-09-11T07:09:06.616774+0000","last_peered":"2024-09-11T07:09:06.616774+0000","last_clean":"2024-09-11T07:09:06.616774+0000","last_became_active":"2024-09-11T07:08:13.094279+0000","last_became_peered":"2024-09-11T07:08:13.094279+0000","last_unstale":"2024-09-11T07:09:06.616774+0000","last_undegraded":"2024-09-11T07:09:06.616774+0000","last_fullsized":"2024-09-11T07:09:06.616774+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:05:19.294505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022690100000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5323,"num_read_kb":21130,"num_write":584,"num_write_kb":14713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":42089319,"num_keys_recovered":120,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"167'374","reported_seq":3081,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702834+0000","last_change":"2024-09-11T07:08:48.086616+0000","last_active":"2024-09-11T07:09:06.702834+0000","last_peered":"2024-09-11T07:09:06.702834+0000","last_clean":"2024-09-11T07:09:06.702834+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:09:06.702834+0000","last_undegraded":"2024-09-11T07:09:06.702834+0000","last_fullsized":"2024-09-11T07:09:06.702834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:14.712547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032901720000000001,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":2243,"num_read_kb":7360,"num_write":303,"num_write_kb":6081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"166'472","reported_seq":4057,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187174+0000","last_change":"2024-09-11T07:08:48.077078+0000","last_active":"2024-09-11T07:09:07.187174+0000","last_peered":"2024-09-11T07:09:07.187174+0000","last_clean":"2024-09-11T07:09:07.187174+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:09:07.187174+0000","last_undegraded":"2024-09-11T07:09:07.187174+0000","last_fullsized":"2024-09-11T07:09:07.187174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:01.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048801529999999999,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":5047,"num_read_kb":19575,"num_write":443,"num_write_kb":9370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"168'510","reported_seq":3756,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187328+0000","last_change":"2024-09-11T07:08:54.863283+0000","last_active":"2024-09-11T07:09:07.187328+0000","last_peered":"2024-09-11T07:09:07.187328+0000","last_clean":"2024-09-11T07:09:07.187328+0000","last_became_active":"2024-09-11T07:08:54.860099+0000","last_became_peered":"2024-09-11T07:08:54.860099+0000","last_unstale":"2024-09-11T07:09:07.187328+0000","last_undegraded":"2024-09-11T07:09:07.187328+0000","last_fullsized":"2024-09-11T07:09:07.187328+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:28:05.233558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058914980000000002,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5468,"num_read_kb":40931,"num_write":483,"num_write_kb":33825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":29182336,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'908","reported_seq":5692,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187215+0000","last_change":"2024-09-11T07:08:59.860723+0000","last_active":"2024-09-11T07:09:07.187215+0000","last_peered":"2024-09-11T07:09:07.187215+0000","last_clean":"2024-09-11T07:09:07.187215+0000","last_became_active":"2024-09-11T07:08:59.857371+0000","last_became_peered":"2024-09-11T07:08:59.857371+0000","last_unstale":"2024-09-11T07:09:07.187215+0000","last_undegraded":"2024-09-11T07:09:07.187215+0000","last_fullsized":"2024-09-11T07:09:07.187215+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:39.427043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037300609999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7268,"num_read_kb":23165,"num_write":1135,"num_write_kb":16436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":309,"num_bytes_recovered":38565066,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"164'1332","reported_seq":3550,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:48.072601+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:12.088833+0000","last_became_peered":"2024-09-11T07:08:12.088833+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:10.966554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025943210000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7126,"num_read_kb":16929,"num_write":1954,"num_write_kb":15903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":5558122,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"166'305","reported_seq":4432,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:57.881661+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:57.878966+0000","last_became_peered":"2024-09-11T07:08:57.878966+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:57:28.004494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030609069999999999,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":3180,"num_read_kb":9248,"num_write":258,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":2139720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"168'502","reported_seq":6667,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188231+0000","last_change":"2024-09-11T07:08:48.121587+0000","last_active":"2024-09-11T07:09:07.188231+0000","last_peered":"2024-09-11T07:09:07.188231+0000","last_clean":"2024-09-11T07:09:07.188231+0000","last_became_active":"2024-09-11T07:08:12.092494+0000","last_became_peered":"2024-09-11T07:08:12.092494+0000","last_unstale":"2024-09-11T07:09:07.188231+0000","last_undegraded":"2024-09-11T07:09:07.188231+0000","last_fullsized":"2024-09-11T07:09:07.188231+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:18:59.887309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011861700000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":6702,"num_read_kb":31801,"num_write":602,"num_write_kb":10266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":13150126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"166'597","reported_seq":3338,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187361+0000","last_change":"2024-09-11T07:08:58.859305+0000","last_active":"2024-09-11T07:09:07.187361+0000","last_peered":"2024-09-11T07:09:07.187361+0000","last_clean":"2024-09-11T07:09:07.187361+0000","last_became_active":"2024-09-11T07:08:58.856080+0000","last_became_peered":"2024-09-11T07:08:58.856080+0000","last_unstale":"2024-09-11T07:09:07.187361+0000","last_undegraded":"2024-09-11T07:09:07.187361+0000","last_fullsized":"2024-09-11T07:09:07.187361+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:44.826014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019838210000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3601,"num_read_kb":5499,"num_write":635,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":826886,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":952,"num_object_clones":0,"num_object_copies":1904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":952,"num_whiteouts":948,"num_read":171813,"num_read_kb":628353,"num_write":19992,"num_write_kb":415358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4495,"num_bytes_recovered":292360160,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18509,"ondisk_log_size":18509,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":19129,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47332,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324508,"statfs":{"total":96636764160,"available":96588296192,"internally_reserved":0,"allocated":2301952,"data_stored":1675772,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":46135753},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33380,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338460,"statfs":{"total":96636764160,"available":96602583040,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59744,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312096,"statfs":{"total":96636764160,"available":96575586304,"internally_reserved":0,"allocated":2236416,"data_stored":1079581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":58915268},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51420,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320420,"statfs":{"total":96636764160,"available":96584110080,"internally_reserved":0,"allocated":2236416,"data_stored":1079581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2232320,"data_stored":1079562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41700,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330140,"statfs":{"total":96636764160,"available":96594063360,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55584,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316256,"statfs":{"total":96636764160,"available":96579846144,"internally_reserved":0,"allocated":2240512,"data_stored":1079600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55632,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316208,"statfs":{"total":96636764160,"available":96579796992,"internally_reserved":0,"allocated":2285568,"data_stored":1675772,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:09:12.245 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-09-11T07:09:12.246 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-09-11T07:09:12.553 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-11T07:09:12.562 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-11T07:09:12.562 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:09:12.834 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:09:12.835 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:09:12.850 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-11T07:09:11.867482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":956,"num_object_clones":0,"num_object_copies":1912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":956,"num_whiteouts":948,"num_read":171929,"num_read_kb":628453,"num_write":20153,"num_write_kb":417776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4499,"num_bytes_recovered":293540896,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18629,"ondisk_log_size":18629,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400368,"kb_used_data":17600,"kb_used_omap":12,"kb_used_meta":382579,"kb_avail":754574352,"statfs":{"total":773094113280,"available":772684136448,"internally_reserved":0,"allocated":18022400,"data_stored":9840676,"data_compressed":12474,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":12760,"internal_metadata":391761448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.711104"},"pg_stats":[{"pgid":"3.1f","version":"168'468","reported_seq":3070,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.189047+0000","last_change":"2024-09-11T07:08:48.123890+0000","last_active":"2024-09-11T07:09:07.189047+0000","last_peered":"2024-09-11T07:09:07.189047+0000","last_clean":"2024-09-11T07:09:07.189047+0000","last_became_active":"2024-09-11T07:08:13.087864+0000","last_became_peered":"2024-09-11T07:08:13.087864+0000","last_unstale":"2024-09-11T07:09:07.189047+0000","last_undegraded":"2024-09-11T07:09:07.189047+0000","last_fullsized":"2024-09-11T07:09:07.189047+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:15:41.981140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028069940000000002,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2694,"num_read_kb":5154,"num_write":552,"num_write_kb":22529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":3432884,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'412","reported_seq":2205,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616940+0000","last_change":"2024-09-11T07:08:48.203786+0000","last_active":"2024-09-11T07:09:06.616940+0000","last_peered":"2024-09-11T07:09:06.616940+0000","last_clean":"2024-09-11T07:09:06.616940+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:09:06.616940+0000","last_undegraded":"2024-09-11T07:09:06.616940+0000","last_fullsized":"2024-09-11T07:09:06.616940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:36.315451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028533249999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":1677,"num_read_kb":19454,"num_write":399,"num_write_kb":12631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"165'649","reported_seq":12980,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703100+0000","last_change":"2024-09-11T07:08:55.868195+0000","last_active":"2024-09-11T07:09:06.703100+0000","last_peered":"2024-09-11T07:09:06.703100+0000","last_clean":"2024-09-11T07:09:06.703100+0000","last_became_active":"2024-09-11T07:08:55.865799+0000","last_became_peered":"2024-09-11T07:08:55.865799+0000","last_unstale":"2024-09-11T07:09:06.703100+0000","last_undegraded":"2024-09-11T07:09:06.703100+0000","last_fullsized":"2024-09-11T07:09:06.703100+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:49:41.498042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019228699999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":13982,"num_read_kb":66796,"num_write":768,"num_write_kb":14794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":5987441,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"168'909","reported_seq":4677,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702821+0000","last_change":"2024-09-11T07:08:57.885182+0000","last_active":"2024-09-11T07:09:06.702821+0000","last_peered":"2024-09-11T07:09:06.702821+0000","last_clean":"2024-09-11T07:09:06.702821+0000","last_became_active":"2024-09-11T07:08:57.881857+0000","last_became_peered":"2024-09-11T07:08:57.881857+0000","last_unstale":"2024-09-11T07:09:06.702821+0000","last_undegraded":"2024-09-11T07:09:06.702821+0000","last_fullsized":"2024-09-11T07:09:06.702821+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:28:07.362960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021881650000000002,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":5039,"num_read_kb":16054,"num_write":1190,"num_write_kb":13844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":6996622,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'539","reported_seq":6881,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188813+0000","last_change":"2024-09-11T07:08:57.881662+0000","last_active":"2024-09-11T07:09:07.188813+0000","last_peered":"2024-09-11T07:09:07.188813+0000","last_clean":"2024-09-11T07:09:07.188813+0000","last_became_active":"2024-09-11T07:08:57.880103+0000","last_became_peered":"2024-09-11T07:08:57.880103+0000","last_unstale":"2024-09-11T07:09:07.188813+0000","last_undegraded":"2024-09-11T07:09:07.188813+0000","last_fullsized":"2024-09-11T07:09:07.188813+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:54.645362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025371069999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":8318,"num_read_kb":11321,"num_write":542,"num_write_kb":4670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":4425669,"num_keys_recovered":47,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"163'520","reported_seq":5071,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173410+0000","last_change":"2024-09-11T07:09:02.150715+0000","last_active":"2024-09-11T07:09:06.173410+0000","last_peered":"2024-09-11T07:09:06.173410+0000","last_clean":"2024-09-11T07:09:06.173410+0000","last_became_active":"2024-09-11T07:09:02.145138+0000","last_became_peered":"2024-09-11T07:09:02.145138+0000","last_unstale":"2024-09-11T07:09:06.173410+0000","last_undegraded":"2024-09-11T07:09:06.173410+0000","last_fullsized":"2024-09-11T07:09:06.173410+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:02:56.439518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024466639999999999,"stat_sum":{"num_bytes":19,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":41,"num_read":6616,"num_read_kb":11567,"num_write":528,"num_write_kb":10022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":3177242,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"168'483","reported_seq":2146,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171830+0000","last_change":"2024-09-11T07:08:48.078593+0000","last_active":"2024-09-11T07:09:06.171830+0000","last_peered":"2024-09-11T07:09:06.171830+0000","last_clean":"2024-09-11T07:09:06.171830+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:09:06.171830+0000","last_undegraded":"2024-09-11T07:09:06.171830+0000","last_fullsized":"2024-09-11T07:09:06.171830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:35.663171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016777719999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2274,"num_read_kb":6232,"num_write":578,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"167'723","reported_seq":4881,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616636+0000","last_change":"2024-09-11T07:08:48.201459+0000","last_active":"2024-09-11T07:09:06.616636+0000","last_peered":"2024-09-11T07:09:06.616636+0000","last_clean":"2024-09-11T07:09:06.616636+0000","last_became_active":"2024-09-11T07:08:14.106879+0000","last_became_peered":"2024-09-11T07:08:14.106879+0000","last_unstale":"2024-09-11T07:09:06.616636+0000","last_undegraded":"2024-09-11T07:09:06.616636+0000","last_fullsized":"2024-09-11T07:09:06.616636+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:07.608483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013481490000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6716,"num_read_kb":13771,"num_write":714,"num_write_kb":21799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":9689178,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"162'445","reported_seq":6684,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188867+0000","last_change":"2024-09-11T07:08:48.122544+0000","last_active":"2024-09-11T07:09:07.188867+0000","last_peered":"2024-09-11T07:09:07.188867+0000","last_clean":"2024-09-11T07:09:07.188867+0000","last_became_active":"2024-09-11T07:08:21.855245+0000","last_became_peered":"2024-09-11T07:08:21.855245+0000","last_unstale":"2024-09-11T07:09:07.188867+0000","last_undegraded":"2024-09-11T07:09:07.188867+0000","last_fullsized":"2024-09-11T07:09:07.188867+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:49:30.408153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020224750000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":6674,"num_read_kb":41299,"num_write":387,"num_write_kb":21088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":28975126,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"168'688","reported_seq":4228,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703013+0000","last_change":"2024-09-11T07:08:48.086510+0000","last_active":"2024-09-11T07:09:06.703013+0000","last_peered":"2024-09-11T07:09:06.703013+0000","last_clean":"2024-09-11T07:09:06.703013+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:09:06.703013+0000","last_undegraded":"2024-09-11T07:09:06.703013+0000","last_fullsized":"2024-09-11T07:09:06.703013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:32:02.395296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033666669999999998,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5507,"num_read_kb":16321,"num_write":723,"num_write_kb":8687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'483","reported_seq":4221,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187154+0000","last_change":"2024-09-11T07:08:48.076124+0000","last_active":"2024-09-11T07:09:07.187154+0000","last_peered":"2024-09-11T07:09:07.187154+0000","last_clean":"2024-09-11T07:09:07.187154+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:09:07.187154+0000","last_undegraded":"2024-09-11T07:09:07.187154+0000","last_fullsized":"2024-09-11T07:09:07.187154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:09.463660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041864520000000002,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4880,"num_read_kb":24721,"num_write":443,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"168'598","reported_seq":4851,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173739+0000","last_change":"2024-09-11T07:09:02.153702+0000","last_active":"2024-09-11T07:09:06.173739+0000","last_peered":"2024-09-11T07:09:06.173739+0000","last_clean":"2024-09-11T07:09:06.173739+0000","last_became_active":"2024-09-11T07:09:02.149433+0000","last_became_peered":"2024-09-11T07:09:02.149433+0000","last_unstale":"2024-09-11T07:09:06.173739+0000","last_undegraded":"2024-09-11T07:09:06.173739+0000","last_fullsized":"2024-09-11T07:09:06.173739+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:41.039056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001012333,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6911,"num_read_kb":17769,"num_write":573,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":3955769,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":263,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186748+0000","last_change":"2024-09-11T07:07:24.114928+0000","last_active":"2024-09-11T07:09:07.186748+0000","last_peered":"2024-09-11T07:09:07.186748+0000","last_clean":"2024-09-11T07:09:07.186748+0000","last_became_active":"2024-09-11T07:07:24.114181+0000","last_became_peered":"2024-09-11T07:07:24.114181+0000","last_unstale":"2024-09-11T07:09:07.186748+0000","last_undegraded":"2024-09-11T07:09:07.186748+0000","last_fullsized":"2024-09-11T07:09:07.186748+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:03.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"168'628","reported_seq":4054,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188734+0000","last_change":"2024-09-11T07:08:48.123105+0000","last_active":"2024-09-11T07:09:07.188734+0000","last_peered":"2024-09-11T07:09:07.188734+0000","last_clean":"2024-09-11T07:09:07.188734+0000","last_became_active":"2024-09-11T07:08:11.076673+0000","last_became_peered":"2024-09-11T07:08:11.076673+0000","last_unstale":"2024-09-11T07:09:07.188734+0000","last_undegraded":"2024-09-11T07:09:07.188734+0000","last_fullsized":"2024-09-11T07:09:07.188734+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:17:38.398538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024495049999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":4338,"num_read_kb":14044,"num_write":542,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":16056304,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":348,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.172090+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:09:06.172090+0000","last_peered":"2024-09-11T07:09:06.172090+0000","last_clean":"2024-09-11T07:09:06.172090+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:09:06.172090+0000","last_undegraded":"2024-09-11T07:09:06.172090+0000","last_fullsized":"2024-09-11T07:09:06.172090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"166'680","reported_seq":2593,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616923+0000","last_change":"2024-09-11T07:08:48.203453+0000","last_active":"2024-09-11T07:09:06.616923+0000","last_peered":"2024-09-11T07:09:06.616923+0000","last_clean":"2024-09-11T07:09:06.616923+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:09:06.616923+0000","last_undegraded":"2024-09-11T07:09:06.616923+0000","last_fullsized":"2024-09-11T07:09:06.616923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:28.692608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023129169999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4034,"num_read_kb":11596,"num_write":855,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187457+0000","last_change":"2024-09-11T07:08:08.034462+0000","last_active":"2024-09-11T07:09:07.187457+0000","last_peered":"2024-09-11T07:09:07.187457+0000","last_clean":"2024-09-11T07:09:07.187457+0000","last_became_active":"2024-09-11T07:08:08.033647+0000","last_became_peered":"2024-09-11T07:08:08.033647+0000","last_unstale":"2024-09-11T07:09:07.187457+0000","last_undegraded":"2024-09-11T07:09:07.187457+0000","last_fullsized":"2024-09-11T07:09:07.187457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:34:57.644981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"165'515","reported_seq":5204,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171863+0000","last_change":"2024-09-11T07:08:48.079207+0000","last_active":"2024-09-11T07:09:06.171863+0000","last_peered":"2024-09-11T07:09:06.171863+0000","last_clean":"2024-09-11T07:09:06.171863+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:09:06.171863+0000","last_undegraded":"2024-09-11T07:09:06.171863+0000","last_fullsized":"2024-09-11T07:09:06.171863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:16.525589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002205477,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6066,"num_read_kb":28471,"num_write":492,"num_write_kb":12910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":358,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.172023+0000","last_change":"2024-09-11T07:08:08.036204+0000","last_active":"2024-09-11T07:09:06.172023+0000","last_peered":"2024-09-11T07:09:06.172023+0000","last_clean":"2024-09-11T07:09:06.172023+0000","last_became_active":"2024-09-11T07:08:08.035491+0000","last_became_peered":"2024-09-11T07:08:08.035491+0000","last_unstale":"2024-09-11T07:09:06.172023+0000","last_undegraded":"2024-09-11T07:09:06.172023+0000","last_fullsized":"2024-09-11T07:09:06.172023+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:23.281269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"168'540","reported_seq":2961,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703091+0000","last_change":"2024-09-11T07:08:48.087759+0000","last_active":"2024-09-11T07:09:06.703091+0000","last_peered":"2024-09-11T07:09:06.703091+0000","last_clean":"2024-09-11T07:09:06.703091+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:09:06.703091+0000","last_undegraded":"2024-09-11T07:09:06.703091+0000","last_fullsized":"2024-09-11T07:09:06.703091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:05.015024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042550620000000004,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3092,"num_read_kb":8737,"num_write":637,"num_write_kb":5048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"168'738","reported_seq":4496,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173437+0000","last_change":"2024-09-11T07:09:02.152239+0000","last_active":"2024-09-11T07:09:06.173437+0000","last_peered":"2024-09-11T07:09:06.173437+0000","last_clean":"2024-09-11T07:09:06.173437+0000","last_became_active":"2024-09-11T07:09:02.147735+0000","last_became_peered":"2024-09-11T07:09:02.147735+0000","last_unstale":"2024-09-11T07:09:06.173437+0000","last_undegraded":"2024-09-11T07:09:06.173437+0000","last_fullsized":"2024-09-11T07:09:06.173437+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:14.396794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020874370000000001,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":24,"num_read":5018,"num_read_kb":11581,"num_write":787,"num_write_kb":11396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":7952009,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":352,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702790+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:09:06.702790+0000","last_peered":"2024-09-11T07:09:06.702790+0000","last_clean":"2024-09-11T07:09:06.702790+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:09:06.702790+0000","last_undegraded":"2024-09-11T07:09:06.702790+0000","last_fullsized":"2024-09-11T07:09:06.702790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"168'683","reported_seq":5241,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171860+0000","last_change":"2024-09-11T07:08:48.077928+0000","last_active":"2024-09-11T07:09:06.171860+0000","last_peered":"2024-09-11T07:09:06.171860+0000","last_clean":"2024-09-11T07:09:06.171860+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:09:06.171860+0000","last_undegraded":"2024-09-11T07:09:06.171860+0000","last_fullsized":"2024-09-11T07:09:06.171860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:11.799895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011597129999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5953,"num_read_kb":41533,"num_write":674,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":351,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.731446+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:09:07.731446+0000","last_peered":"2024-09-11T07:09:07.731446+0000","last_clean":"2024-09-11T07:09:07.731446+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:09:07.731446+0000","last_undegraded":"2024-09-11T07:09:07.731446+0000","last_fullsized":"2024-09-11T07:09:07.731446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'472","reported_seq":8833,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188231+0000","last_change":"2024-09-11T07:08:55.866882+0000","last_active":"2024-09-11T07:09:07.188231+0000","last_peered":"2024-09-11T07:09:07.188231+0000","last_clean":"2024-09-11T07:09:07.188231+0000","last_became_active":"2024-09-11T07:08:55.865598+0000","last_became_peered":"2024-09-11T07:08:55.865598+0000","last_unstale":"2024-09-11T07:09:07.188231+0000","last_undegraded":"2024-09-11T07:09:07.188231+0000","last_fullsized":"2024-09-11T07:09:07.188231+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:43.022711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012557989999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":8865,"num_read_kb":33202,"num_write":482,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":323,"num_bytes_recovered":61422801,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188279+0000","last_change":"2024-09-11T07:08:08.034045+0000","last_active":"2024-09-11T07:09:07.188279+0000","last_peered":"2024-09-11T07:09:07.188279+0000","last_clean":"2024-09-11T07:09:07.188279+0000","last_became_active":"2024-09-11T07:08:08.033145+0000","last_became_peered":"2024-09-11T07:08:08.033145+0000","last_unstale":"2024-09-11T07:09:07.188279+0000","last_undegraded":"2024-09-11T07:09:07.188279+0000","last_fullsized":"2024-09-11T07:09:07.188279+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:23:05.963512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"167'462","reported_seq":5352,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616776+0000","last_change":"2024-09-11T07:08:48.202029+0000","last_active":"2024-09-11T07:09:06.616776+0000","last_peered":"2024-09-11T07:09:06.616776+0000","last_clean":"2024-09-11T07:09:06.616776+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:09:06.616776+0000","last_undegraded":"2024-09-11T07:09:06.616776+0000","last_fullsized":"2024-09-11T07:09:06.616776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:28.720201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018328699999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5357,"num_read_kb":20493,"num_write":487,"num_write_kb":10685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":351,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702781+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:09:06.702781+0000","last_peered":"2024-09-11T07:09:06.702781+0000","last_clean":"2024-09-11T07:09:06.702781+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:09:06.702781+0000","last_undegraded":"2024-09-11T07:09:06.702781+0000","last_fullsized":"2024-09-11T07:09:06.702781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":529,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187056+0000","last_change":"2024-09-11T07:08:13.093650+0000","last_active":"2024-09-11T07:09:07.187056+0000","last_peered":"2024-09-11T07:09:07.187056+0000","last_clean":"2024-09-11T07:09:07.187056+0000","last_became_active":"2024-09-11T07:08:13.085823+0000","last_became_peered":"2024-09-11T07:08:13.085823+0000","last_unstale":"2024-09-11T07:09:07.187056+0000","last_undegraded":"2024-09-11T07:09:07.187056+0000","last_fullsized":"2024-09-11T07:09:07.187056+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:40.664683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"168'417","reported_seq":3550,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616659+0000","last_change":"2024-09-11T07:08:48.202051+0000","last_active":"2024-09-11T07:09:06.616659+0000","last_peered":"2024-09-11T07:09:06.616659+0000","last_clean":"2024-09-11T07:09:06.616659+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:09:06.616659+0000","last_undegraded":"2024-09-11T07:09:06.616659+0000","last_fullsized":"2024-09-11T07:09:06.616659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:43.653964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886642,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3136,"num_read_kb":12190,"num_write":362,"num_write_kb":7014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'299","reported_seq":2285,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173312+0000","last_change":"2024-09-11T07:09:02.151236+0000","last_active":"2024-09-11T07:09:06.173312+0000","last_peered":"2024-09-11T07:09:06.173312+0000","last_clean":"2024-09-11T07:09:06.173312+0000","last_became_active":"2024-09-11T07:09:02.146228+0000","last_became_peered":"2024-09-11T07:09:02.146228+0000","last_unstale":"2024-09-11T07:09:06.173312+0000","last_undegraded":"2024-09-11T07:09:06.173312+0000","last_fullsized":"2024-09-11T07:09:06.173312+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:06:14.189857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010147260000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":1603,"num_read_kb":8035,"num_write":242,"num_write_kb":8539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":4236596,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"167'604","reported_seq":5585,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187660+0000","last_change":"2024-09-11T07:09:06.177501+0000","last_active":"2024-09-11T07:09:07.187660+0000","last_peered":"2024-09-11T07:09:07.187660+0000","last_clean":"2024-09-11T07:09:07.187660+0000","last_became_active":"2024-09-11T07:09:06.175303+0000","last_became_peered":"2024-09-11T07:09:06.175303+0000","last_unstale":"2024-09-11T07:09:07.187660+0000","last_undegraded":"2024-09-11T07:09:07.187660+0000","last_fullsized":"2024-09-11T07:09:07.187660+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:00.818882+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0083757740000000008,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":7105,"num_read_kb":12374,"num_write":638,"num_write_kb":6832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":288,"num_bytes_recovered":4540944,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"167'554","reported_seq":3894,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616774+0000","last_change":"2024-09-11T07:08:48.202794+0000","last_active":"2024-09-11T07:09:06.616774+0000","last_peered":"2024-09-11T07:09:06.616774+0000","last_clean":"2024-09-11T07:09:06.616774+0000","last_became_active":"2024-09-11T07:08:13.094279+0000","last_became_peered":"2024-09-11T07:08:13.094279+0000","last_unstale":"2024-09-11T07:09:06.616774+0000","last_undegraded":"2024-09-11T07:09:06.616774+0000","last_fullsized":"2024-09-11T07:09:06.616774+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:05:19.294505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022690100000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5323,"num_read_kb":21130,"num_write":584,"num_write_kb":14713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":42089319,"num_keys_recovered":120,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"167'374","reported_seq":3081,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702834+0000","last_change":"2024-09-11T07:08:48.086616+0000","last_active":"2024-09-11T07:09:06.702834+0000","last_peered":"2024-09-11T07:09:06.702834+0000","last_clean":"2024-09-11T07:09:06.702834+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:09:06.702834+0000","last_undegraded":"2024-09-11T07:09:06.702834+0000","last_fullsized":"2024-09-11T07:09:06.702834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:14.712547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032901720000000001,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":2243,"num_read_kb":7360,"num_write":303,"num_write_kb":6081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"166'472","reported_seq":4057,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187174+0000","last_change":"2024-09-11T07:08:48.077078+0000","last_active":"2024-09-11T07:09:07.187174+0000","last_peered":"2024-09-11T07:09:07.187174+0000","last_clean":"2024-09-11T07:09:07.187174+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:09:07.187174+0000","last_undegraded":"2024-09-11T07:09:07.187174+0000","last_fullsized":"2024-09-11T07:09:07.187174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:01.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048801529999999999,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":5047,"num_read_kb":19575,"num_write":443,"num_write_kb":9370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"168'510","reported_seq":3756,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187328+0000","last_change":"2024-09-11T07:08:54.863283+0000","last_active":"2024-09-11T07:09:07.187328+0000","last_peered":"2024-09-11T07:09:07.187328+0000","last_clean":"2024-09-11T07:09:07.187328+0000","last_became_active":"2024-09-11T07:08:54.860099+0000","last_became_peered":"2024-09-11T07:08:54.860099+0000","last_unstale":"2024-09-11T07:09:07.187328+0000","last_undegraded":"2024-09-11T07:09:07.187328+0000","last_fullsized":"2024-09-11T07:09:07.187328+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:28:05.233558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058914980000000002,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5468,"num_read_kb":40931,"num_write":483,"num_write_kb":33825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":29182336,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'908","reported_seq":5692,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187215+0000","last_change":"2024-09-11T07:08:59.860723+0000","last_active":"2024-09-11T07:09:07.187215+0000","last_peered":"2024-09-11T07:09:07.187215+0000","last_clean":"2024-09-11T07:09:07.187215+0000","last_became_active":"2024-09-11T07:08:59.857371+0000","last_became_peered":"2024-09-11T07:08:59.857371+0000","last_unstale":"2024-09-11T07:09:07.187215+0000","last_undegraded":"2024-09-11T07:09:07.187215+0000","last_fullsized":"2024-09-11T07:09:07.187215+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:39.427043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037300609999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7268,"num_read_kb":23165,"num_write":1135,"num_write_kb":16436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":309,"num_bytes_recovered":38565066,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"164'1332","reported_seq":3550,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:48.072601+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:12.088833+0000","last_became_peered":"2024-09-11T07:08:12.088833+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:10.966554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025943210000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7126,"num_read_kb":16929,"num_write":1954,"num_write_kb":15903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":5558122,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"166'305","reported_seq":4432,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:57.881661+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:57.878966+0000","last_became_peered":"2024-09-11T07:08:57.878966+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:57:28.004494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030609069999999999,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":3180,"num_read_kb":9248,"num_write":258,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":2139720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"168'502","reported_seq":6667,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188231+0000","last_change":"2024-09-11T07:08:48.121587+0000","last_active":"2024-09-11T07:09:07.188231+0000","last_peered":"2024-09-11T07:09:07.188231+0000","last_clean":"2024-09-11T07:09:07.188231+0000","last_became_active":"2024-09-11T07:08:12.092494+0000","last_became_peered":"2024-09-11T07:08:12.092494+0000","last_unstale":"2024-09-11T07:09:07.188231+0000","last_undegraded":"2024-09-11T07:09:07.188231+0000","last_fullsized":"2024-09-11T07:09:07.188231+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:18:59.887309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011861700000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":6702,"num_read_kb":31801,"num_write":602,"num_write_kb":10266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":13150126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"166'597","reported_seq":3338,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187361+0000","last_change":"2024-09-11T07:08:58.859305+0000","last_active":"2024-09-11T07:09:07.187361+0000","last_peered":"2024-09-11T07:09:07.187361+0000","last_clean":"2024-09-11T07:09:07.187361+0000","last_became_active":"2024-09-11T07:08:58.856080+0000","last_became_peered":"2024-09-11T07:08:58.856080+0000","last_unstale":"2024-09-11T07:09:07.187361+0000","last_undegraded":"2024-09-11T07:09:07.187361+0000","last_fullsized":"2024-09-11T07:09:07.187361+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:44.826014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019838210000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3601,"num_read_kb":5499,"num_write":635,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":826886,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":952,"num_object_clones":0,"num_object_copies":1904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":952,"num_whiteouts":948,"num_read":171813,"num_read_kb":628353,"num_write":19992,"num_write_kb":415358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4495,"num_bytes_recovered":292360160,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18509,"ondisk_log_size":18509,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":19129,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47332,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324508,"statfs":{"total":96636764160,"available":96588296192,"internally_reserved":0,"allocated":2301952,"data_stored":1675772,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":46135753},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33380,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338460,"statfs":{"total":96636764160,"available":96602583040,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59744,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312096,"statfs":{"total":96636764160,"available":96575586304,"internally_reserved":0,"allocated":2236416,"data_stored":1079581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":58915268},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51420,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320420,"statfs":{"total":96636764160,"available":96584110080,"internally_reserved":0,"allocated":2236416,"data_stored":1079581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2232320,"data_stored":1079562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41700,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330140,"statfs":{"total":96636764160,"available":96594063360,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55584,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316256,"statfs":{"total":96636764160,"available":96579846144,"internally_reserved":0,"allocated":2240512,"data_stored":1079600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55632,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316208,"statfs":{"total":96636764160,"available":96579796992,"internally_reserved":0,"allocated":2285568,"data_stored":1675772,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:09:12.852 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:09:13.130 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:09:13.131 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:09:13.147 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-11T07:09:11.867482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":956,"num_object_clones":0,"num_object_copies":1912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":956,"num_whiteouts":948,"num_read":171929,"num_read_kb":628453,"num_write":20153,"num_write_kb":417776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4499,"num_bytes_recovered":293540896,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18629,"ondisk_log_size":18629,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400368,"kb_used_data":17600,"kb_used_omap":12,"kb_used_meta":382579,"kb_avail":754574352,"statfs":{"total":773094113280,"available":772684136448,"internally_reserved":0,"allocated":18022400,"data_stored":9840676,"data_compressed":12474,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":12760,"internal_metadata":391761448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.711104"},"pg_stats":[{"pgid":"3.1f","version":"168'468","reported_seq":3070,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.189047+0000","last_change":"2024-09-11T07:08:48.123890+0000","last_active":"2024-09-11T07:09:07.189047+0000","last_peered":"2024-09-11T07:09:07.189047+0000","last_clean":"2024-09-11T07:09:07.189047+0000","last_became_active":"2024-09-11T07:08:13.087864+0000","last_became_peered":"2024-09-11T07:08:13.087864+0000","last_unstale":"2024-09-11T07:09:07.189047+0000","last_undegraded":"2024-09-11T07:09:07.189047+0000","last_fullsized":"2024-09-11T07:09:07.189047+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:15:41.981140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028069940000000002,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2694,"num_read_kb":5154,"num_write":552,"num_write_kb":22529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":3432884,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'412","reported_seq":2205,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616940+0000","last_change":"2024-09-11T07:08:48.203786+0000","last_active":"2024-09-11T07:09:06.616940+0000","last_peered":"2024-09-11T07:09:06.616940+0000","last_clean":"2024-09-11T07:09:06.616940+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:09:06.616940+0000","last_undegraded":"2024-09-11T07:09:06.616940+0000","last_fullsized":"2024-09-11T07:09:06.616940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:36.315451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028533249999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":1677,"num_read_kb":19454,"num_write":399,"num_write_kb":12631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"165'649","reported_seq":12980,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703100+0000","last_change":"2024-09-11T07:08:55.868195+0000","last_active":"2024-09-11T07:09:06.703100+0000","last_peered":"2024-09-11T07:09:06.703100+0000","last_clean":"2024-09-11T07:09:06.703100+0000","last_became_active":"2024-09-11T07:08:55.865799+0000","last_became_peered":"2024-09-11T07:08:55.865799+0000","last_unstale":"2024-09-11T07:09:06.703100+0000","last_undegraded":"2024-09-11T07:09:06.703100+0000","last_fullsized":"2024-09-11T07:09:06.703100+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:49:41.498042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019228699999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":13982,"num_read_kb":66796,"num_write":768,"num_write_kb":14794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":5987441,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"168'909","reported_seq":4677,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702821+0000","last_change":"2024-09-11T07:08:57.885182+0000","last_active":"2024-09-11T07:09:06.702821+0000","last_peered":"2024-09-11T07:09:06.702821+0000","last_clean":"2024-09-11T07:09:06.702821+0000","last_became_active":"2024-09-11T07:08:57.881857+0000","last_became_peered":"2024-09-11T07:08:57.881857+0000","last_unstale":"2024-09-11T07:09:06.702821+0000","last_undegraded":"2024-09-11T07:09:06.702821+0000","last_fullsized":"2024-09-11T07:09:06.702821+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:28:07.362960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021881650000000002,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":5039,"num_read_kb":16054,"num_write":1190,"num_write_kb":13844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":6996622,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'539","reported_seq":6881,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188813+0000","last_change":"2024-09-11T07:08:57.881662+0000","last_active":"2024-09-11T07:09:07.188813+0000","last_peered":"2024-09-11T07:09:07.188813+0000","last_clean":"2024-09-11T07:09:07.188813+0000","last_became_active":"2024-09-11T07:08:57.880103+0000","last_became_peered":"2024-09-11T07:08:57.880103+0000","last_unstale":"2024-09-11T07:09:07.188813+0000","last_undegraded":"2024-09-11T07:09:07.188813+0000","last_fullsized":"2024-09-11T07:09:07.188813+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:54.645362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025371069999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":8318,"num_read_kb":11321,"num_write":542,"num_write_kb":4670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":4425669,"num_keys_recovered":47,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"163'520","reported_seq":5071,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173410+0000","last_change":"2024-09-11T07:09:02.150715+0000","last_active":"2024-09-11T07:09:06.173410+0000","last_peered":"2024-09-11T07:09:06.173410+0000","last_clean":"2024-09-11T07:09:06.173410+0000","last_became_active":"2024-09-11T07:09:02.145138+0000","last_became_peered":"2024-09-11T07:09:02.145138+0000","last_unstale":"2024-09-11T07:09:06.173410+0000","last_undegraded":"2024-09-11T07:09:06.173410+0000","last_fullsized":"2024-09-11T07:09:06.173410+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:02:56.439518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024466639999999999,"stat_sum":{"num_bytes":19,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":41,"num_read":6616,"num_read_kb":11567,"num_write":528,"num_write_kb":10022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":3177242,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"168'483","reported_seq":2146,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171830+0000","last_change":"2024-09-11T07:08:48.078593+0000","last_active":"2024-09-11T07:09:06.171830+0000","last_peered":"2024-09-11T07:09:06.171830+0000","last_clean":"2024-09-11T07:09:06.171830+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:09:06.171830+0000","last_undegraded":"2024-09-11T07:09:06.171830+0000","last_fullsized":"2024-09-11T07:09:06.171830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:35.663171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016777719999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2274,"num_read_kb":6232,"num_write":578,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"167'723","reported_seq":4881,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616636+0000","last_change":"2024-09-11T07:08:48.201459+0000","last_active":"2024-09-11T07:09:06.616636+0000","last_peered":"2024-09-11T07:09:06.616636+0000","last_clean":"2024-09-11T07:09:06.616636+0000","last_became_active":"2024-09-11T07:08:14.106879+0000","last_became_peered":"2024-09-11T07:08:14.106879+0000","last_unstale":"2024-09-11T07:09:06.616636+0000","last_undegraded":"2024-09-11T07:09:06.616636+0000","last_fullsized":"2024-09-11T07:09:06.616636+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:07.608483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013481490000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6716,"num_read_kb":13771,"num_write":714,"num_write_kb":21799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":9689178,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"162'445","reported_seq":6684,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188867+0000","last_change":"2024-09-11T07:08:48.122544+0000","last_active":"2024-09-11T07:09:07.188867+0000","last_peered":"2024-09-11T07:09:07.188867+0000","last_clean":"2024-09-11T07:09:07.188867+0000","last_became_active":"2024-09-11T07:08:21.855245+0000","last_became_peered":"2024-09-11T07:08:21.855245+0000","last_unstale":"2024-09-11T07:09:07.188867+0000","last_undegraded":"2024-09-11T07:09:07.188867+0000","last_fullsized":"2024-09-11T07:09:07.188867+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:49:30.408153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020224750000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":6674,"num_read_kb":41299,"num_write":387,"num_write_kb":21088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":28975126,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"168'688","reported_seq":4228,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703013+0000","last_change":"2024-09-11T07:08:48.086510+0000","last_active":"2024-09-11T07:09:06.703013+0000","last_peered":"2024-09-11T07:09:06.703013+0000","last_clean":"2024-09-11T07:09:06.703013+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:09:06.703013+0000","last_undegraded":"2024-09-11T07:09:06.703013+0000","last_fullsized":"2024-09-11T07:09:06.703013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:32:02.395296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033666669999999998,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5507,"num_read_kb":16321,"num_write":723,"num_write_kb":8687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'483","reported_seq":4221,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187154+0000","last_change":"2024-09-11T07:08:48.076124+0000","last_active":"2024-09-11T07:09:07.187154+0000","last_peered":"2024-09-11T07:09:07.187154+0000","last_clean":"2024-09-11T07:09:07.187154+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:09:07.187154+0000","last_undegraded":"2024-09-11T07:09:07.187154+0000","last_fullsized":"2024-09-11T07:09:07.187154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:09.463660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041864520000000002,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4880,"num_read_kb":24721,"num_write":443,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"168'598","reported_seq":4851,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173739+0000","last_change":"2024-09-11T07:09:02.153702+0000","last_active":"2024-09-11T07:09:06.173739+0000","last_peered":"2024-09-11T07:09:06.173739+0000","last_clean":"2024-09-11T07:09:06.173739+0000","last_became_active":"2024-09-11T07:09:02.149433+0000","last_became_peered":"2024-09-11T07:09:02.149433+0000","last_unstale":"2024-09-11T07:09:06.173739+0000","last_undegraded":"2024-09-11T07:09:06.173739+0000","last_fullsized":"2024-09-11T07:09:06.173739+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:41.039056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001012333,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6911,"num_read_kb":17769,"num_write":573,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":3955769,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":263,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186748+0000","last_change":"2024-09-11T07:07:24.114928+0000","last_active":"2024-09-11T07:09:07.186748+0000","last_peered":"2024-09-11T07:09:07.186748+0000","last_clean":"2024-09-11T07:09:07.186748+0000","last_became_active":"2024-09-11T07:07:24.114181+0000","last_became_peered":"2024-09-11T07:07:24.114181+0000","last_unstale":"2024-09-11T07:09:07.186748+0000","last_undegraded":"2024-09-11T07:09:07.186748+0000","last_fullsized":"2024-09-11T07:09:07.186748+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:03.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"168'628","reported_seq":4054,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188734+0000","last_change":"2024-09-11T07:08:48.123105+0000","last_active":"2024-09-11T07:09:07.188734+0000","last_peered":"2024-09-11T07:09:07.188734+0000","last_clean":"2024-09-11T07:09:07.188734+0000","last_became_active":"2024-09-11T07:08:11.076673+0000","last_became_peered":"2024-09-11T07:08:11.076673+0000","last_unstale":"2024-09-11T07:09:07.188734+0000","last_undegraded":"2024-09-11T07:09:07.188734+0000","last_fullsized":"2024-09-11T07:09:07.188734+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:17:38.398538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024495049999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":4338,"num_read_kb":14044,"num_write":542,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":16056304,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":348,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.172090+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:09:06.172090+0000","last_peered":"2024-09-11T07:09:06.172090+0000","last_clean":"2024-09-11T07:09:06.172090+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:09:06.172090+0000","last_undegraded":"2024-09-11T07:09:06.172090+0000","last_fullsized":"2024-09-11T07:09:06.172090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"166'680","reported_seq":2593,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616923+0000","last_change":"2024-09-11T07:08:48.203453+0000","last_active":"2024-09-11T07:09:06.616923+0000","last_peered":"2024-09-11T07:09:06.616923+0000","last_clean":"2024-09-11T07:09:06.616923+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:09:06.616923+0000","last_undegraded":"2024-09-11T07:09:06.616923+0000","last_fullsized":"2024-09-11T07:09:06.616923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:28.692608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023129169999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4034,"num_read_kb":11596,"num_write":855,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187457+0000","last_change":"2024-09-11T07:08:08.034462+0000","last_active":"2024-09-11T07:09:07.187457+0000","last_peered":"2024-09-11T07:09:07.187457+0000","last_clean":"2024-09-11T07:09:07.187457+0000","last_became_active":"2024-09-11T07:08:08.033647+0000","last_became_peered":"2024-09-11T07:08:08.033647+0000","last_unstale":"2024-09-11T07:09:07.187457+0000","last_undegraded":"2024-09-11T07:09:07.187457+0000","last_fullsized":"2024-09-11T07:09:07.187457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:34:57.644981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"165'515","reported_seq":5204,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171863+0000","last_change":"2024-09-11T07:08:48.079207+0000","last_active":"2024-09-11T07:09:06.171863+0000","last_peered":"2024-09-11T07:09:06.171863+0000","last_clean":"2024-09-11T07:09:06.171863+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:09:06.171863+0000","last_undegraded":"2024-09-11T07:09:06.171863+0000","last_fullsized":"2024-09-11T07:09:06.171863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:16.525589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002205477,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6066,"num_read_kb":28471,"num_write":492,"num_write_kb":12910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":358,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.172023+0000","last_change":"2024-09-11T07:08:08.036204+0000","last_active":"2024-09-11T07:09:06.172023+0000","last_peered":"2024-09-11T07:09:06.172023+0000","last_clean":"2024-09-11T07:09:06.172023+0000","last_became_active":"2024-09-11T07:08:08.035491+0000","last_became_peered":"2024-09-11T07:08:08.035491+0000","last_unstale":"2024-09-11T07:09:06.172023+0000","last_undegraded":"2024-09-11T07:09:06.172023+0000","last_fullsized":"2024-09-11T07:09:06.172023+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:23.281269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"168'540","reported_seq":2961,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703091+0000","last_change":"2024-09-11T07:08:48.087759+0000","last_active":"2024-09-11T07:09:06.703091+0000","last_peered":"2024-09-11T07:09:06.703091+0000","last_clean":"2024-09-11T07:09:06.703091+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:09:06.703091+0000","last_undegraded":"2024-09-11T07:09:06.703091+0000","last_fullsized":"2024-09-11T07:09:06.703091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:05.015024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042550620000000004,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3092,"num_read_kb":8737,"num_write":637,"num_write_kb":5048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"168'738","reported_seq":4496,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173437+0000","last_change":"2024-09-11T07:09:02.152239+0000","last_active":"2024-09-11T07:09:06.173437+0000","last_peered":"2024-09-11T07:09:06.173437+0000","last_clean":"2024-09-11T07:09:06.173437+0000","last_became_active":"2024-09-11T07:09:02.147735+0000","last_became_peered":"2024-09-11T07:09:02.147735+0000","last_unstale":"2024-09-11T07:09:06.173437+0000","last_undegraded":"2024-09-11T07:09:06.173437+0000","last_fullsized":"2024-09-11T07:09:06.173437+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:14.396794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020874370000000001,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":24,"num_read":5018,"num_read_kb":11581,"num_write":787,"num_write_kb":11396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":7952009,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":352,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702790+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:09:06.702790+0000","last_peered":"2024-09-11T07:09:06.702790+0000","last_clean":"2024-09-11T07:09:06.702790+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:09:06.702790+0000","last_undegraded":"2024-09-11T07:09:06.702790+0000","last_fullsized":"2024-09-11T07:09:06.702790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"168'683","reported_seq":5241,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171860+0000","last_change":"2024-09-11T07:08:48.077928+0000","last_active":"2024-09-11T07:09:06.171860+0000","last_peered":"2024-09-11T07:09:06.171860+0000","last_clean":"2024-09-11T07:09:06.171860+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:09:06.171860+0000","last_undegraded":"2024-09-11T07:09:06.171860+0000","last_fullsized":"2024-09-11T07:09:06.171860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:11.799895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011597129999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5953,"num_read_kb":41533,"num_write":674,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":351,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.731446+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:09:07.731446+0000","last_peered":"2024-09-11T07:09:07.731446+0000","last_clean":"2024-09-11T07:09:07.731446+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:09:07.731446+0000","last_undegraded":"2024-09-11T07:09:07.731446+0000","last_fullsized":"2024-09-11T07:09:07.731446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'472","reported_seq":8833,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188231+0000","last_change":"2024-09-11T07:08:55.866882+0000","last_active":"2024-09-11T07:09:07.188231+0000","last_peered":"2024-09-11T07:09:07.188231+0000","last_clean":"2024-09-11T07:09:07.188231+0000","last_became_active":"2024-09-11T07:08:55.865598+0000","last_became_peered":"2024-09-11T07:08:55.865598+0000","last_unstale":"2024-09-11T07:09:07.188231+0000","last_undegraded":"2024-09-11T07:09:07.188231+0000","last_fullsized":"2024-09-11T07:09:07.188231+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:43.022711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012557989999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":8865,"num_read_kb":33202,"num_write":482,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":323,"num_bytes_recovered":61422801,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188279+0000","last_change":"2024-09-11T07:08:08.034045+0000","last_active":"2024-09-11T07:09:07.188279+0000","last_peered":"2024-09-11T07:09:07.188279+0000","last_clean":"2024-09-11T07:09:07.188279+0000","last_became_active":"2024-09-11T07:08:08.033145+0000","last_became_peered":"2024-09-11T07:08:08.033145+0000","last_unstale":"2024-09-11T07:09:07.188279+0000","last_undegraded":"2024-09-11T07:09:07.188279+0000","last_fullsized":"2024-09-11T07:09:07.188279+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:23:05.963512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"167'462","reported_seq":5352,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616776+0000","last_change":"2024-09-11T07:08:48.202029+0000","last_active":"2024-09-11T07:09:06.616776+0000","last_peered":"2024-09-11T07:09:06.616776+0000","last_clean":"2024-09-11T07:09:06.616776+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:09:06.616776+0000","last_undegraded":"2024-09-11T07:09:06.616776+0000","last_fullsized":"2024-09-11T07:09:06.616776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:28.720201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018328699999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5357,"num_read_kb":20493,"num_write":487,"num_write_kb":10685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":351,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702781+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:09:06.702781+0000","last_peered":"2024-09-11T07:09:06.702781+0000","last_clean":"2024-09-11T07:09:06.702781+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:09:06.702781+0000","last_undegraded":"2024-09-11T07:09:06.702781+0000","last_fullsized":"2024-09-11T07:09:06.702781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":529,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187056+0000","last_change":"2024-09-11T07:08:13.093650+0000","last_active":"2024-09-11T07:09:07.187056+0000","last_peered":"2024-09-11T07:09:07.187056+0000","last_clean":"2024-09-11T07:09:07.187056+0000","last_became_active":"2024-09-11T07:08:13.085823+0000","last_became_peered":"2024-09-11T07:08:13.085823+0000","last_unstale":"2024-09-11T07:09:07.187056+0000","last_undegraded":"2024-09-11T07:09:07.187056+0000","last_fullsized":"2024-09-11T07:09:07.187056+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:40.664683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"168'417","reported_seq":3550,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616659+0000","last_change":"2024-09-11T07:08:48.202051+0000","last_active":"2024-09-11T07:09:06.616659+0000","last_peered":"2024-09-11T07:09:06.616659+0000","last_clean":"2024-09-11T07:09:06.616659+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:09:06.616659+0000","last_undegraded":"2024-09-11T07:09:06.616659+0000","last_fullsized":"2024-09-11T07:09:06.616659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:43.653964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886642,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3136,"num_read_kb":12190,"num_write":362,"num_write_kb":7014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'299","reported_seq":2285,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173312+0000","last_change":"2024-09-11T07:09:02.151236+0000","last_active":"2024-09-11T07:09:06.173312+0000","last_peered":"2024-09-11T07:09:06.173312+0000","last_clean":"2024-09-11T07:09:06.173312+0000","last_became_active":"2024-09-11T07:09:02.146228+0000","last_became_peered":"2024-09-11T07:09:02.146228+0000","last_unstale":"2024-09-11T07:09:06.173312+0000","last_undegraded":"2024-09-11T07:09:06.173312+0000","last_fullsized":"2024-09-11T07:09:06.173312+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:06:14.189857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010147260000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":1603,"num_read_kb":8035,"num_write":242,"num_write_kb":8539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":4236596,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"167'604","reported_seq":5585,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187660+0000","last_change":"2024-09-11T07:09:06.177501+0000","last_active":"2024-09-11T07:09:07.187660+0000","last_peered":"2024-09-11T07:09:07.187660+0000","last_clean":"2024-09-11T07:09:07.187660+0000","last_became_active":"2024-09-11T07:09:06.175303+0000","last_became_peered":"2024-09-11T07:09:06.175303+0000","last_unstale":"2024-09-11T07:09:07.187660+0000","last_undegraded":"2024-09-11T07:09:07.187660+0000","last_fullsized":"2024-09-11T07:09:07.187660+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:00.818882+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0083757740000000008,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":7105,"num_read_kb":12374,"num_write":638,"num_write_kb":6832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":288,"num_bytes_recovered":4540944,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"167'554","reported_seq":3894,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616774+0000","last_change":"2024-09-11T07:08:48.202794+0000","last_active":"2024-09-11T07:09:06.616774+0000","last_peered":"2024-09-11T07:09:06.616774+0000","last_clean":"2024-09-11T07:09:06.616774+0000","last_became_active":"2024-09-11T07:08:13.094279+0000","last_became_peered":"2024-09-11T07:08:13.094279+0000","last_unstale":"2024-09-11T07:09:06.616774+0000","last_undegraded":"2024-09-11T07:09:06.616774+0000","last_fullsized":"2024-09-11T07:09:06.616774+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:05:19.294505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022690100000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5323,"num_read_kb":21130,"num_write":584,"num_write_kb":14713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":42089319,"num_keys_recovered":120,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"167'374","reported_seq":3081,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702834+0000","last_change":"2024-09-11T07:08:48.086616+0000","last_active":"2024-09-11T07:09:06.702834+0000","last_peered":"2024-09-11T07:09:06.702834+0000","last_clean":"2024-09-11T07:09:06.702834+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:09:06.702834+0000","last_undegraded":"2024-09-11T07:09:06.702834+0000","last_fullsized":"2024-09-11T07:09:06.702834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:14.712547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032901720000000001,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":2243,"num_read_kb":7360,"num_write":303,"num_write_kb":6081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"166'472","reported_seq":4057,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187174+0000","last_change":"2024-09-11T07:08:48.077078+0000","last_active":"2024-09-11T07:09:07.187174+0000","last_peered":"2024-09-11T07:09:07.187174+0000","last_clean":"2024-09-11T07:09:07.187174+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:09:07.187174+0000","last_undegraded":"2024-09-11T07:09:07.187174+0000","last_fullsized":"2024-09-11T07:09:07.187174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:01.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048801529999999999,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":5047,"num_read_kb":19575,"num_write":443,"num_write_kb":9370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"168'510","reported_seq":3756,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187328+0000","last_change":"2024-09-11T07:08:54.863283+0000","last_active":"2024-09-11T07:09:07.187328+0000","last_peered":"2024-09-11T07:09:07.187328+0000","last_clean":"2024-09-11T07:09:07.187328+0000","last_became_active":"2024-09-11T07:08:54.860099+0000","last_became_peered":"2024-09-11T07:08:54.860099+0000","last_unstale":"2024-09-11T07:09:07.187328+0000","last_undegraded":"2024-09-11T07:09:07.187328+0000","last_fullsized":"2024-09-11T07:09:07.187328+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:28:05.233558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058914980000000002,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5468,"num_read_kb":40931,"num_write":483,"num_write_kb":33825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":29182336,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'908","reported_seq":5692,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187215+0000","last_change":"2024-09-11T07:08:59.860723+0000","last_active":"2024-09-11T07:09:07.187215+0000","last_peered":"2024-09-11T07:09:07.187215+0000","last_clean":"2024-09-11T07:09:07.187215+0000","last_became_active":"2024-09-11T07:08:59.857371+0000","last_became_peered":"2024-09-11T07:08:59.857371+0000","last_unstale":"2024-09-11T07:09:07.187215+0000","last_undegraded":"2024-09-11T07:09:07.187215+0000","last_fullsized":"2024-09-11T07:09:07.187215+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:39.427043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037300609999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7268,"num_read_kb":23165,"num_write":1135,"num_write_kb":16436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":309,"num_bytes_recovered":38565066,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"164'1332","reported_seq":3550,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:48.072601+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:12.088833+0000","last_became_peered":"2024-09-11T07:08:12.088833+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:10.966554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025943210000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7126,"num_read_kb":16929,"num_write":1954,"num_write_kb":15903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":5558122,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"166'305","reported_seq":4432,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:57.881661+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:57.878966+0000","last_became_peered":"2024-09-11T07:08:57.878966+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:57:28.004494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030609069999999999,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":3180,"num_read_kb":9248,"num_write":258,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":2139720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"168'502","reported_seq":6667,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188231+0000","last_change":"2024-09-11T07:08:48.121587+0000","last_active":"2024-09-11T07:09:07.188231+0000","last_peered":"2024-09-11T07:09:07.188231+0000","last_clean":"2024-09-11T07:09:07.188231+0000","last_became_active":"2024-09-11T07:08:12.092494+0000","last_became_peered":"2024-09-11T07:08:12.092494+0000","last_unstale":"2024-09-11T07:09:07.188231+0000","last_undegraded":"2024-09-11T07:09:07.188231+0000","last_fullsized":"2024-09-11T07:09:07.188231+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:18:59.887309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011861700000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":6702,"num_read_kb":31801,"num_write":602,"num_write_kb":10266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":13150126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"166'597","reported_seq":3338,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187361+0000","last_change":"2024-09-11T07:08:58.859305+0000","last_active":"2024-09-11T07:09:07.187361+0000","last_peered":"2024-09-11T07:09:07.187361+0000","last_clean":"2024-09-11T07:09:07.187361+0000","last_became_active":"2024-09-11T07:08:58.856080+0000","last_became_peered":"2024-09-11T07:08:58.856080+0000","last_unstale":"2024-09-11T07:09:07.187361+0000","last_undegraded":"2024-09-11T07:09:07.187361+0000","last_fullsized":"2024-09-11T07:09:07.187361+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:44.826014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019838210000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3601,"num_read_kb":5499,"num_write":635,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":826886,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":952,"num_object_clones":0,"num_object_copies":1904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":952,"num_whiteouts":948,"num_read":171813,"num_read_kb":628353,"num_write":19992,"num_write_kb":415358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4495,"num_bytes_recovered":292360160,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18509,"ondisk_log_size":18509,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":19129,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47332,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324508,"statfs":{"total":96636764160,"available":96588296192,"internally_reserved":0,"allocated":2301952,"data_stored":1675772,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":46135753},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33380,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338460,"statfs":{"total":96636764160,"available":96602583040,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59744,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312096,"statfs":{"total":96636764160,"available":96575586304,"internally_reserved":0,"allocated":2236416,"data_stored":1079581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":58915268},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51420,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320420,"statfs":{"total":96636764160,"available":96584110080,"internally_reserved":0,"allocated":2236416,"data_stored":1079581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2232320,"data_stored":1079562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41700,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330140,"statfs":{"total":96636764160,"available":96594063360,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55584,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316256,"statfs":{"total":96636764160,"available":96579846144,"internally_reserved":0,"allocated":2240512,"data_stored":1079600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55632,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316208,"statfs":{"total":96636764160,"available":96579796992,"internally_reserved":0,"allocated":2285568,"data_stored":1675772,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:09:13.149 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-11T07:09:13.149 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:09:13.425 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:09:13.425 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:09:13.441 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2024-09-11T07:09:11.867482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":956,"num_object_clones":0,"num_object_copies":1912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":956,"num_whiteouts":948,"num_read":171929,"num_read_kb":628453,"num_write":20153,"num_write_kb":417776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4499,"num_bytes_recovered":293540896,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18629,"ondisk_log_size":18629,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400368,"kb_used_data":17600,"kb_used_omap":12,"kb_used_meta":382579,"kb_avail":754574352,"statfs":{"total":773094113280,"available":772684136448,"internally_reserved":0,"allocated":18022400,"data_stored":9840676,"data_compressed":12474,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":12760,"internal_metadata":391761448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":101,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.711104"},"pg_stats":[{"pgid":"3.1f","version":"168'468","reported_seq":3070,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.189047+0000","last_change":"2024-09-11T07:08:48.123890+0000","last_active":"2024-09-11T07:09:07.189047+0000","last_peered":"2024-09-11T07:09:07.189047+0000","last_clean":"2024-09-11T07:09:07.189047+0000","last_became_active":"2024-09-11T07:08:13.087864+0000","last_became_peered":"2024-09-11T07:08:13.087864+0000","last_unstale":"2024-09-11T07:09:07.189047+0000","last_undegraded":"2024-09-11T07:09:07.189047+0000","last_fullsized":"2024-09-11T07:09:07.189047+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:15:41.981140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028069940000000002,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2694,"num_read_kb":5154,"num_write":552,"num_write_kb":22529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":3432884,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'412","reported_seq":2205,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616940+0000","last_change":"2024-09-11T07:08:48.203786+0000","last_active":"2024-09-11T07:09:06.616940+0000","last_peered":"2024-09-11T07:09:06.616940+0000","last_clean":"2024-09-11T07:09:06.616940+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:09:06.616940+0000","last_undegraded":"2024-09-11T07:09:06.616940+0000","last_fullsized":"2024-09-11T07:09:06.616940+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:23:36.315451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028533249999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":1677,"num_read_kb":19454,"num_write":399,"num_write_kb":12631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"165'649","reported_seq":12980,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703100+0000","last_change":"2024-09-11T07:08:55.868195+0000","last_active":"2024-09-11T07:09:06.703100+0000","last_peered":"2024-09-11T07:09:06.703100+0000","last_clean":"2024-09-11T07:09:06.703100+0000","last_became_active":"2024-09-11T07:08:55.865799+0000","last_became_peered":"2024-09-11T07:08:55.865799+0000","last_unstale":"2024-09-11T07:09:06.703100+0000","last_undegraded":"2024-09-11T07:09:06.703100+0000","last_fullsized":"2024-09-11T07:09:06.703100+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:49:41.498042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019228699999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":13982,"num_read_kb":66796,"num_write":768,"num_write_kb":14794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":5987441,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"168'909","reported_seq":4677,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702821+0000","last_change":"2024-09-11T07:08:57.885182+0000","last_active":"2024-09-11T07:09:06.702821+0000","last_peered":"2024-09-11T07:09:06.702821+0000","last_clean":"2024-09-11T07:09:06.702821+0000","last_became_active":"2024-09-11T07:08:57.881857+0000","last_became_peered":"2024-09-11T07:08:57.881857+0000","last_unstale":"2024-09-11T07:09:06.702821+0000","last_undegraded":"2024-09-11T07:09:06.702821+0000","last_fullsized":"2024-09-11T07:09:06.702821+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:28:07.362960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021881650000000002,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":5039,"num_read_kb":16054,"num_write":1190,"num_write_kb":13844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":6996622,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'539","reported_seq":6881,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188813+0000","last_change":"2024-09-11T07:08:57.881662+0000","last_active":"2024-09-11T07:09:07.188813+0000","last_peered":"2024-09-11T07:09:07.188813+0000","last_clean":"2024-09-11T07:09:07.188813+0000","last_became_active":"2024-09-11T07:08:57.880103+0000","last_became_peered":"2024-09-11T07:08:57.880103+0000","last_unstale":"2024-09-11T07:09:07.188813+0000","last_undegraded":"2024-09-11T07:09:07.188813+0000","last_fullsized":"2024-09-11T07:09:07.188813+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:51:54.645362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025371069999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":8318,"num_read_kb":11321,"num_write":542,"num_write_kb":4670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":4425669,"num_keys_recovered":47,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"163'520","reported_seq":5071,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173410+0000","last_change":"2024-09-11T07:09:02.150715+0000","last_active":"2024-09-11T07:09:06.173410+0000","last_peered":"2024-09-11T07:09:06.173410+0000","last_clean":"2024-09-11T07:09:06.173410+0000","last_became_active":"2024-09-11T07:09:02.145138+0000","last_became_peered":"2024-09-11T07:09:02.145138+0000","last_unstale":"2024-09-11T07:09:06.173410+0000","last_undegraded":"2024-09-11T07:09:06.173410+0000","last_fullsized":"2024-09-11T07:09:06.173410+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:02:56.439518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024466639999999999,"stat_sum":{"num_bytes":19,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":41,"num_read":6616,"num_read_kb":11567,"num_write":528,"num_write_kb":10022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":3177242,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"168'483","reported_seq":2146,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171830+0000","last_change":"2024-09-11T07:08:48.078593+0000","last_active":"2024-09-11T07:09:06.171830+0000","last_peered":"2024-09-11T07:09:06.171830+0000","last_clean":"2024-09-11T07:09:06.171830+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:09:06.171830+0000","last_undegraded":"2024-09-11T07:09:06.171830+0000","last_fullsized":"2024-09-11T07:09:06.171830+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:20:35.663171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016777719999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2274,"num_read_kb":6232,"num_write":578,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"167'723","reported_seq":4881,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616636+0000","last_change":"2024-09-11T07:08:48.201459+0000","last_active":"2024-09-11T07:09:06.616636+0000","last_peered":"2024-09-11T07:09:06.616636+0000","last_clean":"2024-09-11T07:09:06.616636+0000","last_became_active":"2024-09-11T07:08:14.106879+0000","last_became_peered":"2024-09-11T07:08:14.106879+0000","last_unstale":"2024-09-11T07:09:06.616636+0000","last_undegraded":"2024-09-11T07:09:06.616636+0000","last_fullsized":"2024-09-11T07:09:06.616636+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:18:07.608483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013481490000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6716,"num_read_kb":13771,"num_write":714,"num_write_kb":21799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":9689178,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"162'445","reported_seq":6684,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188867+0000","last_change":"2024-09-11T07:08:48.122544+0000","last_active":"2024-09-11T07:09:07.188867+0000","last_peered":"2024-09-11T07:09:07.188867+0000","last_clean":"2024-09-11T07:09:07.188867+0000","last_became_active":"2024-09-11T07:08:21.855245+0000","last_became_peered":"2024-09-11T07:08:21.855245+0000","last_unstale":"2024-09-11T07:09:07.188867+0000","last_undegraded":"2024-09-11T07:09:07.188867+0000","last_fullsized":"2024-09-11T07:09:07.188867+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:49:30.408153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020224750000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":6674,"num_read_kb":41299,"num_write":387,"num_write_kb":21088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":28975126,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"168'688","reported_seq":4228,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703013+0000","last_change":"2024-09-11T07:08:48.086510+0000","last_active":"2024-09-11T07:09:06.703013+0000","last_peered":"2024-09-11T07:09:06.703013+0000","last_clean":"2024-09-11T07:09:06.703013+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:09:06.703013+0000","last_undegraded":"2024-09-11T07:09:06.703013+0000","last_fullsized":"2024-09-11T07:09:06.703013+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:32:02.395296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033666669999999998,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5507,"num_read_kb":16321,"num_write":723,"num_write_kb":8687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'483","reported_seq":4221,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187154+0000","last_change":"2024-09-11T07:08:48.076124+0000","last_active":"2024-09-11T07:09:07.187154+0000","last_peered":"2024-09-11T07:09:07.187154+0000","last_clean":"2024-09-11T07:09:07.187154+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:09:07.187154+0000","last_undegraded":"2024-09-11T07:09:07.187154+0000","last_fullsized":"2024-09-11T07:09:07.187154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:09.463660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041864520000000002,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4880,"num_read_kb":24721,"num_write":443,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"168'598","reported_seq":4851,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173739+0000","last_change":"2024-09-11T07:09:02.153702+0000","last_active":"2024-09-11T07:09:06.173739+0000","last_peered":"2024-09-11T07:09:06.173739+0000","last_clean":"2024-09-11T07:09:06.173739+0000","last_became_active":"2024-09-11T07:09:02.149433+0000","last_became_peered":"2024-09-11T07:09:02.149433+0000","last_unstale":"2024-09-11T07:09:06.173739+0000","last_undegraded":"2024-09-11T07:09:06.173739+0000","last_fullsized":"2024-09-11T07:09:06.173739+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:41.039056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001012333,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6911,"num_read_kb":17769,"num_write":573,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":3955769,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":263,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186748+0000","last_change":"2024-09-11T07:07:24.114928+0000","last_active":"2024-09-11T07:09:07.186748+0000","last_peered":"2024-09-11T07:09:07.186748+0000","last_clean":"2024-09-11T07:09:07.186748+0000","last_became_active":"2024-09-11T07:07:24.114181+0000","last_became_peered":"2024-09-11T07:07:24.114181+0000","last_unstale":"2024-09-11T07:09:07.186748+0000","last_undegraded":"2024-09-11T07:09:07.186748+0000","last_fullsized":"2024-09-11T07:09:07.186748+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:03.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"168'628","reported_seq":4054,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188734+0000","last_change":"2024-09-11T07:08:48.123105+0000","last_active":"2024-09-11T07:09:07.188734+0000","last_peered":"2024-09-11T07:09:07.188734+0000","last_clean":"2024-09-11T07:09:07.188734+0000","last_became_active":"2024-09-11T07:08:11.076673+0000","last_became_peered":"2024-09-11T07:08:11.076673+0000","last_unstale":"2024-09-11T07:09:07.188734+0000","last_undegraded":"2024-09-11T07:09:07.188734+0000","last_fullsized":"2024-09-11T07:09:07.188734+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":628,"log_dups_size":0,"ondisk_log_size":628,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:17:38.398538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024495049999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":4338,"num_read_kb":14044,"num_write":542,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":16056304,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":348,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.172090+0000","last_change":"2024-09-11T07:05:51.150991+0000","last_active":"2024-09-11T07:09:06.172090+0000","last_peered":"2024-09-11T07:09:06.172090+0000","last_clean":"2024-09-11T07:09:06.172090+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:09:06.172090+0000","last_undegraded":"2024-09-11T07:09:06.172090+0000","last_fullsized":"2024-09-11T07:09:06.172090+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:11:28.243021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"166'680","reported_seq":2593,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616923+0000","last_change":"2024-09-11T07:08:48.203453+0000","last_active":"2024-09-11T07:09:06.616923+0000","last_peered":"2024-09-11T07:09:06.616923+0000","last_clean":"2024-09-11T07:09:06.616923+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:09:06.616923+0000","last_undegraded":"2024-09-11T07:09:06.616923+0000","last_fullsized":"2024-09-11T07:09:06.616923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:00:28.692608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023129169999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4034,"num_read_kb":11596,"num_write":855,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187457+0000","last_change":"2024-09-11T07:08:08.034462+0000","last_active":"2024-09-11T07:09:07.187457+0000","last_peered":"2024-09-11T07:09:07.187457+0000","last_clean":"2024-09-11T07:09:07.187457+0000","last_became_active":"2024-09-11T07:08:08.033647+0000","last_became_peered":"2024-09-11T07:08:08.033647+0000","last_unstale":"2024-09-11T07:09:07.187457+0000","last_undegraded":"2024-09-11T07:09:07.187457+0000","last_fullsized":"2024-09-11T07:09:07.187457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:34:57.644981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"165'515","reported_seq":5204,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171863+0000","last_change":"2024-09-11T07:08:48.079207+0000","last_active":"2024-09-11T07:09:06.171863+0000","last_peered":"2024-09-11T07:09:06.171863+0000","last_clean":"2024-09-11T07:09:06.171863+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:09:06.171863+0000","last_undegraded":"2024-09-11T07:09:06.171863+0000","last_fullsized":"2024-09-11T07:09:06.171863+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:16.525589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002205477,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6066,"num_read_kb":28471,"num_write":492,"num_write_kb":12910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":358,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.172023+0000","last_change":"2024-09-11T07:08:08.036204+0000","last_active":"2024-09-11T07:09:06.172023+0000","last_peered":"2024-09-11T07:09:06.172023+0000","last_clean":"2024-09-11T07:09:06.172023+0000","last_became_active":"2024-09-11T07:08:08.035491+0000","last_became_peered":"2024-09-11T07:08:08.035491+0000","last_unstale":"2024-09-11T07:09:06.172023+0000","last_undegraded":"2024-09-11T07:09:06.172023+0000","last_fullsized":"2024-09-11T07:09:06.172023+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:48:23.281269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"168'540","reported_seq":2961,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.703091+0000","last_change":"2024-09-11T07:08:48.087759+0000","last_active":"2024-09-11T07:09:06.703091+0000","last_peered":"2024-09-11T07:09:06.703091+0000","last_clean":"2024-09-11T07:09:06.703091+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:09:06.703091+0000","last_undegraded":"2024-09-11T07:09:06.703091+0000","last_fullsized":"2024-09-11T07:09:06.703091+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:05.015024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042550620000000004,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3092,"num_read_kb":8737,"num_write":637,"num_write_kb":5048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"168'738","reported_seq":4496,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173437+0000","last_change":"2024-09-11T07:09:02.152239+0000","last_active":"2024-09-11T07:09:06.173437+0000","last_peered":"2024-09-11T07:09:06.173437+0000","last_clean":"2024-09-11T07:09:06.173437+0000","last_became_active":"2024-09-11T07:09:02.147735+0000","last_became_peered":"2024-09-11T07:09:02.147735+0000","last_unstale":"2024-09-11T07:09:06.173437+0000","last_undegraded":"2024-09-11T07:09:06.173437+0000","last_fullsized":"2024-09-11T07:09:06.173437+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:14.396794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020874370000000001,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":24,"num_read":5018,"num_read_kb":11581,"num_write":787,"num_write_kb":11396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":7952009,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":352,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702790+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:09:06.702790+0000","last_peered":"2024-09-11T07:09:06.702790+0000","last_clean":"2024-09-11T07:09:06.702790+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:09:06.702790+0000","last_undegraded":"2024-09-11T07:09:06.702790+0000","last_fullsized":"2024-09-11T07:09:06.702790+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"168'683","reported_seq":5241,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.171860+0000","last_change":"2024-09-11T07:08:48.077928+0000","last_active":"2024-09-11T07:09:06.171860+0000","last_peered":"2024-09-11T07:09:06.171860+0000","last_clean":"2024-09-11T07:09:06.171860+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:09:06.171860+0000","last_undegraded":"2024-09-11T07:09:06.171860+0000","last_fullsized":"2024-09-11T07:09:06.171860+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:49:11.799895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011597129999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5953,"num_read_kb":41533,"num_write":674,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":351,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.731446+0000","last_change":"2024-09-11T07:05:51.153018+0000","last_active":"2024-09-11T07:09:07.731446+0000","last_peered":"2024-09-11T07:09:07.731446+0000","last_clean":"2024-09-11T07:09:07.731446+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:09:07.731446+0000","last_undegraded":"2024-09-11T07:09:07.731446+0000","last_fullsized":"2024-09-11T07:09:07.731446+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:44:24.018237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'472","reported_seq":8833,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188231+0000","last_change":"2024-09-11T07:08:55.866882+0000","last_active":"2024-09-11T07:09:07.188231+0000","last_peered":"2024-09-11T07:09:07.188231+0000","last_clean":"2024-09-11T07:09:07.188231+0000","last_became_active":"2024-09-11T07:08:55.865598+0000","last_became_peered":"2024-09-11T07:08:55.865598+0000","last_unstale":"2024-09-11T07:09:07.188231+0000","last_undegraded":"2024-09-11T07:09:07.188231+0000","last_fullsized":"2024-09-11T07:09:07.188231+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:49:43.022711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012557989999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":8865,"num_read_kb":33202,"num_write":482,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":323,"num_bytes_recovered":61422801,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":126,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188279+0000","last_change":"2024-09-11T07:08:08.034045+0000","last_active":"2024-09-11T07:09:07.188279+0000","last_peered":"2024-09-11T07:09:07.188279+0000","last_clean":"2024-09-11T07:09:07.188279+0000","last_became_active":"2024-09-11T07:08:08.033145+0000","last_became_peered":"2024-09-11T07:08:08.033145+0000","last_unstale":"2024-09-11T07:09:07.188279+0000","last_undegraded":"2024-09-11T07:09:07.188279+0000","last_fullsized":"2024-09-11T07:09:07.188279+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:23:05.963512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"167'462","reported_seq":5352,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616776+0000","last_change":"2024-09-11T07:08:48.202029+0000","last_active":"2024-09-11T07:09:06.616776+0000","last_peered":"2024-09-11T07:09:06.616776+0000","last_clean":"2024-09-11T07:09:06.616776+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:09:06.616776+0000","last_undegraded":"2024-09-11T07:09:06.616776+0000","last_fullsized":"2024-09-11T07:09:06.616776+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:37:28.720201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018328699999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5357,"num_read_kb":20493,"num_write":487,"num_write_kb":10685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":351,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702781+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:09:06.702781+0000","last_peered":"2024-09-11T07:09:06.702781+0000","last_clean":"2024-09-11T07:09:06.702781+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:09:06.702781+0000","last_undegraded":"2024-09-11T07:09:06.702781+0000","last_fullsized":"2024-09-11T07:09:06.702781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":529,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187056+0000","last_change":"2024-09-11T07:08:13.093650+0000","last_active":"2024-09-11T07:09:07.187056+0000","last_peered":"2024-09-11T07:09:07.187056+0000","last_clean":"2024-09-11T07:09:07.187056+0000","last_became_active":"2024-09-11T07:08:13.085823+0000","last_became_peered":"2024-09-11T07:08:13.085823+0000","last_unstale":"2024-09-11T07:09:07.187056+0000","last_undegraded":"2024-09-11T07:09:07.187056+0000","last_fullsized":"2024-09-11T07:09:07.187056+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:40.664683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"168'417","reported_seq":3550,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616659+0000","last_change":"2024-09-11T07:08:48.202051+0000","last_active":"2024-09-11T07:09:06.616659+0000","last_peered":"2024-09-11T07:09:06.616659+0000","last_clean":"2024-09-11T07:09:06.616659+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:09:06.616659+0000","last_undegraded":"2024-09-11T07:09:06.616659+0000","last_fullsized":"2024-09-11T07:09:06.616659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":417,"log_dups_size":0,"ondisk_log_size":417,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:14:43.653964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001886642,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3136,"num_read_kb":12190,"num_write":362,"num_write_kb":7014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'299","reported_seq":2285,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.173312+0000","last_change":"2024-09-11T07:09:02.151236+0000","last_active":"2024-09-11T07:09:06.173312+0000","last_peered":"2024-09-11T07:09:06.173312+0000","last_clean":"2024-09-11T07:09:06.173312+0000","last_became_active":"2024-09-11T07:09:02.146228+0000","last_became_peered":"2024-09-11T07:09:02.146228+0000","last_unstale":"2024-09-11T07:09:06.173312+0000","last_undegraded":"2024-09-11T07:09:06.173312+0000","last_fullsized":"2024-09-11T07:09:06.173312+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:06:14.189857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010147260000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":1603,"num_read_kb":8035,"num_write":242,"num_write_kb":8539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":4236596,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"167'604","reported_seq":5585,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187660+0000","last_change":"2024-09-11T07:09:06.177501+0000","last_active":"2024-09-11T07:09:07.187660+0000","last_peered":"2024-09-11T07:09:07.187660+0000","last_clean":"2024-09-11T07:09:07.187660+0000","last_became_active":"2024-09-11T07:09:06.175303+0000","last_became_peered":"2024-09-11T07:09:06.175303+0000","last_unstale":"2024-09-11T07:09:07.187660+0000","last_undegraded":"2024-09-11T07:09:07.187660+0000","last_fullsized":"2024-09-11T07:09:07.187660+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:00.818882+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0083757740000000008,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":7105,"num_read_kb":12374,"num_write":638,"num_write_kb":6832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":288,"num_bytes_recovered":4540944,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"167'554","reported_seq":3894,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.616774+0000","last_change":"2024-09-11T07:08:48.202794+0000","last_active":"2024-09-11T07:09:06.616774+0000","last_peered":"2024-09-11T07:09:06.616774+0000","last_clean":"2024-09-11T07:09:06.616774+0000","last_became_active":"2024-09-11T07:08:13.094279+0000","last_became_peered":"2024-09-11T07:08:13.094279+0000","last_unstale":"2024-09-11T07:09:06.616774+0000","last_undegraded":"2024-09-11T07:09:06.616774+0000","last_fullsized":"2024-09-11T07:09:06.616774+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:05:19.294505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022690100000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5323,"num_read_kb":21130,"num_write":584,"num_write_kb":14713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":42089319,"num_keys_recovered":120,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"167'374","reported_seq":3081,"reported_epoch":185,"state":"active+clean","last_fresh":"2024-09-11T07:09:06.702834+0000","last_change":"2024-09-11T07:08:48.086616+0000","last_active":"2024-09-11T07:09:06.702834+0000","last_peered":"2024-09-11T07:09:06.702834+0000","last_clean":"2024-09-11T07:09:06.702834+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:09:06.702834+0000","last_undegraded":"2024-09-11T07:09:06.702834+0000","last_fullsized":"2024-09-11T07:09:06.702834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:14.712547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032901720000000001,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":2243,"num_read_kb":7360,"num_write":303,"num_write_kb":6081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"166'472","reported_seq":4057,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187174+0000","last_change":"2024-09-11T07:08:48.077078+0000","last_active":"2024-09-11T07:09:07.187174+0000","last_peered":"2024-09-11T07:09:07.187174+0000","last_clean":"2024-09-11T07:09:07.187174+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:09:07.187174+0000","last_undegraded":"2024-09-11T07:09:07.187174+0000","last_fullsized":"2024-09-11T07:09:07.187174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:01.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048801529999999999,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":5047,"num_read_kb":19575,"num_write":443,"num_write_kb":9370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"168'510","reported_seq":3756,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187328+0000","last_change":"2024-09-11T07:08:54.863283+0000","last_active":"2024-09-11T07:09:07.187328+0000","last_peered":"2024-09-11T07:09:07.187328+0000","last_clean":"2024-09-11T07:09:07.187328+0000","last_became_active":"2024-09-11T07:08:54.860099+0000","last_became_peered":"2024-09-11T07:08:54.860099+0000","last_unstale":"2024-09-11T07:09:07.187328+0000","last_undegraded":"2024-09-11T07:09:07.187328+0000","last_fullsized":"2024-09-11T07:09:07.187328+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:28:05.233558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058914980000000002,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5468,"num_read_kb":40931,"num_write":483,"num_write_kb":33825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":29182336,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'908","reported_seq":5692,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187215+0000","last_change":"2024-09-11T07:08:59.860723+0000","last_active":"2024-09-11T07:09:07.187215+0000","last_peered":"2024-09-11T07:09:07.187215+0000","last_clean":"2024-09-11T07:09:07.187215+0000","last_became_active":"2024-09-11T07:08:59.857371+0000","last_became_peered":"2024-09-11T07:08:59.857371+0000","last_unstale":"2024-09-11T07:09:07.187215+0000","last_undegraded":"2024-09-11T07:09:07.187215+0000","last_fullsized":"2024-09-11T07:09:07.187215+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:39.427043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037300609999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7268,"num_read_kb":23165,"num_write":1135,"num_write_kb":16436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":309,"num_bytes_recovered":38565066,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"164'1332","reported_seq":3550,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:48.072601+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:12.088833+0000","last_became_peered":"2024-09-11T07:08:12.088833+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:10.966554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025943210000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7126,"num_read_kb":16929,"num_write":1954,"num_write_kb":15903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":5558122,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"166'305","reported_seq":4432,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:57.881661+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:57.878966+0000","last_became_peered":"2024-09-11T07:08:57.878966+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:57:28.004494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030609069999999999,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":3180,"num_read_kb":9248,"num_write":258,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":2139720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"168'502","reported_seq":6667,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188231+0000","last_change":"2024-09-11T07:08:48.121587+0000","last_active":"2024-09-11T07:09:07.188231+0000","last_peered":"2024-09-11T07:09:07.188231+0000","last_clean":"2024-09-11T07:09:07.188231+0000","last_became_active":"2024-09-11T07:08:12.092494+0000","last_became_peered":"2024-09-11T07:08:12.092494+0000","last_unstale":"2024-09-11T07:09:07.188231+0000","last_undegraded":"2024-09-11T07:09:07.188231+0000","last_fullsized":"2024-09-11T07:09:07.188231+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:18:59.887309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011861700000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":6702,"num_read_kb":31801,"num_write":602,"num_write_kb":10266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":13150126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"166'597","reported_seq":3338,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187361+0000","last_change":"2024-09-11T07:08:58.859305+0000","last_active":"2024-09-11T07:09:07.187361+0000","last_peered":"2024-09-11T07:09:07.187361+0000","last_clean":"2024-09-11T07:09:07.187361+0000","last_became_active":"2024-09-11T07:08:58.856080+0000","last_became_peered":"2024-09-11T07:08:58.856080+0000","last_unstale":"2024-09-11T07:09:07.187361+0000","last_undegraded":"2024-09-11T07:09:07.187361+0000","last_fullsized":"2024-09-11T07:09:07.187361+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:44.826014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019838210000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3601,"num_read_kb":5499,"num_write":635,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":826886,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":952,"num_object_clones":0,"num_object_copies":1904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":952,"num_whiteouts":948,"num_read":171813,"num_read_kb":628353,"num_write":19992,"num_write_kb":415358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4495,"num_bytes_recovered":292360160,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18509,"ondisk_log_size":18509,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":19129,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47332,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324508,"statfs":{"total":96636764160,"available":96588296192,"internally_reserved":0,"allocated":2301952,"data_stored":1675772,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":46135753},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33380,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338460,"statfs":{"total":96636764160,"available":96602583040,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59744,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312096,"statfs":{"total":96636764160,"available":96575586304,"internally_reserved":0,"allocated":2236416,"data_stored":1079581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":58915268},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51420,"kb_used_data":2184,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320420,"statfs":{"total":96636764160,"available":96584110080,"internally_reserved":0,"allocated":2236416,"data_stored":1079581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574893,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55576,"kb_used_data":2180,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316264,"statfs":{"total":96636764160,"available":96579854336,"internally_reserved":0,"allocated":2232320,"data_stored":1079562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574893,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41700,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330140,"statfs":{"total":96636764160,"available":96594063360,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55584,"kb_used_data":2188,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316256,"statfs":{"total":96636764160,"available":96579846144,"internally_reserved":0,"allocated":2240512,"data_stored":1079600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574893,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55632,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316208,"statfs":{"total":96636764160,"available":96579796992,"internally_reserved":0,"allocated":2285568,"data_stored":1675772,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:09:13.445 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-11T07:09:13.728 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:09:13.728 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":186,"fsid":"e1313abd-54a9-4e53-ab67-469f744048b1","created":"2024-09-11T07:05:29.098467+0000","modified":"2024-09-11T07:09:07.175415+0000","last_up_change":"2024-09-11T07:05:41.051856+0000","last_in_change":"2024-09-11T07:08:51.070082+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-11T07:05:41.897005+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-11T07:05:47.687214+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"pool_client.0","create_time":"2024-09-11T07:05:57.298060+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":49,"snap_epoch":168,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"24d57cdb-2f3a-4a96-903d-11be7dc26a20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":177,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6825","nonce":1708235775}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6827","nonce":1708235775}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6831","nonce":1708235775}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":1708235775},{"type":"v1","addr":"172.21.15.79:6829","nonce":1708235775}]},"public_addr":"172.21.15.79:6825/1708235775","cluster_addr":"172.21.15.79:6827/1708235775","heartbeat_back_addr":"172.21.15.79:6831/1708235775","heartbeat_front_addr":"172.21.15.79:6829/1708235775","state":["exists","up"]},{"osd":1,"uuid":"aa51dc1b-b783-4212-8736-1f666239613b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6801","nonce":2076268206}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6803","nonce":2076268206}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6807","nonce":2076268206}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":2076268206},{"type":"v1","addr":"172.21.15.79:6805","nonce":2076268206}]},"public_addr":"172.21.15.79:6801/2076268206","cluster_addr":"172.21.15.79:6803/2076268206","heartbeat_back_addr":"172.21.15.79:6807/2076268206","heartbeat_front_addr":"172.21.15.79:6805/2076268206","state":["exists","up"]},{"osd":2,"uuid":"141a913f-7353-44a9-9dbd-70219bcee638","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":175,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6817","nonce":1904492349}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6819","nonce":1904492349}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6823","nonce":1904492349}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":1904492349},{"type":"v1","addr":"172.21.15.79:6821","nonce":1904492349}]},"public_addr":"172.21.15.79:6817/1904492349","cluster_addr":"172.21.15.79:6819/1904492349","heartbeat_back_addr":"172.21.15.79:6823/1904492349","heartbeat_front_addr":"172.21.15.79:6821/1904492349","state":["exists","up"]},{"osd":3,"uuid":"32550aeb-0c8d-4ca9-afd5-3e5258e7255b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":133,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6809","nonce":1327328912}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6811","nonce":1327328912}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6815","nonce":1327328912}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":1327328912},{"type":"v1","addr":"172.21.15.79:6813","nonce":1327328912}]},"public_addr":"172.21.15.79:6809/1327328912","cluster_addr":"172.21.15.79:6811/1327328912","heartbeat_back_addr":"172.21.15.79:6815/1327328912","heartbeat_front_addr":"172.21.15.79:6813/1327328912","state":["exists","up"]},{"osd":4,"uuid":"88d1a4a5-d585-4f6a-aac9-cba5ba67fdfc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":180,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6809","nonce":4087452871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6811","nonce":4087452871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6815","nonce":4087452871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":4087452871},{"type":"v1","addr":"172.21.15.110:6813","nonce":4087452871}]},"public_addr":"172.21.15.110:6809/4087452871","cluster_addr":"172.21.15.110:6811/4087452871","heartbeat_back_addr":"172.21.15.110:6815/4087452871","heartbeat_front_addr":"172.21.15.110:6813/4087452871","state":["exists","up"]},{"osd":5,"uuid":"42c83053-328e-4c9b-bdaf-09e1a4cc8b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":176,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6825","nonce":2133006853}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6827","nonce":2133006853}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6831","nonce":2133006853}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":2133006853},{"type":"v1","addr":"172.21.15.110:6829","nonce":2133006853}]},"public_addr":"172.21.15.110:6825/2133006853","cluster_addr":"172.21.15.110:6827/2133006853","heartbeat_back_addr":"172.21.15.110:6831/2133006853","heartbeat_front_addr":"172.21.15.110:6829/2133006853","state":["exists","up"]},{"osd":6,"uuid":"0ab29b1f-3012-4528-8f47-2cac908122c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6817","nonce":2083734892}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6819","nonce":2083734892}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6823","nonce":2083734892}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":2083734892},{"type":"v1","addr":"172.21.15.110:6821","nonce":2083734892}]},"public_addr":"172.21.15.110:6817/2083734892","cluster_addr":"172.21.15.110:6819/2083734892","heartbeat_back_addr":"172.21.15.110:6823/2083734892","heartbeat_front_addr":"172.21.15.110:6821/2083734892","state":["exists","up"]},{"osd":7,"uuid":"d9c7d12b-be93-41c9-a246-773faa65ecaf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":178,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6801","nonce":2322042784}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6803","nonce":2322042784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6807","nonce":2322042784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2322042784},{"type":"v1","addr":"172.21.15.110:6805","nonce":2322042784}]},"public_addr":"172.21.15.110:6801/2322042784","cluster_addr":"172.21.15.110:6803/2322042784","heartbeat_back_addr":"172.21.15.110:6807/2322042784","heartbeat_front_addr":"172.21.15.110:6805/2322042784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.653648+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.846269+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.970884+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:37.985630+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.236412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.336953+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.306806+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-11T07:05:38.104744+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.0","osds":[0,6]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-11T07:09:14.746 INFO:tasks.ceph:Scrubbing osd.0 2024-09-11T07:09:14.747 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-11T07:09:14.906 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:09:14.907 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T07:09:14.907 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:09:14.922 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-11T07:09:15.203 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 0 to deep-scrub 2024-09-11T07:09:15.222 INFO:tasks.ceph:Scrubbing osd.1 2024-09-11T07:09:15.222 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-11T07:09:15.357 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:09:15.357 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T07:09:15.357 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:09:15.372 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-11T07:09:15.639 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 1 to deep-scrub 2024-09-11T07:09:15.657 INFO:tasks.ceph:Scrubbing osd.2 2024-09-11T07:09:15.657 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-11T07:09:15.804 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:09:15.804 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T07:09:15.804 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:09:15.820 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-11T07:09:16.106 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 2 to deep-scrub 2024-09-11T07:09:16.126 INFO:tasks.ceph:Scrubbing osd.3 2024-09-11T07:09:16.126 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-11T07:09:16.266 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:09:16.266 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T07:09:16.266 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:09:16.280 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-11T07:09:16.546 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 3 to deep-scrub 2024-09-11T07:09:16.563 INFO:tasks.ceph:Scrubbing osd.4 2024-09-11T07:09:16.563 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-11T07:09:16.700 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:09:16.700 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T07:09:16.701 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:09:16.716 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-11T07:09:17.014 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 4 to deep-scrub 2024-09-11T07:09:17.032 INFO:tasks.ceph:Scrubbing osd.5 2024-09-11T07:09:17.032 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-11T07:09:17.189 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:09:17.190 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T07:09:17.190 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:09:17.205 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-11T07:09:17.493 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 5 to deep-scrub 2024-09-11T07:09:17.510 INFO:tasks.ceph:Scrubbing osd.6 2024-09-11T07:09:17.511 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-11T07:09:17.647 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:09:17.647 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T07:09:17.647 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:09:17.662 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-11T07:09:17.972 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 6 to deep-scrub 2024-09-11T07:09:17.990 INFO:tasks.ceph:Scrubbing osd.7 2024-09-11T07:09:17.990 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-11T07:09:18.142 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2024-09-11T07:09:18.142 INFO:teuthology.orchestra.run.smithi079.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-11T07:09:18.142 INFO:teuthology.orchestra.run.smithi079.stdout:} 2024-09-11T07:09:18.159 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-11T07:09:18.454 INFO:teuthology.orchestra.run.smithi079.stderr:instructed osd(s) 7 to deep-scrub 2024-09-11T07:09:18.475 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:09:18.782 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:09:18.782 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:09:18.801 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2024-09-11T07:09:17.869016+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":956,"num_object_clones":0,"num_object_copies":1912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":956,"num_whiteouts":948,"num_read":171929,"num_read_kb":628453,"num_write":20153,"num_write_kb":417776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4499,"num_bytes_recovered":293540896,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18701,"ondisk_log_size":18701,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":400408,"kb_used_data":17648,"kb_used_omap":12,"kb_used_meta":382579,"kb_avail":754574312,"statfs":{"total":773094113280,"available":772684095488,"internally_reserved":0,"allocated":18071552,"data_stored":9864044,"data_compressed":12474,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":12760,"internal_metadata":391761448},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.684452"},"pg_stats":[{"pgid":"3.1f","version":"168'468","reported_seq":3071,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.189171+0000","last_change":"2024-09-11T07:08:48.123890+0000","last_active":"2024-09-11T07:09:07.189171+0000","last_peered":"2024-09-11T07:09:07.189171+0000","last_clean":"2024-09-11T07:09:07.189171+0000","last_became_active":"2024-09-11T07:08:13.087864+0000","last_became_peered":"2024-09-11T07:08:13.087864+0000","last_unstale":"2024-09-11T07:09:07.189171+0000","last_undegraded":"2024-09-11T07:09:07.189171+0000","last_fullsized":"2024-09-11T07:09:07.189171+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028069940000000002,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2694,"num_read_kb":5154,"num_write":552,"num_write_kb":22529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":3432884,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"161'412","reported_seq":2208,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.231519+0000","last_change":"2024-09-11T07:08:48.203786+0000","last_active":"2024-09-11T07:09:08.231519+0000","last_peered":"2024-09-11T07:09:08.231519+0000","last_clean":"2024-09-11T07:09:08.231519+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:09:08.231519+0000","last_undegraded":"2024-09-11T07:09:08.231519+0000","last_fullsized":"2024-09-11T07:09:08.231519+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":412,"log_dups_size":0,"ondisk_log_size":412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0028533249999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":1677,"num_read_kb":19454,"num_write":399,"num_write_kb":12631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"165'649","reported_seq":12982,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.233645+0000","last_change":"2024-09-11T07:08:55.868195+0000","last_active":"2024-09-11T07:09:08.233645+0000","last_peered":"2024-09-11T07:09:08.233645+0000","last_clean":"2024-09-11T07:09:08.233645+0000","last_became_active":"2024-09-11T07:08:55.865799+0000","last_became_peered":"2024-09-11T07:08:55.865799+0000","last_unstale":"2024-09-11T07:09:08.233645+0000","last_undegraded":"2024-09-11T07:09:08.233645+0000","last_fullsized":"2024-09-11T07:09:08.233645+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":649,"log_dups_size":0,"ondisk_log_size":649,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:49:41.498042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019228699999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":13982,"num_read_kb":66796,"num_write":768,"num_write_kb":14794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":5987441,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"168'909","reported_seq":4679,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.233187+0000","last_change":"2024-09-11T07:08:57.885182+0000","last_active":"2024-09-11T07:09:08.233187+0000","last_peered":"2024-09-11T07:09:08.233187+0000","last_clean":"2024-09-11T07:09:08.233187+0000","last_became_active":"2024-09-11T07:08:57.881857+0000","last_became_peered":"2024-09-11T07:08:57.881857+0000","last_unstale":"2024-09-11T07:09:08.233187+0000","last_undegraded":"2024-09-11T07:09:08.233187+0000","last_fullsized":"2024-09-11T07:09:08.233187+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":909,"log_dups_size":0,"ondisk_log_size":909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:28:07.362960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0021881650000000002,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":5039,"num_read_kb":16054,"num_write":1190,"num_write_kb":13844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":6996622,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"161'539","reported_seq":6882,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188943+0000","last_change":"2024-09-11T07:08:57.881662+0000","last_active":"2024-09-11T07:09:07.188943+0000","last_peered":"2024-09-11T07:09:07.188943+0000","last_clean":"2024-09-11T07:09:07.188943+0000","last_became_active":"2024-09-11T07:08:57.880103+0000","last_became_peered":"2024-09-11T07:08:57.880103+0000","last_unstale":"2024-09-11T07:09:07.188943+0000","last_undegraded":"2024-09-11T07:09:07.188943+0000","last_fullsized":"2024-09-11T07:09:07.188943+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":539,"log_dups_size":0,"ondisk_log_size":539,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025371069999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":8318,"num_read_kb":11321,"num_write":542,"num_write_kb":4670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":4425669,"num_keys_recovered":47,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"163'520","reported_seq":5073,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.232561+0000","last_change":"2024-09-11T07:09:02.150715+0000","last_active":"2024-09-11T07:09:08.232561+0000","last_peered":"2024-09-11T07:09:08.232561+0000","last_clean":"2024-09-11T07:09:08.232561+0000","last_became_active":"2024-09-11T07:09:02.145138+0000","last_became_peered":"2024-09-11T07:09:02.145138+0000","last_unstale":"2024-09-11T07:09:08.232561+0000","last_undegraded":"2024-09-11T07:09:08.232561+0000","last_fullsized":"2024-09-11T07:09:08.232561+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":520,"log_dups_size":0,"ondisk_log_size":520,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:02:56.439518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024466639999999999,"stat_sum":{"num_bytes":19,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":41,"num_read":6616,"num_read_kb":11567,"num_write":528,"num_write_kb":10022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":3177242,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"168'483","reported_seq":2149,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.231419+0000","last_change":"2024-09-11T07:08:48.078593+0000","last_active":"2024-09-11T07:09:08.231419+0000","last_peered":"2024-09-11T07:09:08.231419+0000","last_clean":"2024-09-11T07:09:08.231419+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:09:08.231419+0000","last_undegraded":"2024-09-11T07:09:08.231419+0000","last_fullsized":"2024-09-11T07:09:08.231419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016777719999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2274,"num_read_kb":6232,"num_write":578,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"167'723","reported_seq":4884,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.231268+0000","last_change":"2024-09-11T07:08:48.201459+0000","last_active":"2024-09-11T07:09:08.231268+0000","last_peered":"2024-09-11T07:09:08.231268+0000","last_clean":"2024-09-11T07:09:08.231268+0000","last_became_active":"2024-09-11T07:08:14.106879+0000","last_became_peered":"2024-09-11T07:08:14.106879+0000","last_unstale":"2024-09-11T07:09:08.231268+0000","last_undegraded":"2024-09-11T07:09:08.231268+0000","last_fullsized":"2024-09-11T07:09:08.231268+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0013481490000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6716,"num_read_kb":13771,"num_write":714,"num_write_kb":21799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":9689178,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"162'445","reported_seq":6685,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188991+0000","last_change":"2024-09-11T07:08:48.122544+0000","last_active":"2024-09-11T07:09:07.188991+0000","last_peered":"2024-09-11T07:09:07.188991+0000","last_clean":"2024-09-11T07:09:07.188991+0000","last_became_active":"2024-09-11T07:08:21.855245+0000","last_became_peered":"2024-09-11T07:08:21.855245+0000","last_unstale":"2024-09-11T07:09:07.188991+0000","last_undegraded":"2024-09-11T07:09:07.188991+0000","last_fullsized":"2024-09-11T07:09:07.188991+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020224750000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":6674,"num_read_kb":41299,"num_write":387,"num_write_kb":21088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":28975126,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"168'688","reported_seq":4230,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.234002+0000","last_change":"2024-09-11T07:08:48.086510+0000","last_active":"2024-09-11T07:09:08.234002+0000","last_peered":"2024-09-11T07:09:08.234002+0000","last_clean":"2024-09-11T07:09:08.234002+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:09:08.234002+0000","last_undegraded":"2024-09-11T07:09:08.234002+0000","last_fullsized":"2024-09-11T07:09:08.234002+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":688,"log_dups_size":0,"ondisk_log_size":688,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:32:02.395296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0033666669999999998,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5507,"num_read_kb":16321,"num_write":723,"num_write_kb":8687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"165'483","reported_seq":4221,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187154+0000","last_change":"2024-09-11T07:08:48.076124+0000","last_active":"2024-09-11T07:09:07.187154+0000","last_peered":"2024-09-11T07:09:07.187154+0000","last_clean":"2024-09-11T07:09:07.187154+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:09:07.187154+0000","last_undegraded":"2024-09-11T07:09:07.187154+0000","last_fullsized":"2024-09-11T07:09:07.187154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":483,"log_dups_size":0,"ondisk_log_size":483,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:37:09.463660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0041864520000000002,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4880,"num_read_kb":24721,"num_write":443,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"168'598","reported_seq":4853,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.233219+0000","last_change":"2024-09-11T07:09:02.153702+0000","last_active":"2024-09-11T07:09:08.233219+0000","last_peered":"2024-09-11T07:09:08.233219+0000","last_clean":"2024-09-11T07:09:08.233219+0000","last_became_active":"2024-09-11T07:09:02.149433+0000","last_became_peered":"2024-09-11T07:09:02.149433+0000","last_unstale":"2024-09-11T07:09:08.233219+0000","last_undegraded":"2024-09-11T07:09:08.233219+0000","last_fullsized":"2024-09-11T07:09:08.233219+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:42:41.039056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001012333,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6911,"num_read_kb":17769,"num_write":573,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":3955769,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":263,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186748+0000","last_change":"2024-09-11T07:07:24.114928+0000","last_active":"2024-09-11T07:09:07.186748+0000","last_peered":"2024-09-11T07:09:07.186748+0000","last_clean":"2024-09-11T07:09:07.186748+0000","last_became_active":"2024-09-11T07:07:24.114181+0000","last_became_peered":"2024-09-11T07:07:24.114181+0000","last_unstale":"2024-09-11T07:09:07.186748+0000","last_undegraded":"2024-09-11T07:09:07.186748+0000","last_fullsized":"2024-09-11T07:09:07.186748+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:13:03.584137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"186'667","reported_seq":4103,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:16.878646+0000","last_change":"2024-09-11T07:09:16.878734+0000","last_active":"2024-09-11T07:09:16.878646+0000","last_peered":"2024-09-11T07:09:16.878646+0000","last_clean":"2024-09-11T07:09:16.878646+0000","last_became_active":"2024-09-11T07:08:11.076673+0000","last_became_peered":"2024-09-11T07:08:11.076673+0000","last_unstale":"2024-09-11T07:09:16.878646+0000","last_undegraded":"2024-09-11T07:09:16.878646+0000","last_fullsized":"2024-09-11T07:09:16.878646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'667","last_scrub_stamp":"2024-09-11T07:09:16.878511+0000","last_deep_scrub":"186'667","last_deep_scrub_stamp":"2024-09-11T07:09:16.878511+0000","last_clean_scrub_stamp":"2024-09-11T07:09:16.878511+0000","objects_scrubbed":39,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:00.163019+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0024495049999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":4338,"num_read_kb":14044,"num_write":542,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":16056304,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":359,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:15.972450+0000","last_change":"2024-09-11T07:09:15.972488+0000","last_active":"2024-09-11T07:09:15.972450+0000","last_peered":"2024-09-11T07:09:15.972450+0000","last_clean":"2024-09-11T07:09:15.972450+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:09:15.972450+0000","last_undegraded":"2024-09-11T07:09:15.972450+0000","last_fullsized":"2024-09-11T07:09:15.972450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:09:15.972331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:09:15.972331+0000","last_clean_scrub_stamp":"2024-09-11T07:09:15.972331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:17.202360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"166'680","reported_seq":2596,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.231454+0000","last_change":"2024-09-11T07:08:48.203453+0000","last_active":"2024-09-11T07:09:08.231454+0000","last_peered":"2024-09-11T07:09:08.231454+0000","last_clean":"2024-09-11T07:09:08.231454+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:09:08.231454+0000","last_undegraded":"2024-09-11T07:09:08.231454+0000","last_fullsized":"2024-09-11T07:09:08.231454+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0023129169999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4034,"num_read_kb":11596,"num_write":855,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":367,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187457+0000","last_change":"2024-09-11T07:08:08.034462+0000","last_active":"2024-09-11T07:09:07.187457+0000","last_peered":"2024-09-11T07:09:07.187457+0000","last_clean":"2024-09-11T07:09:07.187457+0000","last_became_active":"2024-09-11T07:08:08.033647+0000","last_became_peered":"2024-09-11T07:08:08.033647+0000","last_unstale":"2024-09-11T07:09:07.187457+0000","last_undegraded":"2024-09-11T07:09:07.187457+0000","last_fullsized":"2024-09-11T07:09:07.187457+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:34:57.644981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"165'515","reported_seq":5207,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.231502+0000","last_change":"2024-09-11T07:08:48.079207+0000","last_active":"2024-09-11T07:09:08.231502+0000","last_peered":"2024-09-11T07:09:08.231502+0000","last_clean":"2024-09-11T07:09:08.231502+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:09:08.231502+0000","last_undegraded":"2024-09-11T07:09:08.231502+0000","last_fullsized":"2024-09-11T07:09:08.231502+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":515,"log_dups_size":0,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.002205477,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6066,"num_read_kb":28471,"num_write":492,"num_write_kb":12910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":361,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.231513+0000","last_change":"2024-09-11T07:08:08.036204+0000","last_active":"2024-09-11T07:09:08.231513+0000","last_peered":"2024-09-11T07:09:08.231513+0000","last_clean":"2024-09-11T07:09:08.231513+0000","last_became_active":"2024-09-11T07:08:08.035491+0000","last_became_peered":"2024-09-11T07:08:08.035491+0000","last_unstale":"2024-09-11T07:09:08.231513+0000","last_undegraded":"2024-09-11T07:09:08.231513+0000","last_fullsized":"2024-09-11T07:09:08.231513+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"168'540","reported_seq":2963,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.233795+0000","last_change":"2024-09-11T07:08:48.087759+0000","last_active":"2024-09-11T07:09:08.233795+0000","last_peered":"2024-09-11T07:09:08.233795+0000","last_clean":"2024-09-11T07:09:08.233795+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:09:08.233795+0000","last_undegraded":"2024-09-11T07:09:08.233795+0000","last_fullsized":"2024-09-11T07:09:08.233795+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:09:05.015024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0042550620000000004,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3092,"num_read_kb":8737,"num_write":637,"num_write_kb":5048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"168'738","reported_seq":4498,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.232720+0000","last_change":"2024-09-11T07:09:02.152239+0000","last_active":"2024-09-11T07:09:08.232720+0000","last_peered":"2024-09-11T07:09:08.232720+0000","last_clean":"2024-09-11T07:09:08.232720+0000","last_became_active":"2024-09-11T07:09:02.147735+0000","last_became_peered":"2024-09-11T07:09:02.147735+0000","last_unstale":"2024-09-11T07:09:08.232720+0000","last_undegraded":"2024-09-11T07:09:08.232720+0000","last_fullsized":"2024-09-11T07:09:08.232720+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":738,"log_dups_size":0,"ondisk_log_size":738,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:51:14.396794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0020874370000000001,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":24,"num_read":5018,"num_read_kb":11581,"num_write":787,"num_write_kb":11396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":7952009,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":354,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.232928+0000","last_change":"2024-09-11T07:05:51.162705+0000","last_active":"2024-09-11T07:09:08.232928+0000","last_peered":"2024-09-11T07:09:08.232928+0000","last_clean":"2024-09-11T07:09:08.232928+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:09:08.232928+0000","last_undegraded":"2024-09-11T07:09:08.232928+0000","last_fullsized":"2024-09-11T07:09:08.232928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:58:59.829531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"168'683","reported_seq":5244,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.231515+0000","last_change":"2024-09-11T07:08:48.077928+0000","last_active":"2024-09-11T07:09:08.231515+0000","last_peered":"2024-09-11T07:09:08.231515+0000","last_clean":"2024-09-11T07:09:08.231515+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:09:08.231515+0000","last_undegraded":"2024-09-11T07:09:08.231515+0000","last_fullsized":"2024-09-11T07:09:08.231515+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":683,"log_dups_size":0,"ondisk_log_size":683,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011597129999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5953,"num_read_kb":41533,"num_write":674,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":360,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:16.868052+0000","last_change":"2024-09-11T07:09:16.868096+0000","last_active":"2024-09-11T07:09:16.868052+0000","last_peered":"2024-09-11T07:09:16.868052+0000","last_clean":"2024-09-11T07:09:16.868052+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:09:16.868052+0000","last_undegraded":"2024-09-11T07:09:16.868052+0000","last_fullsized":"2024-09-11T07:09:16.868052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:09:16.867946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:09:16.867946+0000","last_clean_scrub_stamp":"2024-09-11T07:09:16.867946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:23:42.490102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"167'472","reported_seq":8834,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188422+0000","last_change":"2024-09-11T07:08:55.866882+0000","last_active":"2024-09-11T07:09:07.188422+0000","last_peered":"2024-09-11T07:09:07.188422+0000","last_clean":"2024-09-11T07:09:07.188422+0000","last_became_active":"2024-09-11T07:08:55.865598+0000","last_became_peered":"2024-09-11T07:08:55.865598+0000","last_unstale":"2024-09-11T07:09:07.188422+0000","last_undegraded":"2024-09-11T07:09:07.188422+0000","last_fullsized":"2024-09-11T07:09:07.188422+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012557989999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":8865,"num_read_kb":33202,"num_write":482,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":323,"num_bytes_recovered":61422801,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:15.897651+0000","last_change":"2024-09-11T07:09:15.897671+0000","last_active":"2024-09-11T07:09:15.897651+0000","last_peered":"2024-09-11T07:09:15.897651+0000","last_clean":"2024-09-11T07:09:15.897651+0000","last_became_active":"2024-09-11T07:08:08.033145+0000","last_became_peered":"2024-09-11T07:08:08.033145+0000","last_unstale":"2024-09-11T07:09:15.897651+0000","last_undegraded":"2024-09-11T07:09:15.897651+0000","last_fullsized":"2024-09-11T07:09:15.897651+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:09:15.897585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:09:15.897585+0000","last_clean_scrub_stamp":"2024-09-11T07:09:15.897585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:09.827002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"167'462","reported_seq":5355,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.231382+0000","last_change":"2024-09-11T07:08:48.202029+0000","last_active":"2024-09-11T07:09:08.231382+0000","last_peered":"2024-09-11T07:09:08.231382+0000","last_clean":"2024-09-11T07:09:08.231382+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:09:08.231382+0000","last_undegraded":"2024-09-11T07:09:08.231382+0000","last_fullsized":"2024-09-11T07:09:08.231382+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":462,"log_dups_size":0,"ondisk_log_size":462,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018328699999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5357,"num_read_kb":20493,"num_write":487,"num_write_kb":10685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":353,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.233183+0000","last_change":"2024-09-11T07:05:51.161621+0000","last_active":"2024-09-11T07:09:08.233183+0000","last_peered":"2024-09-11T07:09:08.233183+0000","last_clean":"2024-09-11T07:09:08.233183+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:09:08.233183+0000","last_undegraded":"2024-09-11T07:09:08.233183+0000","last_fullsized":"2024-09-11T07:09:08.233183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:48.116397+0000","last_clean_scrub_stamp":"2024-09-11T07:05:48.116397+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:10:54.810085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":529,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187056+0000","last_change":"2024-09-11T07:08:13.093650+0000","last_active":"2024-09-11T07:09:07.187056+0000","last_peered":"2024-09-11T07:09:07.187056+0000","last_clean":"2024-09-11T07:09:07.187056+0000","last_became_active":"2024-09-11T07:08:13.085823+0000","last_became_peered":"2024-09-11T07:08:13.085823+0000","last_unstale":"2024-09-11T07:09:07.187056+0000","last_undegraded":"2024-09-11T07:09:07.187056+0000","last_fullsized":"2024-09-11T07:09:07.187056+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:42.054593+0000","last_clean_scrub_stamp":"2024-09-11T07:05:42.054593+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:12:40.664683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"186'450","reported_seq":3595,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:16.737706+0000","last_change":"2024-09-11T07:09:16.737782+0000","last_active":"2024-09-11T07:09:16.737706+0000","last_peered":"2024-09-11T07:09:16.737706+0000","last_clean":"2024-09-11T07:09:16.737706+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:09:16.737706+0000","last_undegraded":"2024-09-11T07:09:16.737706+0000","last_fullsized":"2024-09-11T07:09:16.737706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'450","last_scrub_stamp":"2024-09-11T07:09:16.737606+0000","last_deep_scrub":"186'450","last_deep_scrub_stamp":"2024-09-11T07:09:16.737606+0000","last_clean_scrub_stamp":"2024-09-11T07:09:16.737606+0000","objects_scrubbed":33,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:18.190505+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.001886642,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3136,"num_read_kb":12190,"num_write":362,"num_write_kb":7014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"164'299","reported_seq":2287,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.232569+0000","last_change":"2024-09-11T07:09:02.151236+0000","last_active":"2024-09-11T07:09:08.232569+0000","last_peered":"2024-09-11T07:09:08.232569+0000","last_clean":"2024-09-11T07:09:08.232569+0000","last_became_active":"2024-09-11T07:09:02.146228+0000","last_became_peered":"2024-09-11T07:09:02.146228+0000","last_unstale":"2024-09-11T07:09:08.232569+0000","last_undegraded":"2024-09-11T07:09:08.232569+0000","last_fullsized":"2024-09-11T07:09:08.232569+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":299,"log_dups_size":0,"ondisk_log_size":299,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:06:14.189857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010147260000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":1603,"num_read_kb":8035,"num_write":242,"num_write_kb":8539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":4236596,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"167'604","reported_seq":5585,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187660+0000","last_change":"2024-09-11T07:09:06.177501+0000","last_active":"2024-09-11T07:09:07.187660+0000","last_peered":"2024-09-11T07:09:07.187660+0000","last_clean":"2024-09-11T07:09:07.187660+0000","last_became_active":"2024-09-11T07:09:06.175303+0000","last_became_peered":"2024-09-11T07:09:06.175303+0000","last_unstale":"2024-09-11T07:09:07.187660+0000","last_undegraded":"2024-09-11T07:09:07.187660+0000","last_fullsized":"2024-09-11T07:09:07.187660+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":604,"log_dups_size":0,"ondisk_log_size":604,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:11:00.818882+0000","scrub_duration":0,"objects_trimmed":2,"snaptrim_duration":0.0083757740000000008,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":7105,"num_read_kb":12374,"num_write":638,"num_write_kb":6832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":288,"num_bytes_recovered":4540944,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"167'554","reported_seq":3897,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.231491+0000","last_change":"2024-09-11T07:08:48.202794+0000","last_active":"2024-09-11T07:09:08.231491+0000","last_peered":"2024-09-11T07:09:08.231491+0000","last_clean":"2024-09-11T07:09:08.231491+0000","last_became_active":"2024-09-11T07:08:13.094279+0000","last_became_peered":"2024-09-11T07:08:13.094279+0000","last_unstale":"2024-09-11T07:09:08.231491+0000","last_undegraded":"2024-09-11T07:09:08.231491+0000","last_fullsized":"2024-09-11T07:09:08.231491+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":554,"log_dups_size":0,"ondisk_log_size":554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0022690100000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5323,"num_read_kb":21130,"num_write":584,"num_write_kb":14713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":42089319,"num_keys_recovered":120,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"167'374","reported_seq":3083,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:08.233501+0000","last_change":"2024-09-11T07:08:48.086616+0000","last_active":"2024-09-11T07:09:08.233501+0000","last_peered":"2024-09-11T07:09:08.233501+0000","last_clean":"2024-09-11T07:09:08.233501+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:09:08.233501+0000","last_undegraded":"2024-09-11T07:09:08.233501+0000","last_fullsized":"2024-09-11T07:09:08.233501+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:54:14.712547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0032901720000000001,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":2243,"num_read_kb":7360,"num_write":303,"num_write_kb":6081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"166'472","reported_seq":4057,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187174+0000","last_change":"2024-09-11T07:08:48.077078+0000","last_active":"2024-09-11T07:09:07.187174+0000","last_peered":"2024-09-11T07:09:07.187174+0000","last_clean":"2024-09-11T07:09:07.187174+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:09:07.187174+0000","last_undegraded":"2024-09-11T07:09:07.187174+0000","last_fullsized":"2024-09-11T07:09:07.187174+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:03:01.423208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0048801529999999999,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":5047,"num_read_kb":19575,"num_write":443,"num_write_kb":9370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"168'510","reported_seq":3756,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187328+0000","last_change":"2024-09-11T07:08:54.863283+0000","last_active":"2024-09-11T07:09:07.187328+0000","last_peered":"2024-09-11T07:09:07.187328+0000","last_clean":"2024-09-11T07:09:07.187328+0000","last_became_active":"2024-09-11T07:08:54.860099+0000","last_became_peered":"2024-09-11T07:08:54.860099+0000","last_unstale":"2024-09-11T07:09:07.187328+0000","last_undegraded":"2024-09-11T07:09:07.187328+0000","last_fullsized":"2024-09-11T07:09:07.187328+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":510,"log_dups_size":0,"ondisk_log_size":510,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:28:05.233558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0058914980000000002,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5468,"num_read_kb":40931,"num_write":483,"num_write_kb":33825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":29182336,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"164'908","reported_seq":5692,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187215+0000","last_change":"2024-09-11T07:08:59.860723+0000","last_active":"2024-09-11T07:09:07.187215+0000","last_peered":"2024-09-11T07:09:07.187215+0000","last_clean":"2024-09-11T07:09:07.187215+0000","last_became_active":"2024-09-11T07:08:59.857371+0000","last_became_peered":"2024-09-11T07:08:59.857371+0000","last_unstale":"2024-09-11T07:09:07.187215+0000","last_undegraded":"2024-09-11T07:09:07.187215+0000","last_fullsized":"2024-09-11T07:09:07.187215+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":908,"log_dups_size":0,"ondisk_log_size":908,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:35:39.427043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0037300609999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7268,"num_read_kb":23165,"num_write":1135,"num_write_kb":16436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":309,"num_bytes_recovered":38565066,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"164'1332","reported_seq":3550,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:48.072601+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:12.088833+0000","last_became_peered":"2024-09-11T07:08:12.088833+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":1332,"log_dups_size":0,"ondisk_log_size":1332,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:16:10.966554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0025943210000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7126,"num_read_kb":16929,"num_write":1954,"num_write_kb":15903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":5558122,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"166'305","reported_seq":4432,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.186697+0000","last_change":"2024-09-11T07:08:57.881661+0000","last_active":"2024-09-11T07:09:07.186697+0000","last_peered":"2024-09-11T07:09:07.186697+0000","last_clean":"2024-09-11T07:09:07.186697+0000","last_became_active":"2024-09-11T07:08:57.878966+0000","last_became_peered":"2024-09-11T07:08:57.878966+0000","last_unstale":"2024-09-11T07:09:07.186697+0000","last_undegraded":"2024-09-11T07:09:07.186697+0000","last_fullsized":"2024-09-11T07:09:07.186697+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":305,"log_dups_size":0,"ondisk_log_size":305,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:57:28.004494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0030609069999999999,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":3180,"num_read_kb":9248,"num_write":258,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":2139720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"168'502","reported_seq":6668,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.188379+0000","last_change":"2024-09-11T07:08:48.121587+0000","last_active":"2024-09-11T07:09:07.188379+0000","last_peered":"2024-09-11T07:09:07.188379+0000","last_clean":"2024-09-11T07:09:07.188379+0000","last_became_active":"2024-09-11T07:08:12.092494+0000","last_became_peered":"2024-09-11T07:08:12.092494+0000","last_unstale":"2024-09-11T07:09:07.188379+0000","last_undegraded":"2024-09-11T07:09:07.188379+0000","last_fullsized":"2024-09-11T07:09:07.188379+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":502,"log_dups_size":0,"ondisk_log_size":502,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011861700000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":6702,"num_read_kb":31801,"num_write":602,"num_write_kb":10266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":13150126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"166'597","reported_seq":3338,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:07.187361+0000","last_change":"2024-09-11T07:08:58.859305+0000","last_active":"2024-09-11T07:09:07.187361+0000","last_peered":"2024-09-11T07:09:07.187361+0000","last_clean":"2024-09-11T07:09:07.187361+0000","last_became_active":"2024-09-11T07:08:58.856080+0000","last_became_peered":"2024-09-11T07:08:58.856080+0000","last_unstale":"2024-09-11T07:09:07.187361+0000","last_undegraded":"2024-09-11T07:09:07.187361+0000","last_fullsized":"2024-09-11T07:09:07.187361+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:05:58.184216+0000","last_clean_scrub_stamp":"2024-09-11T07:05:58.184216+0000","objects_scrubbed":0,"log_size":597,"log_dups_size":0,"ondisk_log_size":597,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:54:44.826014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0019838210000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3601,"num_read_kb":5499,"num_write":635,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":826886,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":952,"num_object_clones":0,"num_object_copies":1904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":952,"num_whiteouts":948,"num_read":171813,"num_read_kb":628353,"num_write":19992,"num_write_kb":415358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4495,"num_bytes_recovered":292360160,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18581,"ondisk_log_size":18581,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":19129,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574894,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47332,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324508,"statfs":{"total":96636764160,"available":96588296192,"internally_reserved":0,"allocated":2301952,"data_stored":1675772,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":46135753},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33376,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338464,"statfs":{"total":96636764160,"available":96602587136,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59752,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312088,"statfs":{"total":96636764160,"available":96575578112,"internally_reserved":0,"allocated":2248704,"data_stored":1085423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":58915268},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51436,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94320404,"statfs":{"total":96636764160,"available":96584093696,"internally_reserved":0,"allocated":2248704,"data_stored":1085423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":50395588},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":54655430},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41700,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330140,"statfs":{"total":96636764160,"available":96594063360,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55596,"kb_used_data":2200,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316244,"statfs":{"total":96636764160,"available":96579833856,"internally_reserved":0,"allocated":2252800,"data_stored":1085442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55624,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316216,"statfs":{"total":96636764160,"available":96579805184,"internally_reserved":0,"allocated":2285568,"data_stored":1675772,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:09:18.805 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.806 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.806 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.806 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.806 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.806 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.806 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.806 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.806 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.806 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.806 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.807 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.807 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-11T07:05:48.116397+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=48, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.807 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.807 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-11T07:05:48.116397+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=48, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.807 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.807 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-11T07:05:48.116397+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=48, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.807 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.807 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.807 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-11T07:05:48.116397+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=48, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.808 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.808 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.808 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.808 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-11T07:05:48.116397+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=48, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.808 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-11T07:05:42.054593+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=42, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.808 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.808 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.808 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.808 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.809 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.809 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.809 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.809 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.809 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.809 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.809 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-11T07:05:58.184216+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=5, tm_sec=58, tm_wday=2, tm_yday=255, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=11, tm_hour=7, tm_min=9, tm_sec=13, tm_wday=2, tm_yday=255, tm_isdst=0) 2024-09-11T07:09:18.809 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-11T07:09:38.811 DEBUG:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-11T07:09:39.118 INFO:teuthology.orchestra.run.smithi079.stdout: 2024-09-11T07:09:39.119 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2024-09-11T07:09:39.135 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-09-11T07:09:37.875345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590406,"num_objects":956,"num_object_clones":0,"num_object_copies":1912,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":956,"num_whiteouts":948,"num_read":171929,"num_read_kb":628453,"num_write":20153,"num_write_kb":417776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4499,"num_bytes_recovered":293540896,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19585,"ondisk_log_size":19585,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":82,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":408688,"kb_used_data":17648,"kb_used_omap":12,"kb_used_meta":390899,"kb_avail":754566032,"statfs":{"total":773094113280,"available":772675616768,"internally_reserved":0,"allocated":18071552,"data_stored":9864044,"data_compressed":12474,"data_compressed_allocated":73728,"data_compressed_original":1163264,"omap_allocated":12760,"internal_metadata":400281128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003479"},"pg_stats":[{"pgid":"3.1f","version":"186'494","reported_seq":3106,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:18.916532+0000","last_change":"2024-09-11T07:09:18.916566+0000","last_active":"2024-09-11T07:09:18.916532+0000","last_peered":"2024-09-11T07:09:18.916532+0000","last_clean":"2024-09-11T07:09:18.916532+0000","last_became_active":"2024-09-11T07:08:13.087864+0000","last_became_peered":"2024-09-11T07:08:13.087864+0000","last_unstale":"2024-09-11T07:09:18.916532+0000","last_undegraded":"2024-09-11T07:09:18.916532+0000","last_fullsized":"2024-09-11T07:09:18.916532+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'494","last_scrub_stamp":"2024-09-11T07:09:18.916440+0000","last_deep_scrub":"186'494","last_deep_scrub_stamp":"2024-09-11T07:09:18.916440+0000","last_clean_scrub_stamp":"2024-09-11T07:09:18.916440+0000","objects_scrubbed":26,"log_size":494,"log_dups_size":0,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:13:30.621955+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0028069940000000002,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":2694,"num_read_kb":5154,"num_write":552,"num_write_kb":22529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":3432884,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"186'440","reported_seq":2245,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:19.748079+0000","last_change":"2024-09-11T07:09:19.748151+0000","last_active":"2024-09-11T07:09:19.748079+0000","last_peered":"2024-09-11T07:09:19.748079+0000","last_clean":"2024-09-11T07:09:19.748079+0000","last_became_active":"2024-09-11T07:05:58.830423+0000","last_became_peered":"2024-09-11T07:05:58.830423+0000","last_unstale":"2024-09-11T07:09:19.748079+0000","last_undegraded":"2024-09-11T07:09:19.748079+0000","last_fullsized":"2024-09-11T07:09:19.748079+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'440","last_scrub_stamp":"2024-09-11T07:09:19.747904+0000","last_deep_scrub":"186'440","last_deep_scrub_stamp":"2024-09-11T07:09:19.747904+0000","last_clean_scrub_stamp":"2024-09-11T07:09:19.747904+0000","objects_scrubbed":28,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T19:00:45.741217+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.0028533249999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":1677,"num_read_kb":19454,"num_write":399,"num_write_kb":12631,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1d","version":"186'684","reported_seq":13027,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:23.251011+0000","last_change":"2024-09-11T07:09:23.251105+0000","last_active":"2024-09-11T07:09:23.251011+0000","last_peered":"2024-09-11T07:09:23.251011+0000","last_clean":"2024-09-11T07:09:23.251011+0000","last_became_active":"2024-09-11T07:08:55.865799+0000","last_became_peered":"2024-09-11T07:08:55.865799+0000","last_unstale":"2024-09-11T07:09:23.251011+0000","last_undegraded":"2024-09-11T07:09:23.251011+0000","last_fullsized":"2024-09-11T07:09:23.251011+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'684","last_scrub_stamp":"2024-09-11T07:09:23.250821+0000","last_deep_scrub":"186'684","last_deep_scrub_stamp":"2024-09-11T07:09:23.250821+0000","last_clean_scrub_stamp":"2024-09-11T07:09:23.250821+0000","objects_scrubbed":35,"log_size":684,"log_dups_size":0,"ondisk_log_size":684,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T17:55:31.765139+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0019228699999999999,"stat_sum":{"num_bytes":0,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":35,"num_read":13982,"num_read_kb":66796,"num_write":768,"num_write_kb":14794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":224,"num_bytes_recovered":5987441,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1c","version":"186'945","reported_seq":4725,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:24.210900+0000","last_change":"2024-09-11T07:09:24.210995+0000","last_active":"2024-09-11T07:09:24.210900+0000","last_peered":"2024-09-11T07:09:24.210900+0000","last_clean":"2024-09-11T07:09:24.210900+0000","last_became_active":"2024-09-11T07:08:57.881857+0000","last_became_peered":"2024-09-11T07:08:57.881857+0000","last_unstale":"2024-09-11T07:09:24.210900+0000","last_undegraded":"2024-09-11T07:09:24.210900+0000","last_fullsized":"2024-09-11T07:09:24.210900+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'945","last_scrub_stamp":"2024-09-11T07:09:24.210679+0000","last_deep_scrub":"186'945","last_deep_scrub_stamp":"2024-09-11T07:09:24.210679+0000","last_clean_scrub_stamp":"2024-09-11T07:09:24.210679+0000","objects_scrubbed":36,"log_size":945,"log_dups_size":0,"ondisk_log_size":945,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:04:47.139565+0000","scrub_duration":75,"objects_trimmed":0,"snaptrim_duration":0.0021881650000000002,"stat_sum":{"num_bytes":0,"num_objects":36,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":35,"num_read":5039,"num_read_kb":16054,"num_write":1190,"num_write_kb":13844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":229,"num_bytes_recovered":6996622,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"186'578","reported_seq":6930,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:21.983253+0000","last_change":"2024-09-11T07:09:21.983432+0000","last_active":"2024-09-11T07:09:21.983253+0000","last_peered":"2024-09-11T07:09:21.983253+0000","last_clean":"2024-09-11T07:09:21.983253+0000","last_became_active":"2024-09-11T07:08:57.880103+0000","last_became_peered":"2024-09-11T07:08:57.880103+0000","last_unstale":"2024-09-11T07:09:21.983253+0000","last_undegraded":"2024-09-11T07:09:21.983253+0000","last_fullsized":"2024-09-11T07:09:21.983253+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'578","last_scrub_stamp":"2024-09-11T07:09:21.983036+0000","last_deep_scrub":"186'578","last_deep_scrub_stamp":"2024-09-11T07:09:21.983036+0000","last_clean_scrub_stamp":"2024-09-11T07:09:21.983036+0000","objects_scrubbed":39,"log_size":578,"log_dups_size":0,"ondisk_log_size":578,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:41:46.743766+0000","scrub_duration":63,"objects_trimmed":0,"snaptrim_duration":0.0025371069999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":8318,"num_read_kb":11321,"num_write":542,"num_write_kb":4670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":342,"num_bytes_recovered":4425669,"num_keys_recovered":47,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"186'562","reported_seq":5125,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:17.405757+0000","last_change":"2024-09-11T07:09:17.405865+0000","last_active":"2024-09-11T07:09:17.405757+0000","last_peered":"2024-09-11T07:09:17.405757+0000","last_clean":"2024-09-11T07:09:17.405757+0000","last_became_active":"2024-09-11T07:09:02.145138+0000","last_became_peered":"2024-09-11T07:09:02.145138+0000","last_unstale":"2024-09-11T07:09:17.405757+0000","last_undegraded":"2024-09-11T07:09:17.405757+0000","last_fullsized":"2024-09-11T07:09:17.405757+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'562","last_scrub_stamp":"2024-09-11T07:09:17.405564+0000","last_deep_scrub":"186'562","last_deep_scrub_stamp":"2024-09-11T07:09:17.405564+0000","last_clean_scrub_stamp":"2024-09-11T07:09:17.405564+0000","objects_scrubbed":42,"log_size":562,"log_dups_size":0,"ondisk_log_size":562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:43:31.256968+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0024466639999999999,"stat_sum":{"num_bytes":19,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":41,"num_read":6616,"num_read_kb":11567,"num_write":528,"num_write_kb":10022,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":105,"num_bytes_recovered":3177242,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"186'507","reported_seq":2181,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:17.002926+0000","last_change":"2024-09-11T07:09:17.003025+0000","last_active":"2024-09-11T07:09:17.002926+0000","last_peered":"2024-09-11T07:09:17.002926+0000","last_clean":"2024-09-11T07:09:17.002926+0000","last_became_active":"2024-09-11T07:05:58.808377+0000","last_became_peered":"2024-09-11T07:05:58.808377+0000","last_unstale":"2024-09-11T07:09:17.002926+0000","last_undegraded":"2024-09-11T07:09:17.002926+0000","last_fullsized":"2024-09-11T07:09:17.002926+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'507","last_scrub_stamp":"2024-09-11T07:09:17.002770+0000","last_deep_scrub":"186'507","last_deep_scrub_stamp":"2024-09-11T07:09:17.002770+0000","last_clean_scrub_stamp":"2024-09-11T07:09:17.002770+0000","objects_scrubbed":24,"log_size":507,"log_dups_size":0,"ondisk_log_size":507,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:56:06.670632+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0016777719999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":2274,"num_read_kb":6232,"num_write":578,"num_write_kb":4313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"186'760","reported_seq":4930,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:21.747833+0000","last_change":"2024-09-11T07:09:21.747932+0000","last_active":"2024-09-11T07:09:21.747833+0000","last_peered":"2024-09-11T07:09:21.747833+0000","last_clean":"2024-09-11T07:09:21.747833+0000","last_became_active":"2024-09-11T07:08:14.106879+0000","last_became_peered":"2024-09-11T07:08:14.106879+0000","last_unstale":"2024-09-11T07:09:21.747833+0000","last_undegraded":"2024-09-11T07:09:21.747833+0000","last_fullsized":"2024-09-11T07:09:21.747833+0000","mapping_epoch":133,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":134,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'760","last_scrub_stamp":"2024-09-11T07:09:21.747629+0000","last_deep_scrub":"186'760","last_deep_scrub_stamp":"2024-09-11T07:09:21.747629+0000","last_clean_scrub_stamp":"2024-09-11T07:09:21.747629+0000","objects_scrubbed":37,"log_size":760,"log_dups_size":0,"ondisk_log_size":760,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:44:57.570621+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0013481490000000001,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":37,"num_read":6716,"num_read_kb":13771,"num_write":714,"num_write_kb":21799,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":9689178,"num_keys_recovered":34,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"186'472","reported_seq":6721,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:19.955902+0000","last_change":"2024-09-11T07:09:19.955981+0000","last_active":"2024-09-11T07:09:19.955902+0000","last_peered":"2024-09-11T07:09:19.955902+0000","last_clean":"2024-09-11T07:09:19.955902+0000","last_became_active":"2024-09-11T07:08:21.855245+0000","last_became_peered":"2024-09-11T07:08:21.855245+0000","last_unstale":"2024-09-11T07:09:19.955902+0000","last_undegraded":"2024-09-11T07:09:19.955902+0000","last_fullsized":"2024-09-11T07:09:19.955902+0000","mapping_epoch":141,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":142,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'472","last_scrub_stamp":"2024-09-11T07:09:19.955625+0000","last_deep_scrub":"186'472","last_deep_scrub_stamp":"2024-09-11T07:09:19.955625+0000","last_clean_scrub_stamp":"2024-09-11T07:09:19.955625+0000","objects_scrubbed":27,"log_size":472,"log_dups_size":0,"ondisk_log_size":472,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:24:56.329285+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.0020224750000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":6674,"num_read_kb":41299,"num_write":387,"num_write_kb":21088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":290,"num_bytes_recovered":28975126,"num_keys_recovered":92,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"186'715","reported_seq":4267,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:22.186761+0000","last_change":"2024-09-11T07:09:22.186855+0000","last_active":"2024-09-11T07:09:22.186761+0000","last_peered":"2024-09-11T07:09:22.186761+0000","last_clean":"2024-09-11T07:09:22.186761+0000","last_became_active":"2024-09-11T07:05:58.833263+0000","last_became_peered":"2024-09-11T07:05:58.833263+0000","last_unstale":"2024-09-11T07:09:22.186761+0000","last_undegraded":"2024-09-11T07:09:22.186761+0000","last_fullsized":"2024-09-11T07:09:22.186761+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'715","last_scrub_stamp":"2024-09-11T07:09:22.186546+0000","last_deep_scrub":"186'715","last_deep_scrub_stamp":"2024-09-11T07:09:22.186546+0000","last_clean_scrub_stamp":"2024-09-11T07:09:22.186546+0000","objects_scrubbed":27,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:41:27.281671+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0033666669999999998,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5507,"num_read_kb":16321,"num_write":723,"num_write_kb":8687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"186'516","reported_seq":4264,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:19.447223+0000","last_change":"2024-09-11T07:09:19.447362+0000","last_active":"2024-09-11T07:09:19.447223+0000","last_peered":"2024-09-11T07:09:19.447223+0000","last_clean":"2024-09-11T07:09:19.447223+0000","last_became_active":"2024-09-11T07:05:58.832241+0000","last_became_peered":"2024-09-11T07:05:58.832241+0000","last_unstale":"2024-09-11T07:09:19.447223+0000","last_undegraded":"2024-09-11T07:09:19.447223+0000","last_fullsized":"2024-09-11T07:09:19.447223+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'516","last_scrub_stamp":"2024-09-11T07:09:19.447030+0000","last_deep_scrub":"186'516","last_deep_scrub_stamp":"2024-09-11T07:09:19.447030+0000","last_clean_scrub_stamp":"2024-09-11T07:09:19.447030+0000","objects_scrubbed":33,"log_size":516,"log_dups_size":0,"ondisk_log_size":516,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:35:39.122924+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0041864520000000002,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":4880,"num_read_kb":24721,"num_write":443,"num_write_kb":20423,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"186'623","reported_seq":4888,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:20.369856+0000","last_change":"2024-09-11T07:09:20.369924+0000","last_active":"2024-09-11T07:09:20.369856+0000","last_peered":"2024-09-11T07:09:20.369856+0000","last_clean":"2024-09-11T07:09:20.369856+0000","last_became_active":"2024-09-11T07:09:02.149433+0000","last_became_peered":"2024-09-11T07:09:02.149433+0000","last_unstale":"2024-09-11T07:09:20.369856+0000","last_undegraded":"2024-09-11T07:09:20.369856+0000","last_fullsized":"2024-09-11T07:09:20.369856+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'623","last_scrub_stamp":"2024-09-11T07:09:20.369650+0000","last_deep_scrub":"186'623","last_deep_scrub_stamp":"2024-09-11T07:09:20.369650+0000","last_clean_scrub_stamp":"2024-09-11T07:09:20.369650+0000","objects_scrubbed":25,"log_size":623,"log_dups_size":0,"ondisk_log_size":623,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:19:37.541367+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.001012333,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6911,"num_read_kb":17769,"num_write":573,"num_write_kb":7208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":100,"num_bytes_recovered":3955769,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":272,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:18.521188+0000","last_change":"2024-09-11T07:09:18.521248+0000","last_active":"2024-09-11T07:09:18.521188+0000","last_peered":"2024-09-11T07:09:18.521188+0000","last_clean":"2024-09-11T07:09:18.521188+0000","last_became_active":"2024-09-11T07:07:24.114181+0000","last_became_peered":"2024-09-11T07:07:24.114181+0000","last_unstale":"2024-09-11T07:09:18.521188+0000","last_undegraded":"2024-09-11T07:09:18.521188+0000","last_fullsized":"2024-09-11T07:09:18.521188+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:09:18.520968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:09:18.520968+0000","last_clean_scrub_stamp":"2024-09-11T07:09:18.520968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:46:32.817427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"186'667","reported_seq":4103,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:16.878646+0000","last_change":"2024-09-11T07:09:16.878734+0000","last_active":"2024-09-11T07:09:16.878646+0000","last_peered":"2024-09-11T07:09:16.878646+0000","last_clean":"2024-09-11T07:09:16.878646+0000","last_became_active":"2024-09-11T07:08:11.076673+0000","last_became_peered":"2024-09-11T07:08:11.076673+0000","last_unstale":"2024-09-11T07:09:16.878646+0000","last_undegraded":"2024-09-11T07:09:16.878646+0000","last_fullsized":"2024-09-11T07:09:16.878646+0000","mapping_epoch":130,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":131,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'667","last_scrub_stamp":"2024-09-11T07:09:16.878511+0000","last_deep_scrub":"186'667","last_deep_scrub_stamp":"2024-09-11T07:09:16.878511+0000","last_clean_scrub_stamp":"2024-09-11T07:09:16.878511+0000","objects_scrubbed":39,"log_size":667,"log_dups_size":0,"ondisk_log_size":667,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:11:00.163019+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0024495049999999998,"stat_sum":{"num_bytes":0,"num_objects":39,"num_object_clones":0,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":39,"num_read":4338,"num_read_kb":14044,"num_write":542,"num_write_kb":8487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":286,"num_bytes_recovered":16056304,"num_keys_recovered":12,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":359,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:15.972450+0000","last_change":"2024-09-11T07:09:15.972488+0000","last_active":"2024-09-11T07:09:15.972450+0000","last_peered":"2024-09-11T07:09:15.972450+0000","last_clean":"2024-09-11T07:09:15.972450+0000","last_became_active":"2024-09-11T07:05:49.150041+0000","last_became_peered":"2024-09-11T07:05:49.150041+0000","last_unstale":"2024-09-11T07:09:15.972450+0000","last_undegraded":"2024-09-11T07:09:15.972450+0000","last_fullsized":"2024-09-11T07:09:15.972450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:09:15.972331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:09:15.972331+0000","last_clean_scrub_stamp":"2024-09-11T07:09:15.972331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:17.202360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001087705,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"186'709","reported_seq":2634,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:17.758338+0000","last_change":"2024-09-11T07:09:17.758368+0000","last_active":"2024-09-11T07:09:17.758338+0000","last_peered":"2024-09-11T07:09:17.758338+0000","last_clean":"2024-09-11T07:09:17.758338+0000","last_became_active":"2024-09-11T07:05:58.814775+0000","last_became_peered":"2024-09-11T07:05:58.814775+0000","last_unstale":"2024-09-11T07:09:17.758338+0000","last_undegraded":"2024-09-11T07:09:17.758338+0000","last_fullsized":"2024-09-11T07:09:17.758338+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'709","last_scrub_stamp":"2024-09-11T07:09:17.758275+0000","last_deep_scrub":"186'709","last_deep_scrub_stamp":"2024-09-11T07:09:17.758275+0000","last_clean_scrub_stamp":"2024-09-11T07:09:17.758275+0000","objects_scrubbed":29,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:54:19.942986+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0023129169999999998,"stat_sum":{"num_bytes":0,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":29,"num_read":4034,"num_read_kb":11596,"num_write":855,"num_write_kb":5688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":376,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:21.317152+0000","last_change":"2024-09-11T07:09:21.317205+0000","last_active":"2024-09-11T07:09:21.317152+0000","last_peered":"2024-09-11T07:09:21.317152+0000","last_clean":"2024-09-11T07:09:21.317152+0000","last_became_active":"2024-09-11T07:08:08.033647+0000","last_became_peered":"2024-09-11T07:08:08.033647+0000","last_unstale":"2024-09-11T07:09:21.317152+0000","last_undegraded":"2024-09-11T07:09:21.317152+0000","last_fullsized":"2024-09-11T07:09:21.317152+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:09:21.316934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:09:21.316934+0000","last_clean_scrub_stamp":"2024-09-11T07:09:21.316934+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:15:28.242857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00091551000000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"186'540","reported_seq":5241,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:18.965263+0000","last_change":"2024-09-11T07:09:18.965313+0000","last_active":"2024-09-11T07:09:18.965263+0000","last_peered":"2024-09-11T07:09:18.965263+0000","last_clean":"2024-09-11T07:09:18.965263+0000","last_became_active":"2024-09-11T07:05:59.016043+0000","last_became_peered":"2024-09-11T07:05:59.016043+0000","last_unstale":"2024-09-11T07:09:18.965263+0000","last_undegraded":"2024-09-11T07:09:18.965263+0000","last_fullsized":"2024-09-11T07:09:18.965263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'540","last_scrub_stamp":"2024-09-11T07:09:18.965165+0000","last_deep_scrub":"186'540","last_deep_scrub_stamp":"2024-09-11T07:09:18.965165+0000","last_clean_scrub_stamp":"2024-09-11T07:09:18.965165+0000","objects_scrubbed":25,"log_size":540,"log_dups_size":0,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:10:34.362094+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.002205477,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":25,"num_read":6066,"num_read_kb":28471,"num_write":492,"num_write_kb":12910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":369,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:19.947276+0000","last_change":"2024-09-11T07:09:19.947317+0000","last_active":"2024-09-11T07:09:19.947276+0000","last_peered":"2024-09-11T07:09:19.947276+0000","last_clean":"2024-09-11T07:09:19.947276+0000","last_became_active":"2024-09-11T07:08:08.035491+0000","last_became_peered":"2024-09-11T07:08:08.035491+0000","last_unstale":"2024-09-11T07:09:19.947276+0000","last_undegraded":"2024-09-11T07:09:19.947276+0000","last_fullsized":"2024-09-11T07:09:19.947276+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:09:19.947120+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:09:19.947120+0000","last_clean_scrub_stamp":"2024-09-11T07:09:19.947120+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T12:50:52.988781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.000948382,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"186'571","reported_seq":3004,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:21.215340+0000","last_change":"2024-09-11T07:09:21.215475+0000","last_active":"2024-09-11T07:09:21.215340+0000","last_peered":"2024-09-11T07:09:21.215340+0000","last_clean":"2024-09-11T07:09:21.215340+0000","last_became_active":"2024-09-11T07:05:58.824491+0000","last_became_peered":"2024-09-11T07:05:58.824491+0000","last_unstale":"2024-09-11T07:09:21.215340+0000","last_undegraded":"2024-09-11T07:09:21.215340+0000","last_fullsized":"2024-09-11T07:09:21.215340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'571","last_scrub_stamp":"2024-09-11T07:09:21.215113+0000","last_deep_scrub":"186'571","last_deep_scrub_stamp":"2024-09-11T07:09:21.215113+0000","last_clean_scrub_stamp":"2024-09-11T07:09:21.215113+0000","objects_scrubbed":31,"log_size":571,"log_dups_size":0,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:12:52.925750+0000","scrub_duration":51,"objects_trimmed":0,"snaptrim_duration":0.0042550620000000004,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":3092,"num_read_kb":8737,"num_write":637,"num_write_kb":5048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"186'763","reported_seq":4533,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:19.404604+0000","last_change":"2024-09-11T07:09:19.404725+0000","last_active":"2024-09-11T07:09:19.404604+0000","last_peered":"2024-09-11T07:09:19.404604+0000","last_clean":"2024-09-11T07:09:19.404604+0000","last_became_active":"2024-09-11T07:09:02.147735+0000","last_became_peered":"2024-09-11T07:09:02.147735+0000","last_unstale":"2024-09-11T07:09:19.404604+0000","last_undegraded":"2024-09-11T07:09:19.404604+0000","last_fullsized":"2024-09-11T07:09:19.404604+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'763","last_scrub_stamp":"2024-09-11T07:09:19.404399+0000","last_deep_scrub":"186'763","last_deep_scrub_stamp":"2024-09-11T07:09:19.404399+0000","last_clean_scrub_stamp":"2024-09-11T07:09:19.404399+0000","objects_scrubbed":25,"log_size":763,"log_dups_size":0,"ondisk_log_size":763,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T14:26:23.623808+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0020874370000000001,"stat_sum":{"num_bytes":0,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":24,"num_read":5018,"num_read_kb":11581,"num_write":787,"num_write_kb":11396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":7952009,"num_keys_recovered":11,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"186'3","reported_seq":364,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:18.160888+0000","last_change":"2024-09-11T07:09:18.161046+0000","last_active":"2024-09-11T07:09:18.160888+0000","last_peered":"2024-09-11T07:09:18.160888+0000","last_clean":"2024-09-11T07:09:18.160888+0000","last_became_active":"2024-09-11T07:05:49.145801+0000","last_became_peered":"2024-09-11T07:05:49.145801+0000","last_unstale":"2024-09-11T07:09:18.160888+0000","last_undegraded":"2024-09-11T07:09:18.160888+0000","last_fullsized":"2024-09-11T07:09:18.160888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'3","last_scrub_stamp":"2024-09-11T07:09:18.160663+0000","last_deep_scrub":"186'3","last_deep_scrub_stamp":"2024-09-11T07:09:18.160663+0000","last_clean_scrub_stamp":"2024-09-11T07:09:18.160663+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:37:30.777546+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001866146,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.0","version":"186'709","reported_seq":5279,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:17.962421+0000","last_change":"2024-09-11T07:09:17.962453+0000","last_active":"2024-09-11T07:09:17.962421+0000","last_peered":"2024-09-11T07:09:17.962421+0000","last_clean":"2024-09-11T07:09:17.962421+0000","last_became_active":"2024-09-11T07:05:59.015925+0000","last_became_peered":"2024-09-11T07:05:59.015925+0000","last_unstale":"2024-09-11T07:09:17.962421+0000","last_undegraded":"2024-09-11T07:09:17.962421+0000","last_fullsized":"2024-09-11T07:09:17.962421+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'709","last_scrub_stamp":"2024-09-11T07:09:17.962325+0000","last_deep_scrub":"186'709","last_deep_scrub_stamp":"2024-09-11T07:09:17.962325+0000","last_clean_scrub_stamp":"2024-09-11T07:09:17.962325+0000","objects_scrubbed":26,"log_size":709,"log_dups_size":0,"ondisk_log_size":709,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:21:48.936893+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0.0011597129999999999,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":5953,"num_read_kb":41533,"num_write":674,"num_write_kb":33951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":360,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:16.868052+0000","last_change":"2024-09-11T07:09:16.868096+0000","last_active":"2024-09-11T07:09:16.868052+0000","last_peered":"2024-09-11T07:09:16.868052+0000","last_clean":"2024-09-11T07:09:16.868052+0000","last_became_active":"2024-09-11T07:05:49.153939+0000","last_became_peered":"2024-09-11T07:05:49.153939+0000","last_unstale":"2024-09-11T07:09:16.868052+0000","last_undegraded":"2024-09-11T07:09:16.868052+0000","last_fullsized":"2024-09-11T07:09:16.868052+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:09:16.867946+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:09:16.867946+0000","last_clean_scrub_stamp":"2024-09-11T07:09:16.867946+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:23:42.490102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.000815656,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"186'496","reported_seq":8866,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:20.929632+0000","last_change":"2024-09-11T07:09:20.929737+0000","last_active":"2024-09-11T07:09:20.929632+0000","last_peered":"2024-09-11T07:09:20.929632+0000","last_clean":"2024-09-11T07:09:20.929632+0000","last_became_active":"2024-09-11T07:08:55.865598+0000","last_became_peered":"2024-09-11T07:08:55.865598+0000","last_unstale":"2024-09-11T07:09:20.929632+0000","last_undegraded":"2024-09-11T07:09:20.929632+0000","last_fullsized":"2024-09-11T07:09:20.929632+0000","mapping_epoch":174,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":175,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'496","last_scrub_stamp":"2024-09-11T07:09:20.929456+0000","last_deep_scrub":"186'496","last_deep_scrub_stamp":"2024-09-11T07:09:20.929456+0000","last_clean_scrub_stamp":"2024-09-11T07:09:20.929456+0000","objects_scrubbed":24,"log_size":496,"log_dups_size":0,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T10:38:51.635388+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0012557989999999999,"stat_sum":{"num_bytes":0,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":24,"num_read":8865,"num_read_kb":33202,"num_write":482,"num_write_kb":25077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":323,"num_bytes_recovered":61422801,"num_keys_recovered":36,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":135,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:15.897651+0000","last_change":"2024-09-11T07:09:15.897671+0000","last_active":"2024-09-11T07:09:15.897651+0000","last_peered":"2024-09-11T07:09:15.897651+0000","last_clean":"2024-09-11T07:09:15.897651+0000","last_became_active":"2024-09-11T07:08:08.033145+0000","last_became_peered":"2024-09-11T07:08:08.033145+0000","last_unstale":"2024-09-11T07:09:15.897651+0000","last_undegraded":"2024-09-11T07:09:15.897651+0000","last_fullsized":"2024-09-11T07:09:15.897651+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-11T07:09:15.897585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-11T07:09:15.897585+0000","last_clean_scrub_stamp":"2024-09-11T07:09:15.897585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:30:09.827002+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"186'490","reported_seq":5392,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:18.712815+0000","last_change":"2024-09-11T07:09:18.712841+0000","last_active":"2024-09-11T07:09:18.712815+0000","last_peered":"2024-09-11T07:09:18.712815+0000","last_clean":"2024-09-11T07:09:18.712815+0000","last_became_active":"2024-09-11T07:05:58.824192+0000","last_became_peered":"2024-09-11T07:05:58.824192+0000","last_unstale":"2024-09-11T07:09:18.712815+0000","last_undegraded":"2024-09-11T07:09:18.712815+0000","last_fullsized":"2024-09-11T07:09:18.712815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'490","last_scrub_stamp":"2024-09-11T07:09:18.712755+0000","last_deep_scrub":"186'490","last_deep_scrub_stamp":"2024-09-11T07:09:18.712755+0000","last_clean_scrub_stamp":"2024-09-11T07:09:18.712755+0000","objects_scrubbed":28,"log_size":490,"log_dups_size":0,"ondisk_log_size":490,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:42.622621+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0.0018328699999999999,"stat_sum":{"num_bytes":0,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":28,"num_read":5357,"num_read_kb":20493,"num_write":487,"num_write_kb":10685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"186'2","reported_seq":363,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:19.194557+0000","last_change":"2024-09-11T07:09:19.194737+0000","last_active":"2024-09-11T07:09:19.194557+0000","last_peered":"2024-09-11T07:09:19.194557+0000","last_clean":"2024-09-11T07:09:19.194557+0000","last_became_active":"2024-09-11T07:05:49.151903+0000","last_became_peered":"2024-09-11T07:05:49.151903+0000","last_unstale":"2024-09-11T07:09:19.194557+0000","last_undegraded":"2024-09-11T07:09:19.194557+0000","last_fullsized":"2024-09-11T07:09:19.194557+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'2","last_scrub_stamp":"2024-09-11T07:09:19.194312+0000","last_deep_scrub":"186'2","last_deep_scrub_stamp":"2024-09-11T07:09:19.194312+0000","last_clean_scrub_stamp":"2024-09-11T07:09:19.194312+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T18:31:49.051637+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.00085399399999999996,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"186'119","reported_seq":540,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:22.319471+0000","last_change":"2024-09-11T07:09:22.319547+0000","last_active":"2024-09-11T07:09:22.319471+0000","last_peered":"2024-09-11T07:09:22.319471+0000","last_clean":"2024-09-11T07:09:22.319471+0000","last_became_active":"2024-09-11T07:08:13.085823+0000","last_became_peered":"2024-09-11T07:08:13.085823+0000","last_unstale":"2024-09-11T07:09:22.319471+0000","last_undegraded":"2024-09-11T07:09:22.319471+0000","last_fullsized":"2024-09-11T07:09:22.319471+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'119","last_scrub_stamp":"2024-09-11T07:09:22.319284+0000","last_deep_scrub":"186'119","last_deep_scrub_stamp":"2024-09-11T07:09:22.319284+0000","last_clean_scrub_stamp":"2024-09-11T07:09:22.319284+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:02:37.750503+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"186'450","reported_seq":3595,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:16.737706+0000","last_change":"2024-09-11T07:09:16.737782+0000","last_active":"2024-09-11T07:09:16.737706+0000","last_peered":"2024-09-11T07:09:16.737706+0000","last_clean":"2024-09-11T07:09:16.737706+0000","last_became_active":"2024-09-11T07:05:58.811669+0000","last_became_peered":"2024-09-11T07:05:58.811669+0000","last_unstale":"2024-09-11T07:09:16.737706+0000","last_undegraded":"2024-09-11T07:09:16.737706+0000","last_fullsized":"2024-09-11T07:09:16.737706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'450","last_scrub_stamp":"2024-09-11T07:09:16.737606+0000","last_deep_scrub":"186'450","last_deep_scrub_stamp":"2024-09-11T07:09:16.737606+0000","last_clean_scrub_stamp":"2024-09-11T07:09:16.737606+0000","objects_scrubbed":33,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:06:18.190505+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0.001886642,"stat_sum":{"num_bytes":0,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":33,"num_read":3136,"num_read_kb":12190,"num_write":362,"num_write_kb":7014,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"186'325","reported_seq":2323,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:18.424221+0000","last_change":"2024-09-11T07:09:18.424353+0000","last_active":"2024-09-11T07:09:18.424221+0000","last_peered":"2024-09-11T07:09:18.424221+0000","last_clean":"2024-09-11T07:09:18.424221+0000","last_became_active":"2024-09-11T07:09:02.146228+0000","last_became_peered":"2024-09-11T07:09:02.146228+0000","last_unstale":"2024-09-11T07:09:18.424221+0000","last_undegraded":"2024-09-11T07:09:18.424221+0000","last_fullsized":"2024-09-11T07:09:18.424221+0000","mapping_epoch":180,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":181,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'325","last_scrub_stamp":"2024-09-11T07:09:18.424005+0000","last_deep_scrub":"186'325","last_deep_scrub_stamp":"2024-09-11T07:09:18.424005+0000","last_clean_scrub_stamp":"2024-09-11T07:09:18.424005+0000","objects_scrubbed":26,"log_size":325,"log_dups_size":0,"ondisk_log_size":325,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:14:47.213888+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0.0010147260000000001,"stat_sum":{"num_bytes":0,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":26,"num_read":1603,"num_read_kb":8035,"num_write":242,"num_write_kb":8539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":4236596,"num_keys_recovered":24,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"186'641","reported_seq":5632,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:20.649693+0000","last_change":"2024-09-11T07:09:20.649841+0000","last_active":"2024-09-11T07:09:20.649693+0000","last_peered":"2024-09-11T07:09:20.649693+0000","last_clean":"2024-09-11T07:09:20.649693+0000","last_became_active":"2024-09-11T07:09:06.175303+0000","last_became_peered":"2024-09-11T07:09:06.175303+0000","last_unstale":"2024-09-11T07:09:20.649693+0000","last_undegraded":"2024-09-11T07:09:20.649693+0000","last_fullsized":"2024-09-11T07:09:20.649693+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'641","last_scrub_stamp":"2024-09-11T07:09:20.649472+0000","last_deep_scrub":"186'641","last_deep_scrub_stamp":"2024-09-11T07:09:20.649472+0000","last_clean_scrub_stamp":"2024-09-11T07:09:20.649472+0000","objects_scrubbed":37,"log_size":641,"log_dups_size":0,"ondisk_log_size":641,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T07:17:14.325458+0000","scrub_duration":71,"objects_trimmed":2,"snaptrim_duration":0.0083757740000000008,"stat_sum":{"num_bytes":0,"num_objects":37,"num_object_clones":0,"num_object_copies":74,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":36,"num_read":7105,"num_read_kb":12374,"num_write":638,"num_write_kb":6832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":288,"num_bytes_recovered":4540944,"num_keys_recovered":88,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.b","version":"186'584","reported_seq":3936,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:20.728403+0000","last_change":"2024-09-11T07:09:20.728569+0000","last_active":"2024-09-11T07:09:20.728403+0000","last_peered":"2024-09-11T07:09:20.728403+0000","last_clean":"2024-09-11T07:09:20.728403+0000","last_became_active":"2024-09-11T07:08:13.094279+0000","last_became_peered":"2024-09-11T07:08:13.094279+0000","last_unstale":"2024-09-11T07:09:20.728403+0000","last_undegraded":"2024-09-11T07:09:20.728403+0000","last_fullsized":"2024-09-11T07:09:20.728403+0000","mapping_epoch":132,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":133,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'584","last_scrub_stamp":"2024-09-11T07:09:20.728134+0000","last_deep_scrub":"186'584","last_deep_scrub_stamp":"2024-09-11T07:09:20.728134+0000","last_clean_scrub_stamp":"2024-09-11T07:09:20.728134+0000","objects_scrubbed":30,"log_size":584,"log_dups_size":0,"ondisk_log_size":584,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T08:04:15.981998+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.0022690100000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":5323,"num_read_kb":21130,"num_write":584,"num_write_kb":14713,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":315,"num_bytes_recovered":42089319,"num_keys_recovered":120,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.c","version":"186'397","reported_seq":3115,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:20.238849+0000","last_change":"2024-09-11T07:09:20.238958+0000","last_active":"2024-09-11T07:09:20.238849+0000","last_peered":"2024-09-11T07:09:20.238849+0000","last_clean":"2024-09-11T07:09:20.238849+0000","last_became_active":"2024-09-11T07:05:58.822658+0000","last_became_peered":"2024-09-11T07:05:58.822658+0000","last_unstale":"2024-09-11T07:09:20.238849+0000","last_undegraded":"2024-09-11T07:09:20.238849+0000","last_fullsized":"2024-09-11T07:09:20.238849+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'397","last_scrub_stamp":"2024-09-11T07:09:20.238659+0000","last_deep_scrub":"186'397","last_deep_scrub_stamp":"2024-09-11T07:09:20.238659+0000","last_clean_scrub_stamp":"2024-09-11T07:09:20.238659+0000","objects_scrubbed":23,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T11:26:58.663147+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0032901720000000001,"stat_sum":{"num_bytes":0,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":23,"num_read":2243,"num_read_kb":7360,"num_write":303,"num_write_kb":6081,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.d","version":"186'503","reported_seq":4098,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:20.415833+0000","last_change":"2024-09-11T07:09:20.415958+0000","last_active":"2024-09-11T07:09:20.415833+0000","last_peered":"2024-09-11T07:09:20.415833+0000","last_clean":"2024-09-11T07:09:20.415833+0000","last_became_active":"2024-09-11T07:05:58.832732+0000","last_became_peered":"2024-09-11T07:05:58.832732+0000","last_unstale":"2024-09-11T07:09:20.415833+0000","last_undegraded":"2024-09-11T07:09:20.415833+0000","last_fullsized":"2024-09-11T07:09:20.415833+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'503","last_scrub_stamp":"2024-09-11T07:09:20.415579+0000","last_deep_scrub":"186'503","last_deep_scrub_stamp":"2024-09-11T07:09:20.415579+0000","last_clean_scrub_stamp":"2024-09-11T07:09:20.415579+0000","objects_scrubbed":31,"log_size":503,"log_dups_size":0,"ondisk_log_size":503,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T15:35:05.358042+0000","scrub_duration":59,"objects_trimmed":0,"snaptrim_duration":0.0048801529999999999,"stat_sum":{"num_bytes":0,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":31,"num_read":5047,"num_read_kb":19575,"num_write":443,"num_write_kb":9370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.e","version":"186'537","reported_seq":3793,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:23.324916+0000","last_change":"2024-09-11T07:09:23.325001+0000","last_active":"2024-09-11T07:09:23.324916+0000","last_peered":"2024-09-11T07:09:23.324916+0000","last_clean":"2024-09-11T07:09:23.324916+0000","last_became_active":"2024-09-11T07:08:54.860099+0000","last_became_peered":"2024-09-11T07:08:54.860099+0000","last_unstale":"2024-09-11T07:09:23.324916+0000","last_undegraded":"2024-09-11T07:09:23.324916+0000","last_fullsized":"2024-09-11T07:09:23.324916+0000","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'537","last_scrub_stamp":"2024-09-11T07:09:23.324758+0000","last_deep_scrub":"186'537","last_deep_scrub_stamp":"2024-09-11T07:09:23.324758+0000","last_clean_scrub_stamp":"2024-09-11T07:09:23.324758+0000","objects_scrubbed":27,"log_size":537,"log_dups_size":0,"ondisk_log_size":537,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:03:14.514424+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0058914980000000002,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":5468,"num_read_kb":40931,"num_write":483,"num_write_kb":33825,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":204,"num_bytes_recovered":29182336,"num_keys_recovered":33,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.f","version":"186'940","reported_seq":5734,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:26.333664+0000","last_change":"2024-09-11T07:09:26.333734+0000","last_active":"2024-09-11T07:09:26.333664+0000","last_peered":"2024-09-11T07:09:26.333664+0000","last_clean":"2024-09-11T07:09:26.333664+0000","last_became_active":"2024-09-11T07:08:59.857371+0000","last_became_peered":"2024-09-11T07:08:59.857371+0000","last_unstale":"2024-09-11T07:09:26.333664+0000","last_undegraded":"2024-09-11T07:09:26.333664+0000","last_fullsized":"2024-09-11T07:09:26.333664+0000","mapping_epoch":178,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":179,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'940","last_scrub_stamp":"2024-09-11T07:09:26.333498+0000","last_deep_scrub":"186'940","last_deep_scrub_stamp":"2024-09-11T07:09:26.333498+0000","last_clean_scrub_stamp":"2024-09-11T07:09:26.333498+0000","objects_scrubbed":32,"log_size":940,"log_dups_size":0,"ondisk_log_size":940,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:07:33.494596+0000","scrub_duration":67,"objects_trimmed":0,"snaptrim_duration":0.0037300609999999998,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":7268,"num_read_kb":23165,"num_write":1135,"num_write_kb":16436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":309,"num_bytes_recovered":38565066,"num_keys_recovered":46,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.10","version":"186'1359","reported_seq":3587,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:19.589821+0000","last_change":"2024-09-11T07:09:19.589887+0000","last_active":"2024-09-11T07:09:19.589821+0000","last_peered":"2024-09-11T07:09:19.589821+0000","last_clean":"2024-09-11T07:09:19.589821+0000","last_became_active":"2024-09-11T07:08:12.088833+0000","last_became_peered":"2024-09-11T07:08:12.088833+0000","last_unstale":"2024-09-11T07:09:19.589821+0000","last_undegraded":"2024-09-11T07:09:19.589821+0000","last_fullsized":"2024-09-11T07:09:19.589821+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'1359","last_scrub_stamp":"2024-09-11T07:09:19.589638+0000","last_deep_scrub":"186'1359","last_deep_scrub_stamp":"2024-09-11T07:09:19.589638+0000","last_clean_scrub_stamp":"2024-09-11T07:09:19.589638+0000","objects_scrubbed":27,"log_size":1359,"log_dups_size":0,"ondisk_log_size":1359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T09:28:47.180084+0000","scrub_duration":47,"objects_trimmed":0,"snaptrim_duration":0.0025943210000000001,"stat_sum":{"num_bytes":0,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":27,"num_read":7126,"num_read_kb":16929,"num_write":1954,"num_write_kb":15903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":159,"num_bytes_recovered":5558122,"num_keys_recovered":48,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.11","version":"186'323","reported_seq":4459,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:24.351028+0000","last_change":"2024-09-11T07:09:24.351140+0000","last_active":"2024-09-11T07:09:24.351028+0000","last_peered":"2024-09-11T07:09:24.351028+0000","last_clean":"2024-09-11T07:09:24.351028+0000","last_became_active":"2024-09-11T07:08:57.878966+0000","last_became_peered":"2024-09-11T07:08:57.878966+0000","last_unstale":"2024-09-11T07:09:24.351028+0000","last_undegraded":"2024-09-11T07:09:24.351028+0000","last_fullsized":"2024-09-11T07:09:24.351028+0000","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'323","last_scrub_stamp":"2024-09-11T07:09:24.350837+0000","last_deep_scrub":"186'323","last_deep_scrub_stamp":"2024-09-11T07:09:24.350837+0000","last_clean_scrub_stamp":"2024-09-11T07:09:24.350837+0000","objects_scrubbed":18,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T16:47:35.508915+0000","scrub_duration":31,"objects_trimmed":0,"snaptrim_duration":0.0030609069999999999,"stat_sum":{"num_bytes":0,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":18,"num_read":3180,"num_read_kb":9248,"num_write":258,"num_write_kb":6654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":201,"num_bytes_recovered":2139720,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.12","version":"186'532","reported_seq":6707,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:17.932980+0000","last_change":"2024-09-11T07:09:17.933027+0000","last_active":"2024-09-11T07:09:17.932980+0000","last_peered":"2024-09-11T07:09:17.932980+0000","last_clean":"2024-09-11T07:09:17.932980+0000","last_became_active":"2024-09-11T07:08:12.092494+0000","last_became_peered":"2024-09-11T07:08:12.092494+0000","last_unstale":"2024-09-11T07:09:17.932980+0000","last_undegraded":"2024-09-11T07:09:17.932980+0000","last_fullsized":"2024-09-11T07:09:17.932980+0000","mapping_epoch":131,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":132,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'532","last_scrub_stamp":"2024-09-11T07:09:17.932873+0000","last_deep_scrub":"186'532","last_deep_scrub_stamp":"2024-09-11T07:09:17.932873+0000","last_clean_scrub_stamp":"2024-09-11T07:09:17.932873+0000","objects_scrubbed":30,"log_size":532,"log_dups_size":0,"ondisk_log_size":532,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:00:21.266734+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0.0011861700000000001,"stat_sum":{"num_bytes":0,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":30,"num_read":6702,"num_read_kb":31801,"num_write":602,"num_write_kb":10266,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":13150126,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"186'629","reported_seq":3380,"reported_epoch":186,"state":"active+clean","last_fresh":"2024-09-11T07:09:25.346163+0000","last_change":"2024-09-11T07:09:25.346221+0000","last_active":"2024-09-11T07:09:25.346163+0000","last_peered":"2024-09-11T07:09:25.346163+0000","last_clean":"2024-09-11T07:09:25.346163+0000","last_became_active":"2024-09-11T07:08:58.856080+0000","last_became_peered":"2024-09-11T07:08:58.856080+0000","last_unstale":"2024-09-11T07:09:25.346163+0000","last_undegraded":"2024-09-11T07:09:25.346163+0000","last_fullsized":"2024-09-11T07:09:25.346163+0000","mapping_epoch":177,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":178,"parent":"0.0","parent_split_bits":0,"last_scrub":"186'629","last_scrub_stamp":"2024-09-11T07:09:25.346035+0000","last_deep_scrub":"186'629","last_deep_scrub_stamp":"2024-09-11T07:09:25.346035+0000","last_clean_scrub_stamp":"2024-09-11T07:09:25.346035+0000","objects_scrubbed":32,"log_size":629,"log_dups_size":0,"ondisk_log_size":629,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T13:36:05.716263+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0.0019838210000000002,"stat_sum":{"num_bytes":0,"num_objects":32,"num_object_clones":0,"num_object_copies":64,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":32,"num_read":3601,"num_read_kb":5499,"num_write":635,"num_write_kb":4475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":202,"num_bytes_recovered":826886,"num_keys_recovered":23,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":19,"num_objects":952,"num_object_clones":0,"num_object_copies":1904,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":952,"num_whiteouts":948,"num_read":171813,"num_read_kb":628353,"num_write":19992,"num_write_kb":415358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4495,"num_bytes_recovered":292360160,"num_keys_recovered":785,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19461,"ondisk_log_size":19461,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":139264,"data_stored":1771104,"data_compressed":19129,"data_compressed_allocated":110592,"data_compressed_original":1753088,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574898,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47320,"kb_used_data":2248,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94324520,"statfs":{"total":96636764160,"available":96588308480,"internally_reserved":0,"allocated":2301952,"data_stored":1675772,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1591,"internal_metadata":46135753},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574900,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33376,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338464,"statfs":{"total":96636764160,"available":96602587136,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59748,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312092,"statfs":{"total":96636764160,"available":96575582208,"internally_reserved":0,"allocated":2248704,"data_stored":1085423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":58915268},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574900,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55588,"kb_used_data":2196,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316252,"statfs":{"total":96636764160,"available":96579842048,"internally_reserved":0,"allocated":2248704,"data_stored":1085423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574899,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":59744,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94312096,"statfs":{"total":96636764160,"available":96575586304,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":58915270},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574899,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41696,"kb_used_data":2192,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94330144,"statfs":{"total":96636764160,"available":96594067456,"internally_reserved":0,"allocated":2244608,"data_stored":1085404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":40434116},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55592,"kb_used_data":2200,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316248,"statfs":{"total":96636764160,"available":96579837952,"internally_reserved":0,"allocated":2252800,"data_stored":1085442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574899,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":55624,"kb_used_data":2232,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94316216,"statfs":{"total":96636764160,"available":96579805184,"internally_reserved":0,"allocated":2285568,"data_stored":1675772,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":1596,"internal_metadata":54655428},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":590368,"data_compressed":6655,"data_compressed_allocated":36864,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":5819,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-11T07:09:39.138 DEBUG:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-11T07:09:39.466 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-11T07:09:39.466 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-11T07:09:39.466 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-11T07:09:39.466 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:09:39.539 INFO:tasks.ceph.osd.0:Stopped 2024-09-11T07:09:39.540 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-11T07:09:39.540 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:09:41.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-09-11T07:09:45.642 INFO:tasks.ceph.osd.1:Stopped 2024-09-11T07:09:45.642 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-11T07:09:45.643 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:09:45.708 INFO:tasks.ceph.osd.2:Stopped 2024-09-11T07:09:45.708 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-11T07:09:45.709 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:09:47.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-11T07:09:47.032 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-09-11T07:09:51.810 INFO:tasks.ceph.osd.3:Stopped 2024-09-11T07:09:51.811 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-11T07:09:51.811 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:09:51.878 INFO:tasks.ceph.osd.4:Stopped 2024-09-11T07:09:51.878 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-11T07:09:51.879 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:09:52.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-11T07:09:52.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-11T07:09:57.981 INFO:tasks.ceph.osd.5:Stopped 2024-09-11T07:09:57.981 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-11T07:09:57.981 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:09:58.039 INFO:tasks.ceph.osd.6:Stopped 2024-09-11T07:09:58.039 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-11T07:09:58.039 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:09:58.444 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~6s 2024-09-11T07:10:03.949 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-11T07:10:03.949 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-11T07:10:04.141 INFO:tasks.ceph.osd.7:Stopped 2024-09-11T07:10:04.142 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-11T07:10:04.142 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-11T07:10:04.142 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:10:04.172 INFO:tasks.ceph.mgr.y:Stopped 2024-09-11T07:10:04.172 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-11T07:10:04.172 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:10:04.200 INFO:tasks.ceph.mgr.x:Stopped 2024-09-11T07:10:04.200 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-11T07:10:04.201 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-11T07:10:04.201 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:10:04.230 INFO:tasks.ceph.mon.a:Stopped 2024-09-11T07:10:04.230 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-11T07:10:04.230 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:10:04.286 INFO:tasks.ceph.mon.c:Stopped 2024-09-11T07:10:04.286 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-11T07:10:04.286 INFO:teuthology.orchestra.run:waiting for 300 2024-09-11T07:10:04.310 INFO:tasks.ceph.mon.b:Stopped 2024-09-11T07:10:04.311 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-11T07:10:04.311 DEBUG:teuthology.orchestra.run.smithi079:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | egrep -v noscrub | egrep -v nodeep-scrub | head -n 1 2024-09-11T07:10:04.351 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T07:10:04.351 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-11T07:10:04.601 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T07:10:04.601 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-11T07:10:04.873 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T07:10:04.873 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-11T07:10:05.081 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T07:10:05.081 DEBUG:teuthology.orchestra.run.smithi079:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-11T07:10:05.267 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T07:10:05.267 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-11T07:10:05.581 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T07:10:05.582 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-11T07:10:05.879 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T07:10:05.879 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-11T07:10:06.081 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T07:10:06.081 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-11T07:10:06.272 INFO:tasks.ceph:Archiving mon data... 2024-09-11T07:10:06.273 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648/data/mon.a.tgz 2024-09-11T07:10:06.273 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-11T07:10:06.279 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.0BGiRRcR75 2024-09-11T07:10:06.280 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0BGiRRcR75 2024-09-11T07:10:06.431 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.0BGiRRcR75 2024-09-11T07:10:06.498 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.0BGiRRcR75 is 423KB 2024-09-11T07:10:06.560 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.0BGiRRcR75 2024-09-11T07:10:06.565 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648/data/mon.c.tgz 2024-09-11T07:10:06.565 DEBUG:teuthology.orchestra.run.smithi079:> mktemp 2024-09-11T07:10:06.613 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.TOoz9X6ONQ 2024-09-11T07:10:06.614 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.TOoz9X6ONQ 2024-09-11T07:10:06.797 DEBUG:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.TOoz9X6ONQ 2024-09-11T07:10:06.858 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.TOoz9X6ONQ is 578KB 2024-09-11T07:10:06.919 DEBUG:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.TOoz9X6ONQ 2024-09-11T07:10:06.924 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648/data/mon.b.tgz 2024-09-11T07:10:06.924 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-09-11T07:10:06.930 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.WZa7SMS9uF 2024-09-11T07:10:06.930 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WZa7SMS9uF 2024-09-11T07:10:07.112 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.WZa7SMS9uF 2024-09-11T07:10:07.172 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.WZa7SMS9uF is 579KB 2024-09-11T07:10:07.276 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.WZa7SMS9uF 2024-09-11T07:10:07.282 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-11T07:10:07.282 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T07:10:07.285 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-11T07:10:07.345 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T07:10:07.385 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-11T07:10:07.386 INFO:tasks.ceph:Archiving crash dumps... 2024-09-11T07:10:07.387 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648/remote/smithi079/crash 2024-09-11T07:10:07.388 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T07:10:07.403 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648/remote/smithi110/crash 2024-09-11T07:10:07.404 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-11T07:10:07.441 INFO:tasks.ceph:Compressing logs... 2024-09-11T07:10:07.442 DEBUG:teuthology.orchestra.run.smithi079:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T07:10:07.450 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-11T07:10:07.472 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38772.log 2024-09-11T07:10:07.472 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32848.log 2024-09-11T07:10:07.473 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40924.log 2024-09-11T07:10:07.473 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38772.log: /var/log/ceph/ceph-client.admin.32848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32848.log.gz 2024-09-11T07:10:07.473 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38772.log.gz 2024-09-11T07:10:07.475 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35974.log 2024-09-11T07:10:07.475 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35601.log 2024-09-11T07:10:07.475 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40924.log.gz 2024-09-11T07:10:07.475 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35974.log.gz 2024-09-11T07:10:07.475 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35023.log 2024-09-11T07:10:07.475 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35601.log.gz 2024-09-11T07:10:07.475 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30188.log 2024-09-11T07:10:07.476 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35023.log.gz 2024-09-11T07:10:07.476 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34740.log 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32204.log 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30188.log.gz 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34740.log.gz 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31469.log 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32204.log.gz 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40846.log 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40768.log 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31469.log.gz 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31956.log 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40846.log.gz 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40768.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40768.log.gz 2024-09-11T07:10:07.480 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38631.log 2024-09-11T07:10:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33311.log 2024-09-11T07:10:07.481 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31956.log.gz 2024-09-11T07:10:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38631.log.gz 2024-09-11T07:10:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34148.log 2024-09-11T07:10:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33311.log.gz 2024-09-11T07:10:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40976.log 2024-09-11T07:10:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34148.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-11T07:10:07.481 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34148.log.gz 2024-09-11T07:10:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40976.log.gz 2024-09-11T07:10:07.481 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40208.log 2024-09-11T07:10:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34788.log 2024-09-11T07:10:07.485 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40208.log.gz 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39312.log 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31681.log 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34788.log.gz 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37390.log 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39312.log.gz 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31681.log.gz 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39182.log 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35896.log 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37390.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37390.log.gz 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33209.log 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39182.log.gz 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35896.log.gz 2024-09-11T07:10:07.486 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35181.log 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26423.log 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33209.log.gz 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40742.log 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35181.log.gz 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.26423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30334.log 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26423.log.gz 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36234.log 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40742.log.gz 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34472.log 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30334.log.gz 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40898.log 2024-09-11T07:10:07.487 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36234.log.gz 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34206.log 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34472.log.gz 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40898.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40898.log.gz 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38289.log 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34206.log.gz 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37121.log 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30285.log 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38289.log.gz 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39048.log 2024-09-11T07:10:07.494 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37121.log.gz 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30285.log.gz 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30337.log 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36595.log 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39048.log.gz 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33895.log 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30337.log.gz 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38995.log 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36595.log.gz 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39110.log 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33895.log.gz 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36581.log 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38995.log.gz 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39110.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.39110.log.gz -- 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr: /var/log/ceph/ceph-client.admin.40560.log 2024-09-11T07:10:07.495 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36581.log.gz 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33286.log 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40378.log 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40560.log.gz 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39780.log 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33286.log.gz 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40378.log.gz 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34476.log 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31121.log 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39780.log.gz 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34476.log.gz 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40416.log 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34563.log 2024-09-11T07:10:07.496 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31121.log.gz 2024-09-11T07:10:07.497 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40416.log.gz 2024-09-11T07:10:07.497 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39728.log 2024-09-11T07:10:07.508 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26516.log 2024-09-11T07:10:07.508 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34563.log.gz 2024-09-11T07:10:07.508 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39728.log.gz 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40180.log 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.26516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30333.log 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26516.log.gz 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40180.log.gz 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39177.log 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30338.log 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30333.log.gz 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39177.log.gz 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39520.log 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35506.log 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30338.log.gz 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39520.log.gz 2024-09-11T07:10:07.509 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36741.log 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33936.log 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35506.log.gz 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36741.log.gz 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34868.log 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40664.log 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33936.log.gz 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34868.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34868.log.gz -5 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr: --verbose -- /var/log/ceph/ceph-client.admin.40387.log 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35870.log/var/log/ceph/ceph-client.admin.40664.log: 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40664.log.gz 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40387.log.gz 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37754.log 2024-09-11T07:10:07.510 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38954.log 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35870.log.gz 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37754.log.gz 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38776.log 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32605.log 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38954.log.gz 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38776.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.34392.log -- replaced with /var/log/ceph/ceph-client.admin.38776.log.gz 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32605.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32605.log.gz 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34392.log.gz 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39650.log 2024-09-11T07:10:07.511 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31065.log 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38560.log 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39650.log.gz 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31065.log.gz 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35978.log 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33412.log 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38560.log.gz 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35978.log.gz 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31732.log 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:gzip/var/log/ceph/ceph-client.admin.33412.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.34261.log 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33412.log.gz 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31732.log.gz 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30935.log 2024-09-11T07:10:07.512 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34653.log 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34261.log.gz 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30935.log.gz 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30737.log 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37920.log 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34653.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34653.log.gz 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38103.log 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30737.log.gz 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37920.log.gz 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31857.log 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38103.log: /var/log/ceph/ceph-mon.a.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38103.log.gz 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33026.log 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37427.log 2024-09-11T07:10:07.513 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31857.log.gz 2024-09-11T07:10:07.514 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41002.log 2024-09-11T07:10:07.514 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33026.log.gz 2024-09-11T07:10:07.514 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38590.log 2024-09-11T07:10:07.514 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37427.log.gz 2024-09-11T07:10:07.514 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40794.log 2024-09-11T07:10:07.514 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41002.log.gz 2024-09-11T07:10:07.522 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26423.log 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26399.log 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26423.log.gz 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26279.log 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26399.log.gz 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26303.log 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26279.log: /var/log/ceph/ceph-client.admin.26303.log: 26.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.26279.log.gz -5 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr: --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26303.log.gz 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26351.log 2024-09-11T07:10:07.523 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26447.log 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26351.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26351.log.gz 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26375.log 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26447.log.gz 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26327.log 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26375.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26375.log.gz 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.26327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26327.log.gz 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T07:10:07.524 INFO:teuthology.orchestra.run.smithi110.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T07:10:07.527 INFO:teuthology.orchestra.run.smithi110.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-11T07:10:07.544 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34936.log 2024-09-11T07:10:07.544 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38590.log.gz 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.40794.log: /var/log/ceph/ceph-client.admin.39771.log 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40794.log.gz 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37556.log 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34936.log.gz 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32097.log 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39771.log.gz 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33515.log 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37556.log.gz 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32978.log 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32097.log.gz 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32241.log 2024-09-11T07:10:07.545 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33515.log.gz 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39764.log 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32978.log.gz 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30083.log 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32241.log.gz 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36208.log 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39764.log.gz 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39229.log 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30083.log.gz 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38407.log 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36208.log.gz 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39572.log 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39229.log.gz 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36324.log 2024-09-11T07:10:07.546 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38407.log.gz 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32299.log 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39572.log.gz 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36557.log 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36324.log.gz 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40508.log 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32299.log.gz 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34896.log 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36557.log.gz 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38263.log 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40508.log.gz 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33351.log 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34896.log.gz 2024-09-11T07:10:07.547 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37883.log 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38263.log.gz 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32766.log 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33351.log.gz 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35324.log 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37883.log.gz 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39702.log 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32766.log.gz 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31013.log 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35324.log.gz 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30727.log 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39702.log.gz 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30523.log 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31013.log.gz 2024-09-11T07:10:07.548 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36283.log 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30727.log.gz 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35274.log 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30523.log.gz 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33598.log 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36283.log.gz 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39442.log 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35274.log.gz 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31404.log 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33598.log.gz 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35365.log 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39442.log.gz 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30547.log 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31404.log.gz 2024-09-11T07:10:07.549 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35365.log.gz 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32674.log 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30547.log.gz 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34430.log 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40534.log 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32674.log.gz 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34999.log 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34430.log.gz 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30259.log 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40534.log: /var/log/ceph/ceph-client.admin.34999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31685.log 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40534.log.gz 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34999.log.gz 2024-09-11T07:10:07.550 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30259.log.gz 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39624.log 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32439.log 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31685.log: /var/log/ceph/ceph-client.admin.39624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35948.log 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31685.log.gz 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39624.log.gz 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40586.log 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32439.log.gz 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39968.log 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35948.log: /var/log/ceph/ceph-client.admin.40586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34716.log 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35948.log.gz 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40586.log.gz 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33050.log 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39968.log.gz 2024-09-11T07:10:07.551 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39233.log 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34716.log: /var/log/ceph/ceph-client.admin.33050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31499.log 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34716.log.gz 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33050.log.gz 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35391.log 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39233.log.gz 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31499.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31499.log.gz 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41132.log 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35391.log: /var/log/ceph/ceph-client.admin.41132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36684.log 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35391.log.gz 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41132.log.gz 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40204.log 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34840.log 2024-09-11T07:10:07.552 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36684.log.gz 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40204.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33147.log 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34840.log.gz 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41106.log 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.31154.log 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33147.log.gz 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41106.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40690.log 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41106.log.gz 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.0.31154.log: 95.0% -- replaced with /var/log/ceph/ceph-client.0.31154.log.gz 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38883.log 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40170.log 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40690.log.gz 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38883.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33484.log 2024-09-11T07:10:07.553 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40170.log.gz 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30546.log 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36375.log 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33484.log.gz 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30546.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32974.log 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36375.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36375.log.gz 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39338.log 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34336.log 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32974.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32974.log.gz 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39338.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32465.log 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34336.log.gz 2024-09-11T07:10:07.554 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36886.log 2024-09-11T07:10:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37869.log 2024-09-11T07:10:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32465.log.gz 2024-09-11T07:10:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36886.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36886.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30735.log 2024-09-11T07:10:07.555 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37869.log.gz 2024-09-11T07:10:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39781.log 2024-09-11T07:10:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33961.log 2024-09-11T07:10:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30735.log.gz 2024-09-11T07:10:07.555 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39781.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31355.log 2024-09-11T07:10:07.555 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33961.log.gz 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38855.log 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36951.log 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31355.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31355.log.gz 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36441.log 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38855.log.gz 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36951.log.gz 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30754.log 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38214.log 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36441.log.gz 2024-09-11T07:10:07.571 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30754.log.gz 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36163.log 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38214.log.gz 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34065.log 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31543.log 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36163.log.gz 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34065.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39676.log 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31543.log.gz 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37610.log 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38046.log 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39676.log.gz 2024-09-11T07:10:07.572 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37610.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39416.log 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38046.log.gz 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30163.log 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35922.log 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39416.log.gz 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30163.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35922.log.gz 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39136.log 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30529.log 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.39136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39136.log.gz 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-11T07:10:07.573 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32048.log 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41080.log 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr: 92.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30529.log.gz/var/log/ceph/ceph-client.admin.32048.log: 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32048.log.gz 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39776.log 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33260.log 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41080.log: /var/log/ceph/ceph-client.admin.39776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31167.log 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41080.log.gz 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39776.log.gz/var/log/ceph/ceph-client.admin.33260.log: 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38452.log 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33260.log.gz 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36416.log 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31167.log.gz 2024-09-11T07:10:07.574 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30539.log 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38452.log: /var/log/ceph/ceph-client.admin.36416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38452.log.gz 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30739.log 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36416.log.gz 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33624.log 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30539.log.gz 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39974.log 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30739.log.gz 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37924.log 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33624.log.gz 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41156.log 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39974.log.gz 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33446.log 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37924.log.gz 2024-09-11T07:10:07.575 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41156.log.gz 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40174.log 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34764.log 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33446.log.gz 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35131.log 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40174.log.gz 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40950.log 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34764.log.gz 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38020.log 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35131.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35131.log.gz/var/log/ceph/ceph-client.admin.40950.log: 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30233.log 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40950.log.gz 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40872.log 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38020.log: /var/log/ceph/ceph-client.admin.30233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32398.log 2024-09-11T07:10:07.576 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38020.log.gz 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30233.log.gz 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40872.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.40872.log.gz --verbose 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr: -- /var/log/ceph/ceph-client.admin.30961.log 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35428.log 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32398.log.gz 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32928.log 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30961.log.gz 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39986.log 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35428.log.gz 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32928.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31039.log 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32928.log.gz 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41028.log 2024-09-11T07:10:07.577 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39986.log.gz 2024-09-11T07:10:07.578 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36048.log 2024-09-11T07:10:07.578 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31039.log.gz 2024-09-11T07:10:07.578 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31915.log 2024-09-11T07:10:07.578 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41028.log.gz 2024-09-11T07:10:07.578 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36048.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-mon.c.log 2024-09-11T07:10:07.578 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36048.log.gz 2024-09-11T07:10:07.578 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39284.log 2024-09-11T07:10:07.578 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31915.log.gz 2024-09-11T07:10:07.588 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37527.log 2024-09-11T07:10:07.588 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34374.log 2024-09-11T07:10:07.588 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39284.log.gz 2024-09-11T07:10:07.588 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37527.log.gz 2024-09-11T07:10:07.588 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34311.log 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39598.log 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34374.log: /var/log/ceph/ceph-client.admin.34311.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34311.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34374.log.gz 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35714.log 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40186.log 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39598.log: /var/log/ceph/ceph-client.admin.35714.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39598.log.gz 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35714.log.gz 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34649.log 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32699.log 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40186.log: /var/log/ceph/ceph-client.admin.34649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40186.log.gz 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34649.log.gz 2024-09-11T07:10:07.589 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35094.log 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33701.log 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32699.log.gz 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35094.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34000.log 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31091.log 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33701.log.gz 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34000.log.gz 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30987.log 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31091.log.gz 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38144.log 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30753.log 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30987.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30987.log.gz 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38144.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37713.log 2024-09-11T07:10:07.590 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38144.log.gz 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30753.log.gz 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31824.log 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40238.log 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37713.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37713.log.gz 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31824.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31594.log 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31824.log.gz 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40238.log.gz 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38374.log 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40415.log 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31594.log: /var/log/ceph/ceph-client.admin.38374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31594.log.gz 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38374.log.gz 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-11T07:10:07.591 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37207.log 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40415.log: /var/log/ceph/ceph.audit.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40415.log.gz 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34149.log 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37207.log.gz 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36791.log 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34149.log.gz 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34103.log 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36791.log.gz 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37423.log 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34103.log.gz 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35767.log 2024-09-11T07:10:07.592 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37423.log.gz 2024-09-11T07:10:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36923.log 2024-09-11T07:10:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34567.log 2024-09-11T07:10:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35767.log.gz 2024-09-11T07:10:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36923.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33151.log 2024-09-11T07:10:07.600 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34567.log.gz 2024-09-11T07:10:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33357.log 2024-09-11T07:10:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30339.log 2024-09-11T07:10:07.600 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33151.log.gz 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33357.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33809.log 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33357.log.gz 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30339.log.gz 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21474.log 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37160.log 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33809.log.gz 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph.tmp-client.admin.21474.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32295.log 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph.tmp-client.admin.21474.log.gz 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37160.log.gz 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35684.log 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40638.log 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32295.log.gz 2024-09-11T07:10:07.601 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35684.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30330.log 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35684.log.gz 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40638.log.gz 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39972.log 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39777.log 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30330.log: /var/log/ceph/ceph-client.admin.39972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30330.log.gz 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39972.log.gz 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37643.log 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31314.log 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39777.log.gz 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37643.log.gzgzip 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32001.log 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31314.log.gz 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36004.log 2024-09-11T07:10:07.602 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32807.log 2024-09-11T07:10:07.603 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32001.log: /var/log/ceph/ceph-client.admin.36004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32001.log.gz 2024-09-11T07:10:07.603 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36004.log.gz 2024-09-11T07:10:07.603 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32894.log 2024-09-11T07:10:07.607 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34623.log 2024-09-11T07:10:07.607 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32807.log.gz 2024-09-11T07:10:07.607 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32894.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.32894.log.gz 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.33780.log 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34623.log.gz 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35816.log 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39364.log 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33780.log: /var/log/ceph/ceph-client.admin.35816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33780.log.gz 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35816.log.gz 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40185.log 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37234.log 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39364.log: /var/log/ceph/ceph-client.admin.40185.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39364.log.gz 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40185.log.gz 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39988.log 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39494.log 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37234.log: /var/log/ceph/ceph-client.admin.39988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37234.log.gz 2024-09-11T07:10:07.608 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39988.log.gz 2024-09-11T07:10:07.609 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37026.log 2024-09-11T07:10:07.609 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39782.log 2024-09-11T07:10:07.609 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39494.log: /var/log/ceph/ceph-client.admin.37026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39494.log.gz 2024-09-11T07:10:07.609 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37026.log.gz 2024-09-11T07:10:07.609 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35539.log 2024-09-11T07:10:07.609 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38483.log 2024-09-11T07:10:07.609 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39782.log: /var/log/ceph/ceph-client.admin.35539.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39782.log.gz 2024-09-11T07:10:07.609 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35539.log.gz 2024-09-11T07:10:07.609 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26269.log 2024-09-11T07:10:07.612 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36523.log 2024-09-11T07:10:07.612 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38483.log: /var/log/ceph/ceph-client.admin.26269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38483.log.gz 2024-09-11T07:10:07.612 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26269.log.gz 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30536.log 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37341.log 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36523.log.gz 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30536.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30335.log 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30536.log.gz 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37341.log.gz 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40820.log 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33557.log 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30335.log.gz 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40820.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40820.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38672.log 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33557.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33557.log.gz 2024-09-11T07:10:07.613 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37289.log 2024-09-11T07:10:07.614 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30213.log 2024-09-11T07:10:07.621 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38672.log.gz 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37289.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36836.log 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37289.log.gz 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30213.log.gz 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33739.log 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31655.log 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36836.log: /var/log/ceph/ceph-client.admin.33739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36836.log.gz 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33739.log.gz 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36832.log 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40716.log 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31655.log: /var/log/ceph/ceph-client.admin.36832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31655.log.gz 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36832.log.gz 2024-09-11T07:10:07.622 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39989.log 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39779.log 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40716.log.gz 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39989.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30520.log 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39779.log.gz 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40382.log 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30535.log 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30520.log: /var/log/ceph/ceph-client.admin.40382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30520.log.gz 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40382.log.gz 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39990.log 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31165.log 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30535.log.gz 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39990.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39468.log 2024-09-11T07:10:07.623 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31165.log.gz 2024-09-11T07:10:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39390.log 2024-09-11T07:10:07.624 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36055.log 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39468.log.gz 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39390.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39546.log 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39390.log.gz 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36055.log.gz 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32511.log 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30751.log 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39546.log.gz 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32511.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35209.log 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30751.log.gz 2024-09-11T07:10:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37804.log 2024-09-11T07:10:07.629 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39963.log 2024-09-11T07:10:07.629 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.35209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35209.log.gz 2024-09-11T07:10:07.629 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.37804.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38746.log 2024-09-11T07:10:07.629 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37804.log.gz 2024-09-11T07:10:07.629 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.39963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39963.log.gz 2024-09-11T07:10:07.629 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32580.log 2024-09-11T07:10:07.629 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34812.log 2024-09-11T07:10:07.629 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.38746.log: /var/log/ceph/ceph-client.admin.32580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38746.log.gz 2024-09-11T07:10:07.629 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32580.log.gz 2024-09-11T07:10:07.629 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35593.log 2024-09-11T07:10:07.632 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31758.log 2024-09-11T07:10:07.632 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.34812.log: /var/log/ceph/ceph-client.admin.35593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34812.log.gz 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35593.log.gz 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40612.log 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31758.log.gz 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.36611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33101.log 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.40612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40612.log.gz 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37051.log 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30756.log 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.33101.log: /var/log/ceph/ceph-client.admin.37051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33101.log.gz 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37051.log.gz 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31163.log 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41054.log 2024-09-11T07:10:07.633 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.30756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30756.log.gz 2024-09-11T07:10:07.635 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.31163.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32123.log 2024-09-11T07:10:07.635 INFO:teuthology.orchestra.run.smithi079.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31163.log.gz 2024-09-11T07:10:07.635 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.41054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41054.log.gz 2024-09-11T07:10:07.635 INFO:teuthology.orchestra.run.smithi079.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30336.log 2024-09-11T07:10:07.636 INFO:teuthology.orchestra.run.smithi079.stderr:/var/log/ceph/ceph-client.admin.32123.log: 0.0%/var/log/ceph/ceph-client.admin.30336.log: -- replaced with /var/log/ceph/ceph-client.admin.32123.log.gz 2024-09-11T07:10:07.636 INFO:teuthology.orchestra.run.smithi079.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30336.log.gz 2024-09-11T07:10:07.686 INFO:teuthology.orchestra.run.smithi110.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-11T07:10:07.821 INFO:teuthology.orchestra.run.smithi079.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-11T07:10:07.885 INFO:teuthology.orchestra.run.smithi079.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-11T07:10:08.433 INFO:teuthology.orchestra.run.smithi079.stderr: 94.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-11T07:10:08.471 INFO:teuthology.orchestra.run.smithi110.stderr: 94.8% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-11T07:10:08.950 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-11T07:10:09.413 INFO:teuthology.orchestra.run.smithi110.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-11T07:10:09.679 INFO:teuthology.orchestra.run.smithi079.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-11T07:10:09.745 INFO:teuthology.orchestra.run.smithi079.stderr: 95.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-11T07:10:10.543 INFO:teuthology.orchestra.run.smithi079.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-11T07:10:10.545 INFO:teuthology.orchestra.run.smithi079.stderr: 2024-09-11T07:10:10.545 INFO:teuthology.orchestra.run.smithi079.stderr:real 0m3.092s 2024-09-11T07:10:10.545 INFO:teuthology.orchestra.run.smithi079.stderr:user 0m8.978s 2024-09-11T07:10:10.545 INFO:teuthology.orchestra.run.smithi079.stderr:sys 0m0.414s 2024-09-11T07:10:10.609 INFO:teuthology.orchestra.run.smithi110.stderr: 95.4% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-11T07:10:11.258 INFO:teuthology.orchestra.run.smithi110.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-11T07:10:11.260 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-09-11T07:10:11.260 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m3.768s 2024-09-11T07:10:11.260 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m9.543s 2024-09-11T07:10:11.260 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.360s 2024-09-11T07:10:11.260 INFO:tasks.ceph:Archiving logs... 2024-09-11T07:10:11.261 DEBUG:teuthology.misc:Transferring archived files from smithi079:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648/remote/smithi079/log 2024-09-11T07:10:11.262 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T07:10:12.454 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648/remote/smithi110/log 2024-09-11T07:10:12.454 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-11T07:10:13.498 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-11T07:10:13.507 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-11T07:10:13.507 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T07:10:13.510 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-11T07:10:13.577 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-11T07:10:13.586 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-11T07:10:13.586 DEBUG:teuthology.orchestra.run.smithi079:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T07:10:13.589 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-11T07:10:13.600 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T07:10:13.600 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2024-09-11T07:10:13.600 INFO:teuthology.orchestra.run.smithi079.stdout:+hv01.front.sepi 67.205.162.81 3 u 34 64 177 0.075 -2.923 1.117 2024-09-11T07:10:13.600 INFO:teuthology.orchestra.run.smithi079.stdout:*hv02.front.sepi 63.231.80.2 3 u 35 64 177 0.145 +0.024 1.573 2024-09-11T07:10:13.600 INFO:teuthology.orchestra.run.smithi079.stdout:+hv03.front.sepi 74.6.168.72 3 u 34 64 177 0.076 -1.009 1.099 2024-09-11T07:10:13.600 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T07:10:13.603 INFO:teuthology.orchestra.run.smithi110.stdout: remote refid st t when poll reach delay offset jitter 2024-09-11T07:10:13.603 INFO:teuthology.orchestra.run.smithi110.stdout:============================================================================== 2024-09-11T07:10:13.603 INFO:teuthology.orchestra.run.smithi110.stdout:+hv01.front.sepi 67.205.162.81 3 u 31 64 177 0.083 -3.631 1.453 2024-09-11T07:10:13.604 INFO:teuthology.orchestra.run.smithi110.stdout:*hv02.front.sepi 63.231.80.2 3 u 33 64 177 0.140 +0.272 1.152 2024-09-11T07:10:13.604 INFO:teuthology.orchestra.run.smithi110.stdout:+hv03.front.sepi 74.6.168.72 3 u 29 64 177 0.066 +0.237 1.064 2024-09-11T07:10:13.604 INFO:teuthology.orchestra.run.smithi110.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-11T07:10:13.605 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-11T07:10:13.613 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-11T07:10:13.614 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-11T07:10:13.647 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-11T07:10:13.681 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-11T07:10:13.714 INFO:teuthology.task.internal:Duration was 883.884667 seconds 2024-09-11T07:10:13.715 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-11T07:10:13.747 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-11T07:10:13.748 DEBUG:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T07:10:13.750 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-11T07:10:13.789 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-11T07:10:13.789 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi079.front.sepia.ceph.com 2024-09-11T07:10:13.789 DEBUG:teuthology.orchestra.run.smithi079:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T07:10:13.838 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-09-11T07:10:13.838 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-11T07:10:13.848 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-11T07:10:13.848 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T07:10:13.882 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-11T07:10:13.916 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-11T07:10:13.917 DEBUG:teuthology.orchestra.run.smithi079:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T07:10:13.954 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-11T07:10:14.032 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-11T07:10:14.042 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-11T07:10:14.042 DEBUG:teuthology.orchestra.run.smithi079:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T07:10:14.053 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-11T07:10:14.064 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-11T07:10:14.106 DEBUG:teuthology.orchestra.run.smithi079:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T07:10:14.108 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-11T07:10:14.117 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = core 2024-09-11T07:10:14.117 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-09-11T07:10:14.196 DEBUG:teuthology.orchestra.run.smithi079:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T07:10:14.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T07:10:14.201 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-11T07:10:14.241 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T07:10:14.241 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-11T07:10:14.251 INFO:teuthology.task.internal:Transferring archived files... 2024-09-11T07:10:14.252 DEBUG:teuthology.misc:Transferring archived files from smithi079:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648/remote/smithi079 2024-09-11T07:10:14.252 DEBUG:teuthology.orchestra.run.smithi079:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T07:10:14.277 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-10_21:16:03-rbd-squid-distro-default-smithi/7900648/remote/smithi110 2024-09-11T07:10:14.277 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-11T07:10:14.306 INFO:teuthology.task.internal:Removing archive directory... 2024-09-11T07:10:14.306 DEBUG:teuthology.orchestra.run.smithi079:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T07:10:14.314 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-11T07:10:14.350 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-11T07:10:14.361 INFO:teuthology.task.internal:Not uploading archives. 2024-09-11T07:10:14.361 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-11T07:10:14.433 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-11T07:10:14.433 DEBUG:teuthology.orchestra.run.smithi079:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T07:10:14.436 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-11T07:10:14.439 INFO:teuthology.orchestra.run.smithi079.stdout: 658633 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 07:10 /home/ubuntu/cephtest 2024-09-11T07:10:14.441 INFO:teuthology.orchestra.run.smithi110.stdout: 658465 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 11 07:10 /home/ubuntu/cephtest 2024-09-11T07:10:14.443 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-11T07:10:14.467 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-11T07:10:14.541 INFO:teuthology.run:Summary data: description: rbd/thrash/{base/install clusters/{fixed-2 openstack} conf/{disable-pool-app} msgr-failures/few objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/rbd_fsx_rate_limit} duration: 883.8846673965454 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-11T07:10:14.542 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T07:10:14.648 INFO:teuthology.run:pass